13TH  WORLD  CONGRESS 

ON 

COMPUTATION  AND  APPLIED 
MATHEMATICS 


JULY  22  -  26,  1991 
TRINITY  COLLEGE  DUBLIN 
IRELAND 


Selects: 

SEP  30199l|  I 

tjl 


IN  FOUR  VOLUMES 


gj-ATEWEWf  A 

far  p«bB«  nbmm 


I 


IMACS  ’91 

Proceedings  of  the  13th  IMACS  World  Congress  on  Computation  and  Applied 
Mathematics 

July  22-26, 1991, Trinity  College,  Dublin,  Ireland 
in  four  volumes 


¥©LUM! 


j  -  i.i 
L5t; 


iur.^'cmr 

..■TJi.'t'oi  1  .’..r-ji.-t 


Computational  Fluid  Dynamics  arid'W.av&Pxopagation 
Parallel  Computing  ,f  '  •>  *  __ 

Concurrent  and  Supercom'pufi'ng  -  * 

Computational  Physics/Comp'iiVatiOnaljChbfftiistry  and  Evolutionary  Systems 


EDITED  BY:  R  Vichnevetsky 

Rutgers  University 
New  Brunswick,  USA 


91-11591 


J  J  H  Miller 
Trinity  College 
Dublin,  Ireland 


Copyright  ©  1991  IMACS  -  International  Association  for  Mathematics  and  Computers  in  Simulation 

Pa1  °f th'S publicaUon ma>  ^ ^Produced, stored  m a retnev al s> stem  or  transmitted  in an>  fonn or 
SS.fflSrtS""'8™1  «*•  "****  ph0l0COP>mS'  prior 


[<?;>  I 

V?  zs  Accession  ?or 

BUS  QRAAI  ft? 

MIC  TAB  □ 

Unannounced  □ 

Justification _ 

f/UAn.  Si 

\f(r  Dlat-rlbutlonZ 

IMACS  Symposium  Rutgeirs  Univ  Dept  of  ,t  _  Availability  Codes 
Computer  Science  New  Brunswicks,  NJ  08903  \  Avail  and/or 

Mat  Special 

100.00  per  set  4  Vols.  /]  l  I 


Special 


rW 


Printed  in  Ireland  by  Criterion  Press,  Dublin 


A  UNIFORM  NUMERICAL  METHOD  FORA  CLASS  OF 
QUASILINEAR  TURNING  POINT  PROBLEMS 

Relja  Vulanovic 

Institute  of  Mathematics,  University  of  Novi  Sad 
21000  Novi  Sad,  Yugoslavia 


Abstract.  An  Lx  -stable  quasilinear  singularly  perturbed  bound¬ 
ary  value  problem  with  a  single  turning  point  is  solved  numer¬ 
ically  by  a  finite-difference  scheme  on  a  mesh  which  is  dense 
near  the  turning  point.  The  scheme  is  a  special  variant  of  tht 
upwind  scheme  andit  has  better  properties  than  the  standard 
Engquist-Osher  scheme. 

Introduction 

We  consider  the  following  singularly  perturbed  boundary  value 
problem: 

—  eu"  —  xb(x,u)u'  +  c(x, u)  =  0,  x  6  I  =  [— 1, 1],  (1) 

«(-l)  =  t/_,  u(l)  =  U+,  (2) 

where  e  is  a  small  positive  parameter,  U±  are  given  numbers,  b 
and.c  are  sufficiently  smooth  functions,  and 

c(*,-u)  =  xci(x,  u)  +  ec2(x,  u),  (3) 

b(x,u)>  b.  >  0,  x  6  I,  u  6  R.  (4) 

Let 

fU 

f(x,u)=  xb(x,s)ds,  g(x,v)  =  fx(x,u)  +c(x,u). 

JO 

Then  (1)  can  be  written  down  in  the  form. 

-  eu"  -  f(x,  u)'  +  g(x,  u)  =  0,  x  €  I.  (5) 

Furthermore,  we  assume: 

<7u(z,u)  =  clt(x,u)+(xb(x,u))I  >  g.  >  0,  x  e  I,  u  €  R.  (6) 

Numerical  treatment  of  problems  of  this  type  was  considered  in 
[2]  (the  linear  case)  and  [3]  (the  semilinear  case  6  =  b(x)).  By 
using  the  technique  from  [2],  (3),  based  on  inverse  monotonicity 
and  (3),  (4),  (6),  we  can  get  that  the  problem  (1),  (2)  has  a 
unique  solution  y  and  that  the  following  estimates  hold  for  x  £ 
/: 

ll/(*)l  ^  M,  |(x!/(s)),|  <  AT,  |(a:J/(a:))"|  <  M(1  +  /r-1u(a:)), 

s|*/"(a:)I  <  M\\x\  +  ft  +  v(a:)],  e|y"'(a:)(  <  M[  1  +  n~lv(x)], 

where  /r  =  e1/2  and  v(x)  =  exp(-|r|//j),  and  throughout  M 
denotes  any  positive  constant  independent  of  e.  These  estimate0 
are  needed  in  the  consistency-error  analysis. 

Numerical  Method 

We  shall  use  finite-differences  on  a  special  discretization  mesh, 
the  approach  from  (2],  [3].  The  estimates  above  show  that  y 
has  an  interior  layer  at  x  =  0,  and  because  of  that  we  shall  use 
a  mesh  which  is  dense  near  that  point  The  mesh  Ih  has  the 
points: 

Xi  =  \{hi  —  1),  t  =  0(l)n,  h  =  2/n,  n  =  2m,  mg  N, 

[  w(t):=  nt/{l/2-t<  if  i€(0,«], 

X(t)  =  <  w'(a)(f  -  ct)  +w(or)  if  t  G  («,  1), 

1  -AH)  if  t  g  (-1,0). 


Here  (u,~'(u))  denotes  the  contact  point  of  the  tangent  line 
from  (1,1)  to  w(t). 

Let  h,  —  x,  —  i,_|,  t  —  l(l)u,  and  let  t uh  and  zh  denote 
arbitiarj  inesh  functions  defined  on  Ih  \  {-1, 1}.  We  set  wh  — 
[u.’i,U)2,...,U!„_1]t  and  w0  =  Lr_,  ts„  =  U+.  Furthermore,  let 

D- Wi  =  (to;  -  Wi-i)/h„  D+Wi  =  (wi+1  -  w;)//i;+i, 

and  let  /,  =  /(*,-,«»,-),  <?,-  =  g(x,-,u ),-).  Let  us  form  the  discretiza¬ 
tion  of  (5),  (2): 

Twi  :=  (Twh)i  =  0,  i  —  l(l)n  —  1,  (7) 

Tu>i  =  -£(D+w,  -  D_ui,)//i,  -  D_/,  +  gn  i  =  l(l)m  -  1, 
Twi  =  —e[D+w;  —  D_to,]//rI+1  -D+f,+git  i  =  m  +  l(l)n-l, 

=  ~ e(wm-I  _  2u»m  +  wm+l]/bfn  —  (/m+l  /m-l]/2/lm  +  Qmi 

(note  that  hm  =  hm+!).  The  following  stability  inequality  holds: 
with  the  discrete  Lx  norm: 

ll^lh  =  I^^KI+  Y. 

1=1  I=m+1 

Then  the  first  older  uniform  convergence  can  be  proved  due  to 
the  special  mesh  and  the  estimates  from  the  Introduction: 

l|yA-!/4.  <Mh, 

where  M  does  not  depend  on  h,  yh  is  the  unique  solution  to  (7) 
and  xjh  is  the  restriction  of  y  on  /*\{— 1, 1).  Moreover,  numerical 
results  show  pointwise  uniform  convergence  as  well.  This  is  not 
^the  case  with  the  Engquist-Osher  (EO)  scheme  (1)  in  general, 
see  [2).  The  EO  scheme  is  uniformly  convergent  only  globally 
-  in  the  standard  discrete  L 1  norm  (1-3).  This  is  because  the 
EO  scheme  uses  D±  with  (h,  +  /r,+i)/2  instead  of  /i,+i  and  hi. 
Another  advantage  of  our  scheme  is  that  it  uses  a  simpler  mesh 
generating  function  A  than  the  upwind  schemes  in  [2]  and  (3). 

We  illustrate  these  facts  by  some  numerical  results  for  the 
problem  with  6  =  1,  c  =  -~{x  sin(Trx)  +  £-cos(-x)j  and  U-  = 
-2,  U+  =  0,  for  which  the  solution  is  known,  see  (3).  Let  E 
denote  the  maximal  pointwise  error  for  e  =  1CT12.  Our  scheme 
gives  E  =  0.386,  0.215,  0.115  for  »  =  50,  100,  200,  respectively. 
Results  for  other  values  of  e  are  similar  due  to  the  special  mesh. 
The  EO  scheme  docs  not  converge:  E  =  4.99,  8.131,  8.09  for 
the  same  values  of  n. 
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A  NOTE  ON  A  SPLINE  COLLOCATION  METHOD  FOR 
SINGULARLY  PERTURBED  PROBLEMS 


,  Katarina  Surla 

Institute  of  Mathematics,  University  of  Novi  Sad 
21000  Novi  Sad,  Yugoslavia 


Abstract:  The  exponential  spline  collocation  methods  for  sin¬ 
gularly  perturbed  boundary  value  problem  are  considered.  The 
convergence  between  mesh  points  for  different  collocation  con¬ 
ditions  is  compared.  Numerical  results  are  presented. 

Introduction 

We  consider  the  following  singularly  perturbed  boundary  value 
problem: 

£y"  +  p{*)y'  =  f{x),  x  e  i  =  [o,  1),  ( 1  j 

1/(0)  =  a0,  !/(l)  =  ari,  (2) 

where  £  is  a  small  positive  parameter,  a0  and  a,  are  given  num¬ 
bers,  p  and  /  are  sufficiently  smooth  functions  and  p(  x )  >  p  >  0. 

By  using  exponential  spline  e(x)  from  (2),  e(x)  g  C*(/),  as  a 
collocation  function  a  family  of  difference  schemes  is  derived  in 
(4).  The  well  known  Allan-Southwel-  Il’in  and  El  Mistikawy- 
Werle  (  EMW  )  schemes  are  members  of  this  family.  Some  of 
the  properties  of  the  scheme  (4).(r>),(6)  ,  which  belongs  to  the 
same  family,  are  better  than  those  of  EMW  scheme  ([3]).  In 
this  paper  we  consider  the  approximation  between  the  mesh 
points  which  correspond  to  both  EMW  scheme  and  to  scheme 
(4), (5), (6).  Both  splines  have  firf.r,  order  of  uniform  convergence 
on  the  whole  interval,  but  the  numerical  lcsults  are  much  better 
for  the  scheme  (4), (5), (61-  This  is  the  consequence  of  the  bettei 
accuracy  at  the  nodes.  If  will  also  be  shown  that  the  collocation 
spline  given  in  [4]  is  equal  to  the  one  used  for  the  derivation  of 
EMW  scheme  (  [lj  ). 

Collocation  Method 
The  spline  e(x)  has  the  form  ([2]): 

e(.c)  =  c,(x)  =  u,  +hm,t-hgj(chii,i  -  l)/p,  +  q,(.sl,p,t  ~i‘, )//>,, 

.r  g  (.r,,. i /+i], 

where  t=(x-x;)//i,  X=jh,  h=l/(n+  1),  p,  -  hp,.  j-OflJn,  p, 
are  tension  parameters.  The  values  y,  and  q,  an  Jitiimlnu! 
from  the  requirement  t(.r)  £  C'(J)  Fiorn  the  volloi  ation  .  uii 
ditions 

sc"(x)  +  p*e'(x)  =  /*,  x  -  x,, .r  =  .rJ+, ,  (3) 

where  p+  and  /+  arc  constant  aproximations  to  p(.r)  and  fix) 
oil  the  interval  (x;,x;+!)  for  fixed  j ,  the  following  family  of  tin 
difference  schemes  is  derived  in  (4): 

r-t<j_i  +  rcU,  +  r+uJ+ 1  =  q~f~  +  q*  f* .  j  =  1(1  )n,  (I) 

«o  =  o  o,  (o) 

where 
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r+  =  (p+/(l  -  cxp[-p+),  r~  =  p~cxp(~n~)/(l  -  exp{-n~)), 
rc  =  -r-  -  r+ 

/y+  =  (e:rp(-p+)+p+  -  l)/(p+(l  -  exp(-p+)))i 
?“  =  (1  -  cxp(-p-) - p~exp(-p-)/(p-(  1  -  exp(— p-))), 

lt+  =  p+h,  p~  = p~h,  p*  =  p+/s,  p~  —  p~/et  p~  and  f~  aie  con¬ 
stant  apioximations  to  p(x)  and  /(x)  on  the  interval  [xJ_,,x;]. 

By  determing  p±  =  (p(x,±i)+p(xi))/2,/±  =  (f{x]±i)+f(x,))/2 
we  obtain  EMW  scheme,  whereas  for 

p*  =  p(Xj  ±  /i/2),  /*  =  f(xj  ±  /i/2)  (6) 

we  obtain  the  scheme  from  (3)  (  (4), (5), (6)).  In  (1)  the  exact 
solution  of  the  problem:  ; 

in"  +  p*u‘  -  /+,  x,  <  x  <  XJ+i , 

u(x,)  =  u,,  u(x,)  =  uJ+l, 

is  used  foi  the  approximation  between  mesh  points.  The  func¬ 
tion  c,(x)  has  the  form:  1 

<_,(■>' )  =  span{l,x,cxp(o,x),  cxp(—p,x)}. 

Since  conditions  (3)  lead  to  the  elimination  of  the  function 
rrp(p,r)  from  the  spline  base,  aftci  some  analysis  of  the  con-  ' 

stants  one  can  see  that  u(.  )  =  c,(x).  Thus,  the  calculation  ] 

becomes  simplei  when  one  use  the  spline  in  the  form  of  the 
piecewise  function  u(x)  ,  The  properties  of  that  function  are 
given  in  [2).  Some  connections  between  the  spline  e(x)  and  the 
cubic  spline  are  given  in  (6).  The  family  of  difference  schemes 
corresponding  to  the  cubic  spline  is  presented  in  [5].  With  re¬ 
gal  d  to  second  older  polinomials  some  characteristics  of  scheme 
(4), (5), (6)  are  shown  in  (3):  the  scheme  becomes  exat  when  £ 
goes  to  zeio  ;  the  major  term  of  the  error  is  four  times  smallei 
than  the  one  for  EMW  scheme  when  h  <  £.  Both  schemes  have 
tin-  second  order  of  uniform  convergence  at  the  mesh  points. 

The  piesented  numerical  results  show  that  the  error  between 

nu  sh  points  has  similar  properties.  In  the  way  presented  in  (lj 

on>  t«m  plow  that  the  estimates  given  foi  spline  corresponding  \ 

to  EMW  scheme  are  also  valid  for  the  spline  corresponding  to  « 

scheme  (4),  (5), (6).  < 

n 

Numerical  results  ■ 

Tin  exam)  li  is  taken  from  (1).  We  denote  by  En  the  maximum  , 

of  |i/(.i,  +  h/2)  -  ut.r,  +  /*/2)|,  j  -  0(1 )«.  The  order  of  conver-  < 

gene"  ( Ord)  for  two  succesivc  values  of  n  with  respective  errors 

En  and  Eln  is  defined  in  the  usual  way  as  in  {lj.  Tables  1  and  J 

2  piesent  the  numerical  results  obtained  by  EMW  and  scheme 

(<1 ).( 5 ).( G )  respectively.  The  better  behaviour  for  small  £  of  the  J 

scheme  presented  in  Table  2  results  in  hasty  decline  of  Ord.  , 


1 


e 


n 


£ 


5.578(-3)  I  8.314(-3)  3:373(-3)  |  3:153(-3) 


l,393(-3)  1.891(-3)  9.356(-4)  8.176M) 


I  ►Mil 

I  Ea 


3.491(-4)  4.865(-4)  I  2.940(-4)  I  2.095(-4) 


1.985  1.856  1.924  1.930  Ord 


8:733(-5)  1.221(-4)  3.055(-4)  5,378(-5) 


2.000  1.976  1.938  1.966 


2.184(-5)  3.070(-5)  2.173(-4)  1  400(-5) 


1.956  1.876  1.9S3 


5.459(-6)  7.6S7(-6)  4.800  (-5)  3.774(-6) 


2:000  1.993  1.687 


1.365(-6)  1.922(-6)  5.870(-6) 


2.000  1.998  1.633  1.989 


imi 


8  |  1  364(-3) 


3.464(-4) 


2-io  2- 


2.049(-3)  I  1.045(-3)  1.070(-3)  |  t 


Ord 


4.0401 -4)  |  2.585(-4)  |  2.685(-4) 


Im 


8  716(-5)  I  1.152(-4)  1  6.360(-5)  |  6.663(-5) 


11967  1.138  2.011  1.945 


2.1S3(-5)  3.006(-5)  2.0S5(-4)  1.650(  5) 


1.996  T758  2.109  1.980  |  Ord 


5.459(-6)  ]  7:642(-6)  1.891H)  |  4.084(-6) 


1.999  1.873  .836 


1.365(-6)  1.920(-6)  4.172  (-5)  l:010(-6) 


2;000  1.965  -1.186  2.031 


3.412(-7)  4.805(-7)  4.771(-6)  1.26S(-6) 


2.000  |  1.998  1 0.252  (-1)  |  2.075 


IEE1 
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A  Posteriori  Error  Bounds  for  Piecewise  Linear  Approximate  Solutions 
of  Singularly  Perturbed  Nonlinear  Elliptic  Problems 

Koiclii  Niijima 

Department  of  Control  Engineering  and  Science 
Kyushu  Institute  of  Technology 
Iizuka  820,  Japan 

Abstract:  A  method  for  finding  a  posteriori  error  bounds  for  piecewise  lin¬ 
ear  approximate  solutions  of  singularly  perturbed  nonlinear  elliptic  problems  is 
proposed.  A  relation  between  a  line  integral  on  an  edge  of  a  triangle  and  volume 
integrals  in  the  triangle  plays  an  important  role. 


1.  Introduction 

Recently,  we  developed  a  metliod-for  finding  er¬ 
ror  estimators  for  piecewise  linear  approximate 
solutions  of  nonlinear  elliptic  problems  (Niijima 
[ij,  Niijima  [2]).  We  will  apply  this  method  to 
piecewise  linear  approximate  solutions  of  singu¬ 
larly  perturbed  nonlinear  elliptic  problems.  Gen¬ 
erally,  numerical  solutions  of  such  problems  do 
not  necessarily  have  a  continuous  piecewise  lin¬ 
ear  form.  So  numerical  data  obtained  are  inter¬ 
polated  piecewise  linearly  such  that  our  method 
can  be  applied. 

2.  Preliminaries 

Let  SI  be  a  bounded  polyhedral  domain  in  R2  with 
a  boundary  dSl  and  consider  the  following  prob¬ 
lem: 

-eAu  +  f(x,  y,  u,  Vu)  =  0  in  SI,  (1) 

u  =  0  on  dSl,  (2) 

where  e  is  a  sufficiently  small  positive  constant 
and  Vu  =  (uz,uy). 

A  weak  form  of  (1)  and  (2)  is 

e(Vu,Vv)  -f  a,  Vu),  v)  =  0  (3) 

for  any  v  belonging  to  the  Hilbert  space  II q  (Si), 
where  (-,•)  denotes  an  L2(Sl)  inner  product. 

We  assume  that 

HI.  (3)  has  a  solution  in  II& (SI), 

112.  there  exists  a  >  0  such  that  for  v,  w  6 


um, 

e(V(v  -  w),V(v -w)) 

+(/(*, V,  v,  Vu)  -  f(x,  y,  w,  Vu/),  v  -  w) 

>  e  ||  V(u  -  w)  ||2  -fa  ||  v  -  w  ||2, 

where  ||  ■  ||  indicates  an  L2(Sl)  norm. 

Consider  a  triangulation  of  fi  and  let  F  be  the 
set  of  triangles.  Let  r  be  a  triangle  in  F  and 
let  three  edges  of  r  be  71,  72  and  73.  Denote 
the  vertices  corresponding  to  71,  72  and  73  by 
(*l,2/l),  (*2,2/2)  and  (x3,  y3),  respectively. 

We  have  the  following  lemma. 

Lemma  1.  For  g  belonging  to  the  Ililberl  space 
II1(t),  we  have 

(i’ff>75=|f|t2(1,!7)r 

+  (*-  *3 ,gz)r  +  (y  -  V3,  <7 v)r]- 

Here  <  •,  ■  >73  and  (•,  -)r  indicate  inner  products 
on  73  and  r,  respectively.  Also 

h  =  (*2  -  *1X2/3  -  2/1 )  -  (*3  -  *1X2/2  -  2/1) 
and J73I  denotes  the  length  of  73. 

This  relation  is  a  formula  changing  a  line  inte¬ 
gral  on  an  edge  into  the  sum  of  three  volume  inte¬ 
grals  in  r.  By  this  formula,  we  can  rewrite  the  line 
integrals  appearing  in  partial  integrations  of  the 
gradient  term  by  elementwise  volume  integrals. 

3.  Main  results 

Let  E  be  the  set  of  edges  not  on  dSl.  Consider 
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twoitriangles  r_  and  r+  sharing  an  edge  7  in  E, 
where  a  normal  direction  mis  outward  from  r_. 
Let  (ari,j/i),  (x2,y2)  and  (x_,y_)  be  the  vertices 
of  r_,  and  (si,  j/i),  (£2,2/2)  and  (a:+,y+)  the  ver¬ 
tices  of  r+.  Denote  tiie  mesh  size  by  li.  Let  uh  be 
a  continuous  piecewise  linear  function  and  define 
a  jump  in  duh/dn  across  7  by 

r^uN  —  ^ uh  1  ^ I 

W7  "  3^|r+~  3n|r-- 

Formatter  convenience,  we  define  [duh/dn]7  =  1 
for  edges  7  on  3ft. 

Let  r  be  a  triangle  in  F  and  let  71,  72  and  73  be 
three  edges  of  r.  From  now,  we  use  the  symbol  ub 
to  denote  a  piecewise  linear  interpolate  solution 
of  (3).  We  now  define  an  operator  A*  by 


Abub 


Here,  if  7 ,•  (E  E,  then  the  parameter  wT>i  has  a 
relation 

Wr,i  +  wTiti,  =  1 

for  the  parameter  uv.i',  where  r'  is  the  other 
triangle  sharing  7,-.  If  7;  is  on  3ft,  then  wTli  is 
free  and  [dub/dn]1;  =  1. 

Using  the  same  symbols  as  above,  we  further 
define  a  two-dimensional  vector  rb  by 


rr  =  -  *0. 


We  define  Aft  and  rh  by  Ah  =  (A^)rgf  and  rb  = 
(rb)T£F,  respectively.  By  W,  we  denote  the  set 
of  vectors  whose  components  consist  of  all  wr. 

Using  Lemma  1,  we  can  prove 
Lemma  2.  Let  ti  be  a  solution  of  (3)  and  let  uh 
be  a  piecewise  linear  interpolate  solution  of  (3). 
We  put  e  =  u  -  uh  and  define  L  by 


L  =  e(Ve,  Ve) 

+(/(*,  y,  w,  Vu)  -  f(x,  y,ub ,  Vu*),  e). 


Then  we  have 

L  =  -(-eA  huh  +  fb ,  c)  +  (erh,  Ve), 

where  we  put  fb  =  /(a:,  y,  uh,  Vuft)  for  simplicity. 
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We  obtain  the  following  theorem  by  applying 
the  Schwarz’  inequality  to  the  right  hand  side  of 
L  in  Lemma  2. 

Theorem.  We  have,  for  e  =  u  —  uh, 
e||Ve||2 +  a||e||2 

<  inf{l||  -eAV  +  /ft||2  +  e||rA||2}.  (4) 

Remark:  infiy  {L||  -  eA hub  -f  /h||2  +  e||r/*||2)  is 
a  quadratic  minimization  problem. 

4.  Numerical  results 
Example. 

—eAu  +  «3  +  «-  y  =  0 

in  ft  =  (0,  l)x  (0, 1), 

«  =  0  on  3ft, 

where  e  .—  10“3  and  g  is  determined  such  that 
u  =  (1  -  exp(-£^))(l  -  exp{-^f))  satis¬ 
fies  the  above  equation.  It  is  easily  verified  that 
112  holds  as  a  =  1.  Divide  the  interval  (0, 1)  into 
m-equidistant  subintervals  and  make  a  triangula¬ 
tion.  The  numerical  solutions  ub  were  obtained 
by  the  Ritz-Galerkin  method.  A  posteriori  error 
bounds  were  computed  following  Theorem,  and 
were  compared  with  actual  errors. 

m  i/r./i.s  of  (4)  y/l.h.r,  of  (4) 


4 

0.732 

0.402 

6 

0.486 

0.281 

8 

0.353 

0.214 

10 

0.274 

0.170 

12 

0.223 

0.142 

14 

0.188 

0.121 

16 

0.163 

0.105 

The  experiment  was  performed  by  using  Turbo 
PascalVer.5.5  011  the  personal  computer  EPSON 
PC-286UX. 
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Iterative  methods  for  convection  dominated  flow 


R.  B.  Kellogg 
Inst.  Physical  Sci.  Tech. 

University  of  Maryland 
College  Park,  Md.  20742  USA 

Abstract  -  Some  iterative  methods  are  considered  for  the  numerical 
solution  of  convection  diffusion  problems.  The  first  class  of  iterative 
methods  is  Chebyshev  accelerated  iterations.  The  issuesof  parame¬ 
ter  selection  and  convergence  rates  are  considered.  Secondly,  we  con¬ 
sider  convection  -  diffusion  type  iterations  where  the  iterations  are  of  a 
Peaccman-Rachford  type.  Here,  a  convergence  method  is  established, 
and  a  conjecture  is  given  concerning  a  related  problem  in  functional 
analysis. 

A.  Chebyshev  iterations 

We  consider  Chebyshev  accelerated  iterations  for  the  numerical  so¬ 
lution  of  discretizations  of  the  convection  diffusion  equation 

-  eAu  +  pux  +  qu„  +  ru  =  /  in  fl, 
u  =  y  on  3D, 

and  related  systems,  such  as  the  Oseen  system.  If  a  discretized  version 
of  (l)  is  written 

Am  =  /,  (2) 

the  methods  we  consider  may  be  written 

uk+l  =  out Auk  +  pkuk  -t"ikMk~l,  (3) 

with  initial  guess  u°,  where  the  iteration  parameters  ak,fSk,'fk  satisfy 
Pk+'lk=l,  'to  =  0.  (4) 

From  (3)  and  (4)  one  Ends  that  the  solution  u  is  preserved  under 
the  iteration,  and  the  error  ck  =  u  —  uk  satisfies  e*'*'1  =  akAck  +  f)ksk  + 
r)ktk~l.  Hence,  defining  a  set  of  polynomials  Pk(X]  by 

Po(A)  =  1,  P*+i(A)  =  ckXPk(X)  +  pkPk(X)  T  7*P*-,(A),  k  -0,1, 

we  find  that  ek  =  Pk(A)c°.  Rrom  this  formula  it  is  seen  that  the  iter¬ 
ation  parameters  should  be  chosen  so  that  the  values  of  Pk  are  small 
on  the  spectrum  of  A.  Manteuffcl  fl]  has  shown  how  to  choose  the  Pk 
in  terms  of  Chebyshev  polynomials  so  as  to  optimize  the  convergence  of 
the  iterations.  Manteuffel’s  choice  requires  a  knowledge  of  an  ellipse  f 
that  contains  the  spectrum  of  A  and  that  does  not  contain  the  origin. 

In  the  first  part  of  this  talk  we  show  how  to  obtain  ellipses  C  in  an 
explicit  manner  from  a  knowledge  of  the  coefficients  of  the  equation  (I), 
the  mesh  spacing  h,  and  the  discretization  A.  We  also  give  estimates  for 
the  asymptotic  rate  of  convergence  of  the  resulting  iterative  method  in 
terms  of  the  parameters  c  and  h.  Finally,  we  give  similar,  results  for  a 
preconditioned  version  of  (I),  where  we  precondition  by  the  self  adjoint 
part  of  the  operator. 

Details  of  this  work  arc  contained  in  [2j. 
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B.  Peaccman  Itachford  type  Iterations 

We  consider  the  convection  diffusion  equation 

Au  3  —  Au  +  p  ■  Vu_+ru  = /,  in  D, 
u  =  0  on  T  =  30. 

Divide  T  into  two  subsets,  Tla  =  {(z,  y) .  n  p  <  0},  and  rou,  =  T  \  rin. 
Here  n  is.the  outward  point  unit  normal. to  I\  We  consider  the  CDI 
method  for  solving  (i):  guess  u°,  and  define  ,  by 

— Aul+1/2  +  puk+1/2  =  puk-p-  Vu*  -  ru*  +  /,  uk+l/2  =  0  on  T, 
p  ■  Vufc+1  +  pufc+1  =  puk+,/2  -  Duk+1‘ 2  +  /,  ufc+1  =  0  on  r,„. 

To  study  the  convergence  of  this  method,  it  is  convenient  to  define 
the  operator  Ad  by 

Lou  =  — Au,  u  =  0  on  T, 
and  the  operator  Lc  by 

Lcusp-Vu  +  ru,  ti  =  0onr|n. 

With  these  definitions,  the  iterations  may  be  written 
(pi  +  Lp)uk+'l2  =  (pi  -  Lc)uk  +  /, 

(pi  +  Ac)u*+1  =  (pi  -  LD)uk+tl2  +  /. 

We  regard  Ld  and  Ac  as  closed,  unbounded  operators  on  Lj((l).  Ld 
and  are  accretive  in  the  sense  that  for  some  ce  >  0, 

(LDM,u)  >ct(u,u), 

(LcM.u)  >  ct(u,u). 

Also,  Ld1  and  A£*  are  bounded  operators  on  A2(fi),  and  A31  is  a  com¬ 
pact  operator.  Finally,  any  positive  p  is  in  the  resolvant  set  of  Ld  and 
Ac-  With  this  understanding  we  define 

„*+*/»  =  (p/  +  Ad)u*+1/*,  k  =  0,1,-, 
vk  =  (pI  +  Lc)uk,  k  =  0,1,--., 

and  we  set 

Td  =  (pi  +  Ld)~1(pI  —  Ld)  —  1p(pl  +  Ad)  1  —  A> 

To  ~  (pi  +  Ac)-1  (pi  -  Ac)  =  2 p(pl  +  Ac)  1  —  I- 
Thus,  Tp  and  To  are  bounded  operators,  and  Tp  is  a  compact  pertur¬ 
bation  of  -I.  Also,  from  the  accretiveness  of  Ac  anmd  Lp  one  cc..  show 
that 

I|Tb||  <  1,  ||Tc||<l. 

In  terms  of  these  operators,  (2)  may  be  written 
„*+l  l*  =  Tcvk  +  f, 
vk+l=TDvk*l/2  +  f. 

To  establish  the  convergence  of  the  method,  vie  must  show  that 
(rDrc)tu-  -  0 

for  any  10  6  Aj(D).  This  is  easily  shown  in  the  finite  dimensional  case.  It 
becomes  an  interesting  conjecture  in  the  case  of  the  differential  operator. 
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EXPLICIT  FINITE  ELEMENT  METHODS  FOR 
CONVECTION-DIFFUSION  PROBLEMS 

GERARD=R.  RICHTER 
Department  of  Computer  Science 
Rutgers  University 
New  Brunswick,  NJ  08903 


Abstract.  We  describe  some  recent  work  on  explicit  fi¬ 
nite  element  methods  for  convection  dominated  convection- 
diffusion  problems.  We  develop  the  methods  for  pure  hyper¬ 
bolic  equations,  and  then  discuss  their  extension  to  problems 
with  diffusion. 


T.  Introduction.  Our  purpose  is  to  summarize  some  re¬ 
cent-work  on  finite  element  methods  for  convection-diffusion 
equations  in  which  convection  is  the  dominant  term.  One  al¬ 
ternative  for  such  problems  is  the  streamline  diffusion  method 
[3,4],  in  which  the  usual  Galerkin’s  method  test  functions  are 
augmented  by  a  convective  derivative  term.  There  arc  also 
“explicit”  finite  element  methods,  which  permit  development 
of  an  approximation  in  an  clement  by  clcr .  nt,  as  opposed  to 
global,  fashion.  It  is  the  latter  class  of  methods  that  we  shall 
be  concerned  with. 

We  first  describe  these  methods  for  a  linear,  scalar  hyper¬ 
bolic  problem 

(1:1)  a(z)-Vu  +  j3(z)u  =  /(i),  x  g  Cl, 
u  =  g,  x  6  r m(fl). 

Here  f l  C.  B?  is  a  bounded  polygon  with  boundary  T,  and 
a  is  assumed  to  have  unit  length.  The  “inflow"  boundary 
r,-„(n)  C  T  is  characterized  by  a  •  n  <  0  where  n  is  the  unit 
outer  normal  to  Cl. 

We  shall  assume  Cl  has  been  divided  into  triangles  and/or 
rectangles  in  such  a  way  that  the  nonalignment  condition 
|a-n|  0  holds  for  all  element  edges.  This  amounts  to  an  as¬ 

sumption  of  unidirectional  “flow”  across  all  edges,  and  allows 
the  elements  to  be  ordered  explicitly  witii  respect  to  domain 
of  dependence  [6].  In  other  words,  the  solution  '  *  the  con¬ 
tinuous  problem  (1.1)  can  be  developed  first  in  one  clement 
(the  inflow  to  which  must  be  contained  in  r,„(n)),  then  in 
another,  etc.  In  general  there  will  be  many  explicit  orderings 
for  a  given  mesh,  and  it  is  potentially  advantageous  to  view 
the  solution  as  evolving  as  a  front,  in  parallel,  across  layers 
of  elements.  The  class  of  finite  clement  methods  of  interest 
here  arc  those  which  allow  development  of  an  approximate  so¬ 
lution  in  the  same  explicit  manner.  Henceforth  wc  shall  deal 
exclusively  with  the  case  of  triangular  elements. 


We  need  some  additional  notation  to  describe  these  meth 
ods.  For  a  generic  triangle  T,  let  P„(T)  denote  the  set  of 
polynomials  of  degree  <  n  over  T,  i.  e.,  linear  combinations 
of  x'y}  ,  0  <-i  t  j  <  it.  We  denote  by  S°  the  space  of  piecewise 
polynomials  over  the  given  triangulation  whose  restrictions 
to  individual  triangles  T  lie  in  P„(T).  A  function  wk  6 
will  in  general  be  discontinuous  across  triangle  edges T;,  and 
for  P  g  Pt-  we  define  its  upstream  (-)  and  downstream  (-f) 
limits  by  u»*(P)  =  lim,_o+«>fc(P  ±  to).  The  space  S\  C  SjJ 
will  consist  of  continuous  piecewise  polynomials  over  the  same 
tri  angulation. 

The  discontinuous  Galcrkin  method  [6,7j  produces  an  ap¬ 
proximation  uk  g  S“  satisfying  the  conditions 

(1.2) 

(a-Vuh+fiuh,vh)-  (u% -u^)i iha-nd.T 

JrlHm 

=  (/,”*.).  all  vk  g  P„(T). 

Here  (  ,  )  is  the  L2(T)  inner  product  and  r  denotes  arclength 
along  the  boundary  of  T.  The  approximate  solution  uk  starts 
off  as  an  interpolant  of  the  given  inflow  data  g,  and  is  propa¬ 
gated,  triangle  by  triangle,  via  the  above  inner  product  condi¬ 
tions.  The  triangles  must  of  course  be  processed  in  an  explicit 
order. 

To  formulate  a  continuous  analog  of  the  discontinuous 
Galcrkin  method,  wc  need  to  distinguish  between  onc-inflow- 
sidc  (type  I)  triangles  and  two-inflow-side  (type  II)  trian¬ 
gles.  In  developing  uk  g  S;*  in  a  type  I  (type  II)  triangle 
T,  note  that  uk  willliave  n  1  (2n  + 1)  fewer  degrees  of  free¬ 
dom  in  T  because  uk,  now  continuous,  is  known  already  on 
r in{T).  Thus  it  is  natural  to  define  a  continuous  approxima¬ 
tion  Uh  €  Si  via  the  conditions  (7j: 

(1.3)  (a- Vu*+/?ufc,t 7>)  =  (/>*),  all  vk  €  Vk, 

where  Vk  —  P„_i(T)  if  T  is  of  type  I  and  14  =  P„_;(T)  if 
T  is  of  type  II.  This  will  give  equality  between  the  number  of 
equations  and  unknowns  in  each  triangle.  Wc  assume  n  >  2 
for  method  (1.3),  so  that  the  inner  product  conditions  arc 
non  vacuous  for  both  types  of  triangles.  As  before,  u,t  starts 
as  an  interpolant  of  g  on  r,„(n). 

Both  of  these  finite  clement  methods  arc  generalizations 
of  the  must  basic  first  order  upwind  finite  difference  scheme. 


499 


They  share  its  good  stability  properties,  and  may  be  applied 
for  arbitrarily  large  n.  Numerical  computations  typically  show 
the  optimal  0(hn'*’1 )  rate  of  convergence  when  the  solution  tt  is 
sufficiently  smooth.  Theoretical  error  estimates  may  be  found 
in  [1,5, 6, 8).  Moreover,  the  methods  yield  good  results  when 
applied  to  problems  with  discontinuous  solutions  [llj.  It  can 
be  shown  [2]:that  the  influence  of  a  disturbance  propagating 
along  a  characteristic  is  confined  to  a  band  of  width  approx¬ 
imately  0{\'h)  about  the  characteristic.  Thus  as  h  — »  0,  the 
methods  methods  exhibit  the  right  limiting  domain  of  depen¬ 
dence  behavior. 


2.  Convection-diffusion  equations.  We  now  consider 
a  convection-diffusion  equation 

(2.1)  —  cAti-f  a-  Vu+0u='f,  x  € fi, 

u  =  g,  x  6  T, 

where  a,  a?  before,  has  unit  length,  and  £  is  a  positive  con¬ 
stant.  If  £  is  large  in  comparison  to  the  mesh  size  h,  then  dif¬ 
fusion  will  be  the  dominant  transport  term,  and  the  standard 
Galerkin  method  performs  well.  However,  if  j  is  small,  con¬ 
vection  will  be  dominant,  and  Galerkin's  method  is  no  longer 
the  finite  element  method  of  choice.  Solution  features  that 
are  not  resolved  generate  oscillations  which  tend  to  propagate 
throughout  the  domain.  The  methods  (1.2)  and  (1.3)  can  be 
extended  to  convection  dominated  problems  of  the  form  (2.1), 
thus  providing  an  alternative. 

The  discontinuous  Galerkin  method  can  be  extended  to 
(2.1)  by  treating  the  diffusion  term  in  essentially  the  same 
way  as  the  convection  term: 


(2.2) 

(~eA  Vh  +  a  •  Van  +0uh,v 


~  uh)vh  a-ndrzz  (/,«*), 


all  vk  €  Pn(T). 


This  scheme  uses  upstream  values  of  both  tt/,  and  its  normal 
derivative.  (A  minor  modification  needs  to  be  mode  i  f  r;n(jP)n 
r,n(ft)  r  0  because  -§£-  is  available  only  in  the  interior  of  ft.) 
The  approximation  «/,  starts  as  an  interpolanl  of  g  on  r.-n(ft), 
and  is  developed  in  the  same  explicit  manner  as  in  the  pure 
hyperbolic  case.  It  is  shown  in  [12]  that  this  scheme  is  stable 
for  sufficiently  small  assuming  the  triangle  sides  (with  the 
possible  exception  of  those  on  V)  arc  uniformly  bounded  away 
from  the  characteristic  direction.  Near  optimal  error  estimates 
are  also  derived  there.  Similar  extensions  of  the  continuous 
method  (1.3)  arc  developed  in  (9,10). 

For  a  convection-diffusion  problem  in  which  convection  is 
dominant  only  over  part  of  fl,  these  hyperbolic-based  finite 
clement  methods  can  be  applied  locally,  in  conjunction  with 
the  standard  Galerkin  method.  For  example,  the  solution  to 
(2.1)  typically  has  an  outflow  boundary  layer  of  thickness  0(e ) 
[13].  One  could  apply  (2.2),  say,  up  to  this  point  and  then  use 
Galerkin’s  method  over  a  finer  mesh  to  rcsoivc  the  outflow 
boundary  layer. 


Extensions  of  the  methods  (1.2)  and  (1.3)  to  equations 
with  a  nonlinear  convcctiomterm  are  currently  under  study. 
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Abstract:-  We  shall  discuss  a  number  obmethods  used  in  the  lit¬ 
erature  to  calculate  rates  of  uniform  convergence.  We  mention  some 
anomalies  concerning  interpretation  of  the  resulting  tables  and  rates, 
which  lead  to  the  determination  of  experimental  rates  of  uniform  con¬ 
vergence  lower  than  the  correct  rates. 

Introduction 

The  determination  of  the  order  of  uniform  convergence  is  not  al¬ 
ways  a  straightforward  task.  A  number  of  approaches  exist  in  the 
literature,  the  two  major  variants  being  that  appearing  in  (6)  and  [1] 
and  that  in:[2]. 

The  former  approach  involves  solving  numerically  a  singularly  per¬ 
turbed  differential  equation  on  [xl,xr]  for  which  the  analytic  solution 
is  known.  The  difference  equation  is  solved  for  decreasing  values  of  h 
and  the  rate  of  convergence  calculated  from 

P«  =  (l"<7-In4)/'n(2)  (1) 

where 

««  =  I«f  -  u«(r,)I,  ft  =  -  =ft)/.V.  (2) 

The  equation  solved  is  chosen  so  that  the  solution  and  its  deriva¬ 
tives  exhibit  exactly  the  analytic  behaviour  hypothesized  in  the  proof 
of  the  error  estimates,  in  practise  this  is  achieved  by  choosing  a  solu¬ 
tion  and  then  determining  a  differential  equation  of  the  correct  form 
which  this  satisfies. 

The  uniform  rate  is  determined  by  inspecting  a  table  of  values 
of  p«,  for  varying  ft  and  c.  constructed  by  setting  c  =  h*  for  various 
values  of  s.  Results  of  this  form  are  given  in  [6]  for  a  non-turning  point 
problem  and  in  (1)  for  a  turning-point  problem  of  the  type  considered 
in  [3,  -1 J.  In  the  case  of  the  turning-point  problem  the  choice  of  solution 
involves  making  the  boundary  values  functions  of  c  and  hence  by  the 
choice  of  e  =  h’  functions  of  A.  A  disadvantage  of  this  method  is  the 
requirement  of  prior  knowledge  of  the  solution  since  this  limits  the 
case  with  which  it  can  be  applied  to  other  problems.  An  alternative 
is,  of  course,  to  use  an  accurate  approximation  on  a  fine  mesh,  if  this 
is  dctcrminable- 
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where 

4c  =  0«n«.  i-"  -  “?I.  h-  [*L~  (1) 

The  experimental- unifuim  t  U  «f  ^mergence  Is  then  determined  as 

p  =  min  pi,  whe.'  p*  =  average^.  (5) 

Doolan,  Miller  and  Schildcrs  rcmarl  that  the  choice  of  the  range 
of  h  values  permissible  is  limited,  since  if  »  mesh  is  too  coarse  the 
solution  of  the  difference  scheme  is  not  sufficient./  "orcsentative  of  the 
solution  of  the  differential  equation  to  permit  meaningful  discussion  of 
convergence,  that  is  h  is  not  sufficiently  small,  whereas  if  it  is  too  fine 
then  rounding  error  predominates.  The  method  has  the  advantage  that 
it  requires  no  a  priori  knowledge  of  the  natu>  of  the  solution  of  the 
equation  and  may  be  easily  programmed  .o  determine  an  experimental 
rale  of  convergence  for  a  wide  variety  of  problems. 

Anomalies 

In  either  of  these  methods  however,  great  care  must  be  taken  in 
interpreting  the  table  of  values  of  p'e  or  p^  for  the  reasons  which  we 
will  outline  below*.  To  simplify  the  arguments  we  shall  consider  only 
the  rate  of  convergence,  for  a  non-turning  point  problem,  as  considered 
in  (6],  that  is  : 

tti"  r  njxju'  -  b[x)u  =  /(r),  0  <  i  <  1 
u(0)  =  A.  sfl  )  =  D. 

where  nix}  >  «  ^  a  >  a.  TL<  determination  of  the  rate  of  convergence 
depends  on  the  assumption  that 

4,  <  CL’  (6) 

where  C  is  independent  of  h  and  c.  This  is  not  necessarily  the  strongest 
bound  available  and  in  fact  the  following  one,  (  efi  [6])  ,  is  a  more 
accurate  estimate : 


The  Double  Mesh  Method 

The  method  proposed  in  (2j  is  based  on  a  consequence  of  the  Gen¬ 
eral  Convergence  Principle  which  states 

Theorem  ({2.  Theorem  L5.1J} 

Let  at  6c  the  solution  of  a  niycnniici  equation  and  ej  a  difference 
approximation.  Ixl  p  >  0  and  C%.  £*j  he  posture  constants  indepen¬ 
dent  of  h.  Then,  for  all  i  >  U.  ail  0  k.  h  <  ftj.  and  ell  c  >  0 

»  -  sji  <  Cth- 


where  p  =  h!e  and  a  >  0.  So  more  accurately 
<  Clp.oih. 


which  is  cot  inconsistent  with  {GJ  since  by  considering  the  limits  as 
p  —  0  and  p  —  05.  for  o  fixed  .  we  can  see  that  is  bounded. 

Lei  us  assume  (hat  holds  ia  i  ■**  f  and  detcimme  the  rate  of 

convergence  Thus 


- 


,»2p*ir 


i- 


i2i 


(SI 


iff 

(ij  Um(n,(r,l-  s'j  =  H 

Hi)  [np  -  »JJ  <  Ci’S. 

Furthermore  Cj  is  m dependent  >  f  <  iff ».%  u. 

Essentially  the  melho-l  law.-ves  ratculatmg  the  quantity  given  m 
JhJ  which  we  shall  tali  the  .•;!>  mesh  err«r  and  determining  a 
rale  of  convergence 

p%  =  ila  ejj  -  ia  cj, i  lm2»  l3» 


and  considering  this  f.**r  c  —  acip  —  rit  and  t  —  l>p  —  xl  we  get 

E»r£  =  2  .  Harf'  1. 

Thus.  If  we  detenaia-  the  rate  »-f  c.^vergeac-  pf.  for  fixed  h,  and 
c  varying  from  at  to  rt.  it  *(3  vary  from  2  t-.  I  as  rx'-rcted.  The 
axstssspti-3  we  ispjdlls  make  is  evaluating  •'-■c-.pslat'onal  orders  of 
convergence  h  that  is  y  and  te*ce  that  the  minimum  value 

is  I.  This  is  not  la  fact  the  case  as  the  fr,-et--*i  pf  given  by  jCO  may 
attain  a  minimum  !*■**  r*  a*s  I  T?  s  e*ay  ?—  «es  Is  Fig  I  .  which  is 
a  graph  »-f  j*f  f-r  a  —  i  >  fi  s  lack  of  Bn*-c-««is  u.  is  fact.  H'sl 


apparent  when  « is, sew.  S..Tvar  result*  are  i-  e  ven  m  Fig.  I  for 
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Figure  1.  Double  Mesh,  ;>£,  and  Exact,  p£,  Hates  of  Convergence 
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Table  1:  Double  Mesh  Rate  of  Convergence,  pd,  a  =  0.25 
the  rate  of  convergence  calculated  using. the  Doolan,  Miller,  Schildcrs 
double-mesh  method.  In  this  case  the  actual  rates  are  given  in  Table 
1.  It  can  bo  seen  that  serious  problems  can  arise  here  in  interpreting 
the  table,  particularly  if  we  take  the  rate  of  convergence  to  be  the 
minimum  of  pdt{p)  over  all  c,  since  this  will  be  loss  than  the  actual 
rate  of  uniform  convergence  and  for  some  problems  may  in  fact  be 
negative.  This  problem  ris  significantly  more  noticeable  for  the  rates 
calculated  using  the  double  mesh  method  than  for  those  calculated 
using  an  exact  or  fine  mesh  approximation.  In  the  case  a-  =  0,25,  for 
example,  the  minima  are  -0.75  and  0.32.  respectively.  This  is  what 
might  be  expected  from  comparison  of  the  two  curves  in  Fig.  1.  The 
experimental  rates  of  uniform  convergence,  for  a  =  0.25,  arc  pd  =  0.76 
and  pe  =  0.80  respectively,  both  of  which  arc  significantly  lower  than 
the  true  rate  of  1.00.  More  examples  of  these  phenomena  are  given  in 
[5].  Reporting  excessively  low  rates  of  uniform  convergence  is  thus  an 
expected  feature  of  this  method. 

In  view  of  these  reservations  we  propose  the  following  estimates  for 
the  rate  of  convergence 

Pd  =  average*;^  and  pd  =  ininpj 

where 

Phd  =  Hcf-chd)l\n{2) 
and 

«d  =  max  <4  =  max^max ,  |uf  -  «5,|). 


It  is  clear  that  ej  is  a  function  of  h  alone  and  thus  we  may  expect 
Pj  to  be  approximately  a  constant  independent  of  h.  This  will  lead  to 
a  better  estimate  for  theiuniform  rate  of  convergence.  In  the  case  a  = 
0.25,  this  is  pd  =  pf  =  p'd  =  p]  =  1.00.  The  pj-method  has  been  used 
to  determine  the  rate  of  convergence  in  [3,  4)  and  many  later  papers. 
We  remark  however  that  it  does  not  give  any  additional  information 
about  the  variations  in  behaviour  of  the  scheme  as  h  — •  0  or  e  —  0. 
Therefore  it  is  also  useful  to  include  tables  of  pd(  to  provide  more 
precise  details  of  this  behaviour.  This  is  particularly  so  for  problems 
having  more  complicated  boundary  or  interior  layers. 

We  should  remark  at  this  point  that  there  remain  certain  problems. 
In  particular,  the  restriction  that  h  was  sufficiently  large  is  crucial.  If 
h  becomes  small,  the  most  prevalent  effect  is  for  rounding  errors  to 
corrupt  the  results.  However,  if  the  calculations  were  done  “exactly”, 
so  that  rounding  error  were  absent  or  negligible,  then  a  more  serious 
problem  would  arise.  If- we  produce  tables  for  arbitrarily  small  h,  but 
only  for  finitely  small  t,  then  most  of  the  rates  in  the  table  will  be  for 
li  <  e.  In  this  case,  we  arc  in  the  region  where  classical  convergence 
theory  applies  and  thus  the  rates  will  be  greater  than  or  equal  to  1, 
for  most  schemes.  These  rates  will  dominate  the  table,  and,  if  we 
use  p*  or  p+  as  the  calculated  rate,  cause  even  non  uniform  schemes 
to  be  reported  as  uniformly  convergent.  This  may  be  viewed  as  a 
consequence  of  the  form  of  the  tables,  where,  in  this  case  in  particular, 
the  rate  of  convergence  's  a  function  of  p  =  h/c.  Thus  the  rates 
along  the  diagonals  are  equal.  To  get  an  accurate  reflection  of  the 
rate  of  uniform  convergence  it  is  therefore- necessary  to  extend  the 
table  at  least  as  far  in  c  as  in  h.  In  the  one  dimensional  cases,  which 
we  have  tested,  (c/.  (3]  ),  we  extend  the  table  until  the  errors,  for 
given  h,  stabilizes,  which  occurs  when  one  is. solving,  up  to  rounding 
error,  the  reduced  equation.  The  finest  mesh  used  in  the  calculations  is 
h  =  1/4096.  In  practice,  using  either  double  or  fine  mesh  methods  this 
has  given  acceptably  accurate  rates.  In  all  cases  the  rate  calculated 
using  the  fine  mesh  method  proved  higher.  A  more  cautious  approach 
might  he  to  use  pj  or  p’,. which  are  less  prone  to  this  effect,  although 
these  will  again  report  lower  than  actual  rates  of  uniform  convergence. 

We  remark  that  there  arc  other  circumstances  in  which  these  meth¬ 
ods  will  report  positive  uniform  convergence  rates  where,  using  the 
normal  definition,  the  scheme  would  not  be  considered  uniformly  con¬ 
vergent.  This  is  particularly  true  of  the  centered  difference  approx¬ 
imation  to  a  self-adjoint  problem  and  of  two  or  higher  dimensional 
problems  exhibiting  certain  phenomena.  These  issues  are  considered 
further  in  (5|. 
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Abstract.  In  this  paper,  numerical  examples  ate  presented,  which 
indicate  that  upwinded  finite  difference-schemes  on  special  meshes  arc 
numerically  e-uniformly  convergent  for  the  numerical  solution  of  ellip¬ 
tic  singular  perturbation  problems;  for  these  examples  it  is  also  shown 
that  upwinded  finite  difference  schemes  on  uniform  meshes  behave  un¬ 
satisfactorily.  The  numerical  results  given  here  validate  the  theoretical 
results  obtained  by  the  last  author  in[3)  [4). 

1.  INTRODUCTION 

In  this  paper,  the  following  linear  singular  perturbation  problem 

£u  =  eAu  +  a.Vu  +  a0u=7  on  fi  -  (0, 1)  X  (0,1)  (l.la) 
u  =  g  on  90  (1.16) 

wherc  a  =  (01,02)  and  O  <  e  <  1  is  examined.  Two  eases  arc 
considered: 

oj  >  ai,02  >  <*2  and  ai  +  02  >  0  (1.1c) 

01  >  <*1  >  0,  a2=0  (l.lrf) 


where 

SXiz  =  (z(x;+l,yj)  -  z(xi,yj))/hi+l 
SXlz  =  (z(z„y})  -  z(x,-i,y,))/h, 

$x,x,z  =  ( &x,z  -  6i,r)/S, and  Ji,  =  (6,+1  +  h,)/ 2, 

on  various  meshes  tor,  =  {(x;,yy)}. 

Shishkin  [4]  has  proved  that  on  a  uniform  mesh  no  e-uniform  finite 
difference  scheme  exists  for  a  problem  with  a  parabolic  layer,  such  as 
(l.Ta,b,d).  In  §3  a  method  which  is  e-uniform  for  all  types  of  layers 
is  described.  This  method  was  first  introduced  by  Shjshkin  in  [3]  and 
uses  classical  upwinded  difference  operators  on  a  special  picccwisc- 
uniform  mesh.  Numerical  results  arc  presented  for  specific  examples 
of  (l.la,b,c)  and  (l.la,b,d). 

2.  Classical  upwinding  on  a  uniform  mesh 
In  this  section,  the  numerical  performance  of  the  upwinded  differ¬ 
ence  scheme  (1.3)  on  the  uniform  mesh 

=  {(*.-. Vi)  ■  =  «*, Vi  =  = 


where  01,0:2  arc  constants  and  ai,  a2,  ao,  /  and  g  arc  smooth  enough 
to, ensure  no  interior  or  comer  layers. 

In  each  ease,  for  small  values  of  e,  boundary  layers  appear  near  some 
of  the  sides  of  Cl.  In  the  ease  (l.la.b.c)  regular  layers  appear  near 
x  =  0  and  y  =  0  and  in  the  ease  (1  Ia,b,d)  a  regular  layer  appears  near 
x  -  0  and  parabolic  layers  near  the  sides  y  —  0  and  y  =  1  which  lie 
along  characteristics  of  the -reduced  differential  equation  (e  -  0).  For 
small  values  of  e,  it  is  well  known  that  classical  numerical  methods  for 
(1.1)  may  produce  spurious  oscillations  throughout  the  whole  domain. 
Various  stable  upwind  methods  have  been  proposed  to  eliminate  these 
oscillations.  In  §2,  numerical  examples  demonstrate  that  the  nodal  er¬ 
rors  for  an  upwinded  method  of  this  type  (on  a  uniform  meshj  depend 
not  only  on  the  number  of  mesh  elements  used  but  also  on  the  value 
of  e.  Numerical  methods  which  converge  independently  of  s  arc  usu¬ 
ally  said  to  be  uniformly  in  e  convergent  or  s-uniformly  convergent. 
More  precisely,  a  numcncal  method  for  solving  (1.1)  is  e-uniformly 
convergent  of  order  p  on  the  mesh  =  {(*j,»/),t,i  =  0,1,...,  IV) 
if 

max  ||u  -  z||  <  CN~'‘\  (1.2) 

where  u  is  the  solution  of  (l.la.b,c):or  (l.la.b.d),  z  is  the  numerical 
approximation  to  u,  C  arid  p  >  0  are  independent  of  e  and  N  is  the 
number  of  mesh  elements  used. 

The  following  upwinded  finite  difference  operator  will  always  be  used, 
to  obtain  a  numerical  approximation  z  to  u 

e(fer*.  +  fyjj ;,)*  +  ai(x{,yj)6Xlz  +  a2(x,,yj)SljJz 

+  a0(xityj)z  =  /(x,-,  yy)  (1.3) 


where  7t  =  1/N  and  N  is  the  number  of  mesh  elements  used  in  both 
directions,  is  examined  when  applied  to  examples  of  (l.la.b.c)  and 
(l.la,b,d).  The  problems  arc  solved  on  a  sequence  of  meshes,  with 
N  =8,  16,  32,  64,  128.  The  errors  |z(x„yj)  -  u(x,,y,)|  arc-ap¬ 
proximated  for  successive  values  of  e  on  the  four  coarsest  meshes  by 
et  (.*)})  =  |zw(z,,yj)  -  z128(x,,yJ)|,  where  the  superscript  indicates 
the  number  of  mesh  elements  used.  For  each  e  the  maximum  nodal 
error  is  approximated  by 


E,,n  =  maxef  (f,y). 


Convergence  rates  for  each  e  and  for  ,V  =  8, 16, 32,  arc  estimated  by 
Pi,n  where 


Pt.S  =  l°g2 


These  estimated  rates  arc  given  in  tables  2.1  and  2.2  for  the  following 
problems: 


Problem  2.1  «Au  +  (2+x2y)uI  +  (l  +  xy)uJ/  =  Oon  (0,1)  x  (0,1), 
with  boundary  conditions: 


u(x,0)  =  0; 


u(0,y)  =  0; 


f,t x  it  —  /  4z(1  “  z)>  z  >  1/2- 

1’  J  \l,  x  <  1/2 

u(l  „)_  (8(y-2y2),  y  >  1/4, 
U  y  <  1/4 


Problem  2.2  cAu + (1 4  x2  +  y2)ux  =  Oon  (0,1)  x  (0, 1),  with  bound¬ 
ary  conditions:u(x,0)  =  x3;  u(x,l)  =  x2;  ti(0,y)  =  0;  u(l,y)  =  1. 
Problem  2.1  has  regular  layers  near  the  sides  x  =  0  and  y  =  0;  the 
estimated  convergence  rates  arc: 
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£ 

N=  8 

N=  16 

N= 32 

1.0000000000 

0.82 

1.10 

1.54 

0.5000000000 

0.92 

1.13 

1.54 

0.2500000000 

0.86 

1.07 

1.52 

0.1250000000 

0.84 

0.97 

1.46 

0.0625000000 

0.46 

0.98 

1.37 

0.0312500000= 

-0.07 

0.66 

1.35 

0.0156250000 

-0.59 

0.17 

1.11 

0.0078125000 

-0.20 

-0.40 

0.69 

0.O039062500 

0.18 

-0.24 

0.08 

0.0019531250 

0.30 

0.21 

-0.13 

0.0009765625 

0.35 

0:42 

0.25 

0.0004882813= 

0.38 

0,55 

0.66 

■  D.0002441406 

0.40 

0.62 

0.89 

0.0001220703 

0.40 

0.67 

1.06 

0.0000610352 

0.41 

0.69 

1.17 

€ 

N=  8 

N=  16 

N= 32 

1.0000000000 

0.81 

1.10 

1.53 

0.5000000000 

0.92 

1.13 

1.53 

0.2500000000 

0.86 

1.07 

1.51 

0.1250000000 

0.66 

0.84 

1.22 

0.0625000000 

0.90 

1.01 

1.43 

0.0312500000 

0.81 

1.02 

1.43 

0.0156250000 

0.77 

0.99 

1.40 

0.0078125000 

0.68 

0.97 

1.41 

0.0039062500 

0.60 

0.91 

t.38 

0.0019531250 

0.58 

0.88 

1.35 

0.0009765625 

0.57 

0.86 

1.34 

0.0004882813 

0.56 

0.86 

1.34 

0.0002441406 

0.56 

0.85 

1.34 

0.0001220703 

0.56 

0.85 

1.34 

0.0000610352 

0.56 

0.85 

1.33 

Problem  2.2  lias  a  regular  layer  near  the  side  x  —  0  and  parabolic  layers 
near  y  =  0  and  y  =  1;  the  estimated  convergence  rates  arc: 


£ 

N= 8 

N=  16 

N= 32 

1.0000000000 

1.72 

1.52 

1.38 

0.2500000000 

1.02 

1.19 

1.56 

0.0625000000 

0.49 

1.01 

1.43 

0.0156250000 

-0.39 

0.12 

0.96 

0.0039062500 

0.29 

-0.39 

0.17 

0.0009765625 

-0.90 

0.67 

-0.03 

0.0002441406 

-1.88 

-0.69 

0.96 

0.0000610352 

-1.94 

-1.82 

-0.27 

0.0000152588 

-1.95 

-1.96 

-1.50 

0.0000038147 

-1.95 

-1.97 

-1.86 

0.0000009537 

-1.95 

-1.97 

-1.95 

In  fact,  it  is  well  known  that  upwinding  on  a  uniform  mesh  is.  not 
uniformly  in  e  convergent;  however,  in  neither  ease  is  an  estimate  of 
the  unifonn  convergence  rate  calculated  because  the  maximum  value  of 
N  is  not  large  enough  to  make  such  estimates  meaningful. 


3.  Numerical  results  on  special  meshes. 

Fbr  the  problem  (1.1a, b,c),  define  the  special  mesh  j  by 

where  z*  =  ih\,  for  0  <  t  <  N/ 2, 

Xf  =  ax  +  («  -  (N/2))h2,  for  N/2  <i<N, 
hi  =  2 ax/N,  and  h2  =  2(1  -  <rx)/N. 

The  points  {y*}  arc  defined  analagously  The  transition  point  ax  is 
chosen  to  depend  on  both  the  layer  width  and  the  number  of  mesh 
elements  used. 

cz  =  min{l/2,Cieln  N},  C\  >  ot] 

The  transition  point  <ry  is  defined  analagously.  Using  the  upwinded 
difference  operator  (1.3)  on  this  special  mesh,  we  obtain  the  following 
estimates  of  convergence  rates  for  problem  2.1: 


For  the  problem  (l.la.b.d),  define  the  special  mesh  ufl2  by 

M(*r,y;)=°  <•■>;<*> 

where  z,-  =  2\axj N,  f  =  0, 1, . . . ,  N/2, 

Xi  =  <rx  +  2 («  -  N/ 2)(1  - ax)/N,  i  =  N/2,..., N, 
y;  =  Aitjy/N,  i  =  0,l,...,N/4, 

y>  =ev  +  2(i  -  1V/4)(1  -  2av)/N,  i  =  N/A . 3 W/4, 

y,  =  (1  -  av)  +  4(i —  3N/4)(au)/N,  i  =  3N'i . N, 

where  <rx  =  min{^,eln N),  and  <xv  =  min{^,\/elnlV}. 

Using  (1.3)  on  this  mesh,  we  obtain  the  following  convergence  rate 
estimates  for  problem  2.2: 


£ 

N= 8 

N=  16 

N= 32 

1.0000000000 

1.71 

1.53 

1.38 

0.2500000000 

1.02 

1.19 

1.56 

0.0625000000 

0.92 

1.05 

1.40 

0.0156250000 

0.91 

1.07 

1.43 

0.0039062500 

0.77 

1.06 

1.47 

0.0009765625 

0.78 

1.01 

1.48 

0.0002441406 

0.81 

0.98 

1.46 

0.0000610352 

0.82 

0.97 

1.44 

0.0000152588 

0.83 

0.97 

1.43 

0.0000038147 

0.83 

0.97 

1.43 

0.0000009537 

0.83 

0.97 

1.43 

While,  again,  no  estimate  of  the  uniform  convergence  rate  is  given  for 
either  problem,  the  rates  for  each  e  and  h  are  evidently  far  superior 
to  those  obtained  using  a  uniform  mesh.  A  fuller  discussion  of  the 
numerical  experiments  outlined  above  can  be  found  in  [1],[2J. 
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CONSTRUCTION  AND  ANALYSIS  OF  PETROV-GALERKIN  APPROXIMATIONS 
FOR  CONVECTION-DOMINATED  FLOWS 


B.W.SCOTNEY 


Abstract 


Department  of  Mathematics,  University  of  Ulster 
Cromore  Road,  Coleraine,  BT52  ISA. 

+  (bh/a)2/12) 1/2inf 


Error  estimates  are  shown  for 


u-U 


Galerkin  and  Petrov-Galerkin  approximations  to 
a  singularly  perturbed  problem  in  one  dimension. 
An  optimal  Petrov-Galerkin  formulation  is 
presented  for  variable  coefficient  problems, 
and  it  is  used  to  analyse  the  common  practice 
of  approximating  variable  coefficient  problems 
by  the  use  of  locally  constant  methods. 


1 .  INTRODUCTION 
We  consider  the  model  problem 
-au"  (x)  +  b (x) u 1  (x)  =  f  (x) 


x  e  (0,1) 


u  (0 ) 


u  ( 1 )  =  g 


where  a  >  0,  b(x)  e  H 
f(x)  e  L_. 


with  b(x) 


R 

>  0  and 


(1.1) 


For  the  case  when  b  is  a  positive  constant 
Hemker  (1977)  developed  a  Petrov-Galerkin 
fprmulation  with  a  piecewise  linear  trial 
space  which  generates  a  nodally  exact  solution. 
Here  we  develop  an  optimal  Petrov-Galerkin 
approximation  with  a  piecewise  linear  trial 
space  for  the  general  variable  velocity  problem 
(1.1)  . 


2.  WEAK  FORMULATION  AND  ERROR  ESTIMATES 


The  weak  formulation  of  problem  (1.1)  is  to 
find  u  e  h4  such  that 

E  1 

B (u, v)  =  <f,v>  v  v  e  HI  (2.1) 

E0 


where  B ( - , • )  is  the  bilinear  form 

B(w1'w2)  =  <w[ .fcW2  +  bw2> 


h  1 

For  a  piecewise  linear  trial  space  S  C  H 


.  „h  _h  '1 
and  SE  =  S  rv  H  , 

o  o 


the  Galerkin  approximation 


is  to  find  U  e  SE  such  that 


B(U,V)  =  <f,V> 
If  wo  denote  by  ||w 


V  v  c  S, 


(2.2) 


the  norm  on  H 


defined 


by 


imi; 


=  <w' ,w'> 


(2.3) 


1 


the  Lax-Milgram  Theorem  (see,  for  example, 
Ciarlet  (1978)),  together  with  a  Friedrichs- 
Poincard  inequality  yields  the  following  error 


estimate  for  the  Galerkin  approximation  U: 


|  ]  u  —  U  | 


<  (1  +  b/ra )  inf  ||u-v||_  (2.4) 


V.eS. 


where  b  =  max  |  b  (x) | . 
xc  (0 , 1 ) 

If  an  Aubin-Nitsche  duality  argument  (see 
Aubin  (1972))  is  used,  an  Improved  estimate 
can  be  achieved  of  the  form 


II  u-U  i 


*1* 


(1 


+  bh/ita)  inf  j j  u  —V  | 
_h 


(2.5) 


veS. 


In  Scotney  (1985)  the  optimal  estimate 


T1  1 


(1 


l|u-v|l 


VeS, 


1 

(2.6) 


is  obtained  and  shown  to  be  the  sharpest 
attainable  bound. 

The  estimates  (2.5)  and  (2.6)  exhibit  the 
importance  of  the  mesh  Pdclet  number  bh/a  in 
the  degree  to  which  optimality  of  the  Galerkin 
approximation  is  lost  as  the  differential 
operator  loses  self-adjointness. 

Petrov-Galerkin  methods  may  be  formulated  for 
singular  perturbation  problems  with  a  view  to 
recapturing  the  optimal  approximation 
properties  enjoyed  by  the  Galerkin  approxima¬ 
tion  for  self-adjoint  problems.  A  test  space 

^  is  employed.  Setting 


Th  C  H *  other  than 


Th  n  hJ 


the  Galerkin  system  (2.2)  is 
_o  “o  h 

replaced  by  the  problem  of  finding  U  e  SE 

_h 


such  that  B ( U , V)  =  <f,V>  V  V  t  T 


(2.7) 


Morton  (1982)  shows  how  to  achieve  bounds 
sharper  than  those  obtained  directly  from  the 
Lax-Milgram  Theorem,  such  as  (2.4).  He 
identifies  the  crucial  requirements  to 
establish  optimal  error  estimates.  By  the 
kiesz  Representation  Theorem  (see,  for  example, 
Adams  (1975)),  there  exists  a  map 


R:  III  ->  hi 
EL 

o  o 


such  that 


B ( v , w)  =  <v',(Rw)’>  v  v,w  e  H 


(2.8) 


If  the  constant  A  is  defined  by 
||  V-RW  ||  _ 


A  =  SUD. 

V«E 


inf 

WeT 


h 


'  1 


(2.9) 


-  Ilv|| 

O  O  ”  j 

and  U  is  the  Petrov-Galerkin  solution  to 
problem  (2.7)  the  following  estimate  holds: 

II  u-U  ||  <  (1  -  A2)'1/2lnf  ||u-v|L  (2.10) 

1 


T . 


ves. 


This  is  the  sharpest  possible  estimate  since 


there  will  exist  a  function  f  e  L2  for  which 


(2.10)  is  an  equality.  (2.8),  (2.9)  and  (2.10) 
provide  the  basis  for  Section  4. 


3. 


PETROV-GALERKIN  METHODS  FOR  CONSTANT 
COEFFICIENT  PROBLEMS 

Wo  consider  a  uniform  discretisation  with 
nodes  x^  =  jh,  j  =  0,...,N,  and  f'h  =  1. 

For  the  problem  (1.1)  when  b  >  0  is  a  constant 
_h 


the  test  space  T 


has  a  basis  { ^  ,  j 


when  b  > 
proposed  by  Hemker  (1977) 

,H  , 


(e 


■6  (x 


*j-l,/h  -  n/(e'e 


1 , . . . N- 1 )  with 

-  l ) ,  y. 


VjOO  = 


(e 

0 


■?,  (x 


Xj)/h>/(e’ 


.  ,<x<x. 

j-1  ~  3 


■1) 


X  .  <x^x  .  _  0  . 
3  -  3  +  1 


otherwise 


where  g  =  bh/a.  The  solution  of  (2.7)  thus 
generated  is  nodally  exact.  It  is  straight¬ 
forward  to  show  that  the  best  fit  0*  e  s|  to 

u  e  in  the  norm  ]|  *11-,  is  also  nodally 
E  T1 

exact,  and  hence  that  U  =  0*. 

Numerous  Petrov-Galerkin  methods  have  been 
proposed  for  problem  (1.1)  which  generate  the 
same  finite  difference  operator  as  the  test 
space  defined  by  (3.1),  namely  that  of  Allen  & 
Southwell  (1955)  -  see,  for  example,  Heinrich 
&  Zienkiewicz  (1979).  Such  methods  arc  not 
optimal  since  they  differ  in  their  treatment 
of  the  source  term  f.  However  Scotney  (1985) 
uses  the  estimate  (2.10)  of  Morton  (1982)  to 
show  that  many  are  near-optimal.  Griffiths  8 
Lorenz  (1978)  have  analysed  these  methods  by 
direct  use  of  the  Lax-Milgram  Theorem. 

4.  RIESZ  REPRESENTATION 

In  the  variable  coefficient  problem  (1.1), 
from  the  defining  relation  (2.8)  we  may  deduce 
that 


(Rw)  (x)  =  w(x)  +  f0  (b  (t) /a)  w  (t).dt  -  xa(w) 


Tj  +  (a^ 


T., )  (x  -  x _. )  /h 


V  w  £  H*  (4.1) 
o 


(T,/h) (x  -  x.) 
3  3 


,  0<x<x^.  _  j 

'  Xj-l<XiXj  (4.7) 


V*<xj+1 

xj+1<x 


The  explicit  form  of  i|i ^  (x)  may  be  obtained  by 

substituting  (4.7)  into  (4.6),  satisfying  the 
requirement  for  local  support  and  normalisa¬ 
tion.  Restricting  the  support  of  ^  to  that 

of  $  .  requires  us  to  set  ij) .  (x)  =  0  for  x.  .  <; x , 


yielding  T ^ 


(y3  -  Y3-i> 


B(s) 
e  ds 


I  (b  (t)  /a)  dt 


(4.10) 


(4.11) 


Normalising  by  setting  i(>j(x.)  =  1  gives 
h(Yj  ~  Yj-l)eB<X:i> 


3  Yj-lYj 

and  hence  we  obtain  ^ (x)  = 

,(B(x.)-B(x)),  .  .x  B(s). 

(e  3  /Vj_1)  /  •  ds '  x  j(_  j  j 


where  a(w)  =  (b  ( t ) /a )  w  ( t )  dt 


From  (2.9)  and  (2.10)  it  is  clear  that  if 
RT?i  =  s!l  then  the 

L  L 

o  o 

Petrov-Galerkin  solution  is  optimal.  We 
therefore  aim  to  construct  a  basis 

{^  ,  j  =  1  ,  .  .  .  ,N- 1  }  such  that  Rif  e  S^  with 
3  j  Eo 

the  additional  property  that  the  support  of 
ij/,  is  restricted  to  the  support  of  the  piece- 

wise  linear  trial  space  basis  function  <!> .  , 

namely  (x.  .,  x .  ,  , )  .  The  key  to  the  localisa- 
3-1  3+1 

tion  is  to  set  R^  to  be  of  the  same  form  as 
H 

R’J'j  -  In  particular  let 

(Ri^Hx)  =  i^(x)  +  !*  (b  (t)  /a)  (t)dt  -  xa^. 

V  w  e  H*  (4.3) 
o 

where  a,.  =  (b  (t)  /a)  (t)dt  (4.4) 

Writing  g(x)  =  (R<J<^  )  (x )  +a_.  x 

=  ^(x)  +  /QX  (b  (t)  /a)  (t)  dt  -  xd  ^  (4.5) 

we  obtain 

♦  j(x)  =  e-/X(b(t)/a)dt  fx  gl(s)e/S(b(t)/a)dtfls 

(4.6) 

From  Scotney  (1985)  we  take  the  required  form 
for  g(x)  as  below: 


(4.12) 

[ B ( X . )  -  B (x) )  X.  .  . 

(e  3  /yj  )  /x  3  1eB(  }  ds ,  xj  <x_<xj  +  , 

0  ,otherwise 

It  is  straightforward  to  check  that  if 
b(x)  =  b  >  0,  a  constant,  (4.12)  reduces  to 

the  test  function  ^  of  Hemker  (1977)  as  in 

(3.1)  . 

If  the  test  space  generated  by  (4.12)  is  used 
in  the  Petrov-Galerkin  formulation  (2.7)  it 
can  be  shown  that  the  system  of  linear 
equations  generated  is  of  the  form 


h(Yj  ’  y3-i> 


(  "Y j  Vi  +  tYj+Yj-i  )Uj 


-  Vj.j  Uj  +  1)  =  <f  ,«;S>  3  =  1  ,  .  .  .  N- 1  (4.13) 

The  significance  of  (4.13)  for  the  variable 
coefficient  problem  (1.1)  is  analagous  to  that 
of  the  Allen  8  Southwell  (1955)  difference 
operator  for  the  constant  coefficient  problem. 

5.  LOCALLY  CONSTANT  METHODS  FOR  VARIABLE 
COEFFICIENT  PROBLEMS 

It  has  been  commonplace  for  many  authors  to 
generalise  the  use  of  Hemker’ s  test  space  (or 
its  near-optimal  counterparts)  to  variable 
coefficient  problems  by  selecting  the  value  of 

b  in  ({* !?  to  be  determined  locally  at  each  node 
or  In  each  element  (e.g.  b  =  b(x^)  for 
x  c  (*  ,  or  b  =  (b(x^_j)  +  b(x^))/2 

for  x  c  (Xj_j,Xj)).  Only  with  the  availability 
of  ’J’j  (x)  as  in  (4.12)  is  it  possible  to 
properly  analyse  this  practice. 

Consider  a  modified  form  of  problem  (2.1)  in 
which  the  velocity  field  b(x)  is  replaced  by  a 
piecewise  constant  field  b(x)  defined  locally 
on  each  clement:  find  u  t  Ili  such  that 


(5.1) 


REFERENCES 


B (u , v )  »  <f,v> 


v  v  e  H* 

o 


where  b(x)  =  =  (b(x.,)  +  b(Xj  +  J))/2 

for  x  e  (x.. ,x^  +  1)  , 

j  =  0,...N-1,  and  B  (•»•)  is-.BCi,*?)  with 

b(x)  replaced  by  b(x). 

_  H 

If  we  denote  by  ip ,  the  test  function  tb .  of 
3  3 

Hemker  with  b(x)  replaced  by  b(x),  we  may 


consider  the  modified  Petrov-Galerkin 
formulation : find  U  e  such  that 

B(U,?..)  =  <f,J  .>  j  =  1,...,N-1  (5.2) 

The  formulation  (5.2)  is  an  obvious 
generalisation  to  the  variable  coefficient 
problem  (1.1)  of  the  use  of  Hemker’ s  constant 
coefficient  test  space  described  in  (3.1). 

By  substituting  b(x)  for  b(x)  in  (4.12), 
we  can  show  that  the  optimal  test  space  for 
problem  (5.1)  is  precisely  the  one  given  by 

in  (5.2).  That  is,  the  obvious 

generalisation  of  Hemker's  formulation 
generates  the  optimal  approximation  to  the 
solution  of  the  modified  problem  (5.1). 


Moreover,  iji.(x)  may  be  written  in  the  form 
3 


vx)  =  j 

$j(x)  + 

'4^(50  - 

°j(x) 

x.<x<x,  , 

3  “  3-1 

x  <x<x  (5-3) 

x-pxixj+l 

where 

o  . 
3 

(Xj)  =  °(xj+1) 

=  0 

and 

r j*‘  •, 

(x)dx  =  ^ 

(5.4) 

X4 

Then  the  system  of  linear  equations 
generated  by  (5.2)  may  be  written  as 
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(-a/h  -  (1  +  ?j_i)bj_1/2)  Uj_1 


+  ( 2a/h  +  ((1  +  5j_1)bj_1-  (1  -  Uj 

(5.5) 

+ (-a/h  +  (1  -  F  ) b./2)  U,  ,  =  <f,p.> 

3  3  3+1  3 

j  =  1  , . . . , N- 1 

Since  (5.4)  implies  no  knowledge  of  the 
functional  form  of  (x) ,  any  of  the 

conforming  Petrov-Galerkin  test  spaces  used 
for  the  constant  coefficient  problem  can  be 
modified  to  fit  (5.3)  and  hence  used  to 
generate  the  left  hand  side  of  (5.5). 
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EXPONENTIALLY  FITTED  BOX  METHODS  AND  THEIR 
APPLICATION  TO  SEMICONDUCTOR  DEVICE  SIMULATION 


W.H.A.  Schilders 
Philips  Research  Laboratories 
Applied  Mathematics  Group 
Building  WAY,  Room  2.09 
PO:Box  218,  5600  MD,  Eindhoven  (NL) 


ABSTRACT 

The  system  of  differential  equations  describing  the  behaviour  of  semi¬ 
conductor  devices  is  singularly  perturbed,  and  therefore  requires  spe¬ 
cial  discretisation  techniques.  To  tiiis  end,  an  exponentially  fitted 
box  method  has  been  developed,  which  is  known  as  the  Scharfetter- 
Gummel  method  In  tbb  paper,  we  will  discuss  this  .discretisation 
technique,  which  is  applicable  to  n-dimensional  problems.  Application 
of  this-techr.ique  is  not  restricted  to  semiconductor  device  problems, 
it  is  suitable  for  any  singuPrly  perturbed  problem  in  divergence  form 
It  is  conjectured  that  -his  method  yields  uniform  error  estimates  for 
arbitrary  polygonal  meshes.  It  is  also  shown  that  the  1-d  scheme  is 
essentially  the  same  as  Il’ins  scheme,  thus  paving  the  way  for  uniform 
error  estimates  on  the  solution  of  the  semiconductor  problem.  On  the 
other  hand,  the  way  the  scheme  has  been  constructed  is  different  from 
the  construction  of  Il’ins  scheme,  and  therefore  this  may  be  of  interest 
to  singular  perturbationists.  Finally  extensions  of  the  scheme  to  a  spe¬ 
cial  case  are  discussed;  where  exponentially  fitted  methods  for  small 
systems  of  equations  can  be  used.  Again  it  is  suspected  that  uniform 
error  estimates  may  be. obtained. 


JP  =  -?Ppnm  tJ*'-*WrV*P 

(9) 

Jn  =  -gpnninle^y^Vpn 

(10) 

A  third  choice  of  variables  can  be  motivated  by  remarking  that  the  sys¬ 
tem  of  equations  can  be  put  into  self-adjoint  form,  which  is  convenient 
in  designing  suitable  discretisation  sche„.e3.  This  can  be  achieved  by 
applying  a  Liouville  transformation.  The  lesult  13  the  formulation  of 

the  .  ..niconductor  problem  in  the  set  01  variables 
latter  two  being  termed  the  Slotboom  va.mbles  (cf. 
defined  by  the  relationships 

,  <FP  and  3>n,  the 
jllj).  These  are 

P  =  nmie'^t,T$p 

(11) 

ti  =  ninte*luT$n 

(12) 

In  this  case,  equations  (5)-(6)  read. 

Jp  =  -qpPVTnmt'-*ll'TV% 

(13) 

Jn  =  qPnUTninlC^V^ 

(14) 

L  SEMICONDUCTOR  DEVICE  SIMULATION 

The  differential  equations  describing  the  behaviour  of  semiconductor 
devices  are  dciived  from  the  Maxwell  equations  and  from  Boltzmann's 
equation.  An  excellent  account  of  this  can  be  found  in  [10,12],  In 
order  to  adequately  describe  the  behaviour  of  semiconductor  devices, 
another- charged  particle  is  introduced,  namely  the  positively  charged 
hole.  Thus,  currents  are  not  only  caused  by  moving  electrons,  but  also 
by  moving  holes. 

We  will  restrict  ourselves  to  the  following  system  of  equations; 


V.(eE )  =  q(p-n+D)  (1) 

V  ■  Jp  =  ~qR  (2) 

V-J„  =  ?R  (3) 

where  the  electric  field  E,  the  hole  current  density  Jp  and  the  electron 
current  density  J„  are  given  by 

E  =  -Vip  (4) 

Jp  =  -  pE)  (5) 

Jn  =  7Pn(UrVn  +  nE)  (6) 


Suitable  boundary  conditions  are  applied.  The  variables  in  this  system 
are  the  electric  potential  y>,  the  hole  concentration  p  and  the  electron 
concentration  n. 

For  the  application  of  exponentially  fitted  methods,  it  is  sometimes 
convenient  to  rewrite  the  system  (l)-(6)  into  other  variables,  First  of 
all,  the  electric  potential  and  the  carrier  concentrations  diffei  very 
much  in  size.  Therefore,  it  is  convenient  to  introduce  the  quasi- 
Fcrmilcvels  <pp  and  4>n  defined  ...y  the  relations 

p=n,ntfl*,-*Wr  (7) 

n=nini<S*~*»WT  (8) 

where  nin(  is  the  intrinsic  carrier  concentration.  In  this  case,  the  equa¬ 
tions  (5)-(6)  become 


2.  SINGULARLY  PERTURBED  CHARACTER 


First  wc  consider  equation  (’. j,  which  is  oft-n- .eferred  vu  as  Foisson’s 
equation.  ’.  e  scale  the  equation  and  the  variables  as  described  in 
[7,8j.  If  we  hen  ironic  the  Poisson  equation  in  term3  of  the  scaled 
quantities,  w.  obtain 

A2V  •  Vtp  =  n  -  p  -  D 

whore  the  right  hand  side  is  of  the  order  of  unity.  The  parameter 
A  is  rather  small.  Typically,  its  value  is  ol  the  order  of  magnitude 
10-3  -  10-6.  Thus,  from  a  mathematical  point  of  view,  the  Poisson 
equation  is  singularly  perturbed. 

The  singularly  perturbed  character  of  Poisson’s  equation  is  not  of  too 
much  interest,  since  it  is  a  self-adjoint  equation  for  which  the  applica¬ 
tion  of  standard  difference  schemes  docs  not  lead  to  erroneous  solutions 
(although  accuracy  could  be  an  issue).  Much  more  interesting  is  shut, 
because  of  the  size  o:  the  parameter  A,  the  entire  system  .  *  j-(6)  is 
singularly  perturbed.  For  more  details  on  the  demonstration  of  this 
fc-i  we  refer  the  reader  to  (7).  This  book  also  contains  asymptotic  ex- 
pan-MjC  at  the  solution,  which  is  important  in  view  of  the  necessary 
conditions  for- a  •(<;•(  r  v ,  echcme  to  possess  the  property  of  uniform 
convergence  (cf  For  the  discuss. jn  in  this  paper  it  will  suffice  to 
remark  that,  because  of  the  behaviour  of  the  elect. ic  field,  the  equa¬ 
tions  (3)  and  (C)  can  be  considered  as  singularly  perturbed  first  order 
equations  fi  »  ;  and  n,  respectively.  This  is  an  important  observation, 
since  ic  ex,, lams  why  standard  difference  schemes  c,.ri  not  be  applied 
to  the  discretisation  of  these  equations. 


As  has  been  discussed  in  the  foregoing  section,  (5)  and  (6)  can  be 
considered  as  singularly  perturbed  first  order  differential  equations  for 
p  and  n,  respectively.  Application  of  the  standard  central  difference 
scheme  on  a  mesh  {xo, ...,  x/y}  leads  to  the  follow  i..,,  expression  for  the 
hole  current  density  in  the  interval  \x,,x,+i]  (denoted  by  Jp, 14-1/2): 
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«-  ,  _  (tt  -P*+l  “Pi  Pi-H  ?*  r*  \ 

^p,  1+1/2—  - - (i5) 


771  _  ^1+1  — 

—]  (16' 
A'similar  expression  is  obtained  for  the  electron  current  density.  Tliese 
expressions  are  then  used  m  the  discrete  versions  of  equations 
which,  for  (2),  reads: 

^p, 1+1/2  ~  Jp, 1-1/2  =  "  ?(Ii+i/2  ~  xt-i/i)Rt  (17) 

It  is  wellknown  that  this  scheme  yields  non-stable  solutions.  In  fact, 
closer  investigation  shows  that  the  concentrations  may  become  neg¬ 
ative,  meaning  that  no  solution  in  terms  of  the  variables  yi,  <j>p,  <j>n 
exists.  Thus,  the  discrete  scheme  does  not  guarantee  existence  •»? so¬ 
lutions. 

Applying  exponential  fitting  techniques  to  the  discretisation  yields 

Jp,i*  1/2  =  -  PJ±~iEl+1/2)  (18) 

*•+1  *|  " 

with 

<7,-  ~  */)  ..pthffiVlfrfr1  ~*1>)  (19) 

/L'7>  ZUx 

which  is  exactly  the  Il’in  fitting  factor  (cf.  [6]). 

This  scheme  has  first  been  described  by  Scharfetter  and  Gummcl  (cf. 
[9]),  and  therefore  the  resulting  difference  scheme  is  known  to  device 
modellers  as  the  Scharfetter-Gummcl  scheme.  As  we  remarkedin  .:  . 
above,  it  is  exactly  the  same  as  Il’ins  scheme.  A  coincidence  is  that 
both  schemes  were  developed  in  1969  1 

Because  the  above  method  is  the  same  as  Il’ins  scheme,  (uniform)  error 
estimates  for  the  latlcr  can  be  carried  over  directly  to  the  semiconduc¬ 
tor  problem.  Then  we  obtain: 

Theorem  1 

We  have  the  followin']  error  estimate  for  the  discrete  solution  [p„i  - 

0 . W): 

!^M<Ch 

P(*.) 

where  h  is  the  maximum  mesh  spving  and  Cis  a  constant  independent 
of  h  and  the  coefficients  in  Ihe  equation. 


Since  the  estimate  here  concerns  the  relative  error,  the  result  can  also 
be  rewritten  as  an  error  estimate  for  the  quasi-Fermilevcl  <j>p. 

The  scheme  in  (18)  has  been  derived  in  the  above  by  applying  expo¬ 
nential  fitting  techniques.  On  the  other  hand,  it  is  very  interesting 
to  see  the  relationship  of  this  derivation  with  the  way  it  is  normally 
derived  in  the  area  of  semiconductor  device  modelling.  To  this  end,  we 
again  consider  the  homogeneous  form  of  the  second  order  differential 
equation  obtained  by  combining  (2)  and  (5)  From  (2)  it  then  follows 
that  Jp  is  constant;  since  this  can  be  concluded  for  each  interval  sep¬ 
arately,  we  will  assume  that  Jp  is  piecewise  constant.  Using  this  and 
the  expression  for  Jp  in  terms  of  the  Slotboom  variable  <$p  (cf  (13)), 
we  obtain: 

V<K  = _ _ _ e^Vr 

WpUfn;nt 

+ iw+i  -  %.i = — jp- —  r+i  s^dx 

WpUrWnt  Jx,- 


and,  assuming  that  ip  is  linear  in  [x(,z,-+ij: 


Rearranging  this  expression  leads  to  the  following  expression  for  Jp  in 
the  interval  (z,-,x,-+i),  which  we  again  denote  by  Jp  i+1/2: 

r  _  r,  ..  th+i/Or  -  'Pi/Ur  $„.,-+i  -  $Pl; 

P',+I/2  ~  WpUTn‘»‘  ~^JVr  _  e^/VT  —  _  ~  t20) 

Using  the  relations  between  the  carrier  concentrations  and  the  Siot- 
boom  variab1  it  is  very  easy  to  show  that  (20)  is  exactly  the  same 
as  (18).  On  closer  examination  of  (20)  we  see  that,  in  fact,  the  dis¬ 
cretisation  of  the  rapidly  varying  coefficient  e^UT  has  been  performed 
by  using  a  harmonic  average  of  this  coefficient.  In  other  words,  for  an 
aporoximation  of  this  coefficient  on  the  interval  (x,-,  Xi+i)  we  have  in 
fa:  *  »ken 

(«  ^%-.*,-+1|  ~  jzi+l  et/urdx 

■  -*  aiq”-.  for  second  order  differential  equations  in  divergence 

>,.»n;  >■  JH  „  idly  varying  coefficients,  has  also  been  described  and 
1  d  1  <n  (l).  Also,  the  so-called  generalised  finite  clement  method 
o'.  j2  ..orks  along  similar  ideas.  Finally,  ,ho  above  technique  of  har- 
mo  .  averaging  appears  in  a  natural  way  in  the  mixed  finite  clement 
met  id  wlt«%  applied  to  semiconductor  problems.  For  more  details  we 
relt"  reader  t/'  several  papers  by  Brezzi  and  co-workers  (cf.  (3,4)). 

^EXT/.NSION  TO  HIGHER  DIMENSIONS 


The  box  method  is  ideally  .sited  for.the  discretisation  of  equations  of 
the  form 

V-F  =  /  (21) 

The  starving  point  is  a  mesh,  consisting  of  triangles,  rectangles,  q.iadri- 
late.als  or  other  polygons,  A  so-called  box  B,  is  constructed  around 
each  mesh  point  x,-,  in  such  a  way  that  the  union  of  all  boxes  is  the 
entire  simulation  domain  and  such  that  boxes  do  not  overlap.  The 
most  common  way  of  doing  this  is  to  construct  B{  using  the  midper- 
pen  iiculars  of  the  mesh  sides.  Hav,.^  completed  this  construction,  we 
integral  (21)  over  each  of  the  boxes: 


\  V-  VdV=  [  fdV 

JBi  J  Bi 


which,  using  Gauss’  theorem,  leads  to 


/  F-n  dS=  f  fdV 
Jdb,  JBi 


'  $p,i  —  “* 


qppUTnint  f 


^(ev.+i/tfr  _  gi’i/U r) 


The  discretisat.oi,  is  now  completed  by  approximating  the  integrals 
i.v  this  eqi:.tion.  A  standard  procedure  is  to  use  the  lowest  order 
quadratuie  rulet  foi  both  integrals.  Ihus,  the  right  head  side  of  (22) 
.3  approximated  by  voI(B,)  The  left  hand  side  is  approximated  by 

k 

wherethe  n*  .-.re  the  normals  in  the  midpoints  of  the  mesh  sides  and 
Ik  arc  the  lengths  of  the  corresponding  box  s’dcs. 

Equations  (l)-(3)  can  be  discretised  using  the  box  method.  The  re¬ 
maining  problem  is  to  evaluate  the  normal  components  of  the  electric 
field  E  and  the  current  densities  Jp  and  Jn.  Because  of  the  construc¬ 
tion  of  the  boxes,  however,  this  is  rather  straightforward.  Namely,  the 
normal  components  are  exactly  the  components  along  the  mesh  sides. 
Thus,  to  obtain  the  desired  quantities,  we  can  just  use  the  techniques 
outlined  in  the  previous  section.  In  other  words:  the  one-dimensional 
arguments  used  to  obtain  exponentially  fitted  discretisation*  of  the 
first  order  differential  equations  for  Jp  an  I  between  two  mesh  points 
can  be  used  here.  For  the  electric  field  the  situation  is  even  simpler, 
because  we  do  not  need  any  fitting.  In  that  case  we  just  use  expres¬ 
sions  of  the  form  (16). 


'J’p.i+l  “  %.i  '■ 


IhpUr’Unt  tu+i/Ur  - 
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SflRdusjoiv 

The  box  scheme  for  equations  (t)-(S),  combinei.imth  the  exponentially 
fitted  schemes  for- equations  (4)-(0),  provide  a  suitable  discretisation 
method  for  the  semiconductor  equations  in  l-d,  S-d  and  3-d. 

□ 

In  fact,. we  conjecture  here  that  the  proposed  exponentially  fitted  box 
schemes  yield  uniform  error  estimates  (this.bas.been  shown  in  l-d  and 
in  the  2-d  rectangular  esse). 


In  this  section  we  generalise  the  Scharfetter-Gummel  method  to  the 
case  where  the  effect  of  avalanche  generation-is  taken  into  account, 
using  exponential  fitting  techniques  for  singularly  perturbed  2  a  2  sys- 
tems  as  described  in  [5].  This  effect,  which  may  lead  to  breakdown 
of  the  device,  is  accounted  fer  in  the  equations  by  an  extra- recombi- 
nation/generation  term.  jrmally,  these  terms  only  depend  on  the 
carrier  concentrations,  am.  not  on  the  current  densities.  T  lerefore, 
(2)  and  (3)  are  first  order  equations  in  op.and  without  any  -zero 
■j.der  terms.  From  a  mathematical  point  of  view  this  means  that  the 
current  densities  will  vary  rather  smoothly.  Remark  that  the  assump¬ 
tion  of  piecewise  constant  current  densities  made  in  the  derivation  of 
the  Scharfetter-Gummel  scheme  agrees  with  this. 

When  avalanche  generation  is  taken  into  account,  the  situation  changes 
completely.  In  this  case,  an  extra  term  has  to  be  included  of  the  form 

Rll  =  "(opPpi  rcrn|^|)  (23) 

Now  we  see  that  the  first  order  differential  equations  do  contain  a  zero 
order  term,  thus  allowing  the  possibility  of  .apidly  (namely,  exponen¬ 
tially)  varying  current  densities.  It  is  clei.  that  the  assumption  of 
piecewise  linear  current  densities  may  not  bo  adequate  in  this  case. 
As  a  starting  point' for  our  derivation  we  take  the  homogeneous  form 
of  equations  (2)  and  (3),  i.e.  R  i3  equal  to  the  impact  ionisation  term 
given  in  (23).  The  equations  read 


Jp  —  -\rCtp\Jp\  +  Orn|«/n| 

,24) 

»** 

ii 

i 

£ 

i 

0 

3 

£ 

(25) 

which  can  be  written  as 

3'  =  AJ 

(26) 

where  J  =  ( Jp ,  Jn)‘  and 

(+vpap  +vno:„ 
-vpap  -vna„ 


Here,  vP  =  sign(Jp),  vn  -  s;gn(J„)  are  the  ’directions’  of  Jp  and  J„. 
Using  equations  (9)-(fe  we  see  that  vp  —  -sign {4>p),  v„  —  -sign($,). 
Thus,  (26)  may  be  cuns»,  .'red  as  a  ’..near  equation  in  J. 

Now -we  are  ready  to  discretize  the  problem.  As  usual,  we  take  a 
mesh  (zoi  ■■■ixn}i  the  midpoint  of  the  interval  [ii,x,+i]  beinr  demoted 
by  Xf+i/z-  We  assume  that  A  is  constant  on  each  of  these  inter¬ 
vals  (notation:  A,-+i/2).  Multiplying  (26)  on  tho  interval  [z;,z,-+i] 
by  wc  obtain: 

/jK+i  /sjj’  =  o 

Thus,  wc  may  conclude  that  for  solutions  J  of  the  continuous  problem 
(26)  we  have. that  is  a  constant  vector 

To  proceed  wc  now  use  equations  (13)  and  (14).  These  can  be  written 
in  the  form 

J  =  D& 

where  $  =  (<?p,  $„}7  and 

-qi‘PUTnin,c-*l',T  0  \ 

0  qi‘nUTnMoi’IVr  ) 


Since  jMi+i/jj^)  js  a  constant  vector,  which  we  will  denote 

by  J, *1/2  (substitute  x  =  xl+1/i  !),  we  have  that 

=  D-le(x-Xi*irfA‘+U*  Ji+,/j 

and  it  follows  that 

*i+i  -  =  {J*'+‘  D-le^-z‘*‘/^‘+wody}3i+l/2 

From  this  we  obtain  a  discrete  expression  for  the  current  densities  on 
the  interval  [z,  z,+1): 

J(z)  =  ,/sJ.,  i/j  (27) 

••"here 

J.+1/2  =  [  ‘  l’"1e(y'Ii+,/j)/''+''3dy]-1(5,+1  -  $,);  (28) 

Thu  final  discretisation  ol  (26)  is  then  obtained  integrating  over  th*; 

f  fZ *  /*xi+X/2 

Jf+i/2  —  Jf— 1/2  =  /  A-i/2J(t/)dy+  /  A1+1/2J(y)dy  (29) 

J*i- 1/3 

Equation  (29)  can  be  expanded  furt  by  substituting  the  expressions 
(27)  into  the  integrals  This  leads  .  the  foil  rwi.ig  discretisation. 

e(*i-*i+./jM.+i/j  jf+1/?  _  e(*/-*.-i/a)A..  is J._,/2  =  o  (30) 
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Abstract  A  quasilinear  singularly  perturbed  elliptic 
equation  degenerating  into  an  equation  not  containing 
derivatives  is  considered.  Problems  which  appear  when 
constructing  numerical  methods  based,  in  particular,  on 
fitting  techniques  are  discussed.  In  the  case  of  the  Dirich- 
let  problem  on  a  strip,  or  on  a  domain  with  smooth 
curvilinear-boundary,  principles  for  the  construction  of 
uniformly  (with  respect  to  the  parameter)  convergent 
schemes  are  considered. 

I.  PROBLEM  FORMULATION 

On  a  strip*!)  =  {x  :  0  <  aq  <d,  |x,|  <  oo,  s  =  2, ---,n} 
the  following  Dirichlet  problem  for  a  quasilinear  equation 
is  considered 

X(u(x))  s  e,-X1(u(s))u(is)  —  /(x,u(x))  =  0, 
x  6  D,  u(x)  =  <p(x),  x.e  R  (1) 

Here  X^uJ.is  the  second  order  elliptic  operator 
'•‘(v)  =  H  a,k{x,v)d‘2/dx,dxk 

n 

4=1 

Ii  is  assumed  that  the  coefficients  of  the  operator  L1  and 
the  lunctions  /  and  are  sufficiently  smooth,  and'  that 
for  the  function  /(x,u)  the  following  condition  is  satisfied 

(3/01 r)/(x,  u)  >  a  >  0,  (x,  u)  6  D  x  Rl. 

The  parameter  e  can  take  any  value  in  (0, 1].  When  c 
tends  to  zero  in  a  neighbourhood  of  the  boundary  I'  a 
boundary  layer  appears.  This  boundary  layer  is  described 
by  an  ordinary  differential  equation.  Derivatives  of  the 
solution  along  all  directions  out  of  a  neighbourhood  of 
the  bo  .idar_.  layer  and  also  derivatives  along  directions 
collincar  ..  ith  tl-v.  boundary  domain  in  the  neighbour¬ 
hood  of  the  boundary  layer  arc  bounded  uniformly  with 
respect  to  .he  parameter.  The  numcrral  solution  of  such 
boundary  value  problems  is  difficult  even  for  linear  equa¬ 
tions, and  gives  rise  to  the  problem  of  constructing  ap¬ 
proximations  on  special  grids,  which  converge  uniformly 
with  respect  to  the  parameter  (sec,  for  example,  (1)). 


II.  TYPICAL  NUMERICAL  PROBLEMS  FOR 
NONLINEAR  EQUATIONS 

On. a  unifornrgrid  it  is  impc^sible  to  construct  a  numer 
ical  solution  of  problem  (1)  converging  uniformly  with 
respect  to  the  parameter.  This  is  because,  on  the  one 
hand  problem  (1)  is  nw.  linear  and,  on  the  other  hand 
the  d  .iierence  of  the  values  of  the  solution  to  problem  (1) 
on  neighbouring  nodes  of  the  grid  does  not  converge  to 
zero  uniformly  with  respect  to  the  parameter  (when  the 
grid  size  tends  to  zero).  For  this  reason  it  is  necessary  to 
construct  difference  schemes  on  grids  condensing  in  the 
boundary  layer. 

m.  THE  BOUNDARY  VALUE  PROBLEM  ON 
THE  STRIP 

First  suppose  that  the  coefficients  of  the  operator  V  do 
not  depend  on  u(x).  Then  the  solution  to  problem  (1)  is 
the  limit  of  a  sequence  of  solutions  to  the  boundary  value 
problem 

1?  uw(x)  =:•  (c  i1  -  a)Jk\x)  =  /Q(x,  u(*_1)(x)), 
x  6  D,  u^^x)  =  tp(x),  x  e  T  (2) 

Note  that  this  equation  is  linear  with  respect  to  «W(i) 
and  that  fa{x,u)  =  /(x,u)  —  au.  To  solve  problem  (l) 
the  iterative  difference  scheme 

A2  zW(x)  =  f(x,zk-'(x)), 

x€Dh,  zw(x)  =  y>(x),  x  e  Ta  (3) 

aproximating  problem  (2)  is  used.  Derivatives  are  ap¬ 
proximated  by  classical  finite  differences  on  rectangular 
grids  (see,  for  example,  [2]),  which  are  condensed  in  a 
neighbourhood  of  the  boundary  layer  by  a  special  rule 
(one  such  grid  condensing  rule  is  given  in  [3]).  The  con 
ditions  which  guarantee  uniform  with  respect  to  the  pa 
rameter  convergence  of  the  solution  io  the  solution  of 
problem  (3)  (when  k  -*  oo  and  the  number  of  nodes 
increases).’"’  i  F .ated.  A  similar  method  is  used  when 
the  coefficients  of  the  operator  V  depend  on  the  solution 
of  problem  (1). 

IV.  DOMAINS  WITH  CURVILINEAR 
BOUNDARIES 

In  the  case  of  domains  with  smooth  curvilinear  bound 
irics  iterative  schemes  based  on  the  alternating  method 
of  Schwartz  arc  constructed.  A  neighbourhood  of  the 
boundary  I'  is  covered  by  a  system  of  overlapping  subdo¬ 
mains.  In  each  subdomain  the  boundary  F  of  the 
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initial  domain  DAs  rectified  by  using  a  coordinate  trans¬ 
formation.  A-difference  scheme  (in  the  new  coordinate 
system)  is  constructed  by  employing  results  obtained  for 
the  boundary  value  problem  on  the  strip.  For  boundary 
value  problems  on  domains  with  curvilinear  boundaries, 
conditions  guaranteeing  uniform  with  respect  to  the  pa¬ 
rameter  convergence  of  the  constructed  difference  scheme 
are  deduced. 
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^fetract.  In  this  paper  we  develope  a  finite-difference  method 
for  time  dependent  convection-dominating  convection-diffusion 
problems,  modeled  by  the  singularly  perturbed  parabolic  equa¬ 
tion  ^ 

du  _» 

■gl  -  +  V  V  u  +  ku  =  /,  in  ft  x  [0,T], 

where  ft  C  M2,  k  >  0  and  £  is  a  (possibly  small)  positive  con- 
stant. 

This  method  may  be  viewed  as  a  combination  between  FVac- 
tional  Steps  time  semidiscretizations,  and  one-dimensional  space 
discretizations  of  exponential  fitting  type.  Making  use  of  the 
consistency  and  the  contractivity  of  the  time  integration  pro¬ 
cess,  and  the  special  properties  of  the  discretizations  made,  via 
exponential  fitting,  for  the  space  differential  operators  at  each 
time  level,  a  (uniform  in  c)  convergence  result  is  proven.  Impor¬ 
tant  advantages  for  computations  arc  also  obtained. 

I.  INTRODUCTION 


On  the  other  hand  it  is  well  known  that  the  use  of  alterna¬ 
ting  directions  methods  permits  to  generate  simple  (like  one- 
dimensional)  and  economical  schemes,  for  the  solution  of  prob¬ 
lems  in  mathematical  phisics  that  involve  several  space  variables. 

In  this  paper  we  develope  a  new-difference  method  which 
combines  the  well-known  advantages  of  the  one-dimensional  ex¬ 
ponential  fitting  methods  for  stationary  problems  and  the  alter¬ 
nating  directions  methods. 

II.  TIME  SEMIDISCRETIZATION 

For  simplicity  in  the  exposition  of  our  analisvs  we  will  con¬ 
sider  the  following  initial  Dinchlet  boundary  value  problem 

Find  ti(x,y,<)  in  f!  =  [0, 1)  x  (0,1)  X  (0,T)  solution  of 
—  cAu  4-  +  ku  =  /, 

u(x.y,0)  =  u0(x,y),  m 

.  u(0,y,t)  =  u,(y,t),  '  ' 

«(1>y.0  =  ‘jz(y=0. 

u(xi0,t)  =  u3(i,i), 

.u(x,l,<)  =  u4(x,;t); 

where  k(x,y,t),c  >  0  and  V  =  (tij  (x,y,t),e2(x,y,t))  such  that 
y,-  has  constant  sign,  i  =  1,2.  We  will  assume  compatibility 
between  the  initial  and  the  boundary  conditions,  and  fc,T?,u,-,/ 
smooth  enough,  to  guarantee  that  the  solution  u  of  (1)  verifies 


Let  ft  be  a  bounded  domain  in  St1  with  a  piecewise  smooth 
boundary  T.  We  will  deal  with  the  numerical  aproximation  of 
the  solution  of  time  dependent,  convection  dominated,  convec- 
tion-diffusion  problems  defined  by  the  equation 

—  -  eAu  +  V^u  +  ku  =  /,  in  ft  x  [0,T], 

and  the  initial-boundary  conditions 

u(x,0)  =  u0(x)  in  ft 
u(*.0^s0r,0  in  E  x  [0, T], 

where  V  =  (v,,y3)  and  k  are  smooth  functions  on  ft,  with  c  >  0 
and  such  that  it 'may  occur  c  «  |v|.  In  general,  the  solution  of 
this  problem  is  not  globally  smooth  (even  for  smooth  data)  but 
it  may  present  rapid  variations  in  certain  narrow  regions  in  ft 
(layers). 

Problems  of  this  kind  are  found  in  the  modelling  of  convec¬ 
tion-conduction  of  heat  and  atmospheric  transport  of  pollutants. 

It  is  well  known  that  standard  finite  difference  or  finite  cle¬ 
ment  methods  applied  to  convection  dominated  flows  problems 
give  unphisical  oscilatory  solutions  with  a  reasonable  mesh  size; 
in  these  cases  the  maximum  principle  properly  is  not  preserved. 
The  first  remedy  to  avoid  this  drawback  in  finite  differences  was 
to  introduce  upwind  differencing  for  the  convective  term.  A  re¬ 
lated  concept  was  adapted  later  to  finite  element  methods. 

These  procedures  generate  spurious  crosswmd  diffusion. 
More  sophisticated  techniques  were  developed  with  the  idea  of 
introducing  an  artificial  viscosity  term  which  acted  only  in  the 
direction  of  the  streamlines  (streamline  diffusion,  Hughes  t 
Brooks,  Johnson  k  Navcrl). 

In  order  to  get  rid  of  the  influence,  on  the  numerical  solu¬ 
tion,  of  layer  terms  out  of  the  layer,  and  obtain  uniform  in  c 
convergence  results  it  was  realized  that  some  sort  of  exponential 
fitting  has  to  be  used.  These  kind  of  methods  (Il’in,  Kcllog  k 
Tsan,  Hemker,  Dooland  k  Miller  k  Schildcrs)  have  been  widely- 
studied  for  one-dimensional  stationary  problems  but  their  anal¬ 
ysis  on  multidimensional  and  time  dependent  problems  is  a  dif¬ 
ficult  task. 


{u,.4iu,Aju,  AJu,.4|u,.4j.4ju,  AiA,u)  C  C**(ft),  (2) 


a  , 

,4i=_£__  + 

32  a 

Aj  —  -£^y  +  vj—  -J-  k7,  with  ki  >  0  and  kt  -f  fcj  =  k. 

Note  that  if  /  is  smooth,  conditions  (2)  guarantee 

{“.|r.0}cc«(ft) 

Problem  (1)  is  discretized  in  time,  so  that  we  obtain  semidis¬ 
crete  aproximalions  u"(x,y)  to  u(x;y ,<„)  solution  of  (1)  at-thc 
instant  of  time  t„  =  nAt  by  means  of  the  following  Fractional 
Steps  Scheme 

'a)u°  =  uo(x,y); 

f  (J  +  At.4,)u"+*  =  u"  4  Af /,(<„+,), 

b)  <  un+T(0,y)  =  ui(y.<nj.)), 

'  '.un+i(i.y)  =  u2(yI<n+)j; 

f  (/+  AM3)u"+i  =  u"*i  4  Af/i(fB+1),(/j  +  f2  =  /), 

c)  |  un+1(x,0)  =  trj(x,<„-n), 

(  u"+,(x,l)  =  v<(x,tn+I). 

(3) 

Note  that  if  we  define  u(/f  AtA , )~ 1  u'*  by  the  resolution  of 
the  stationary  problem 


(V  +  AM,)x  =  u, 
<  x(0,y)  =  0, 
(x(l,y)  =  0; 


and  analogously  for  \I  4  AfAj^’u",  we  have  that  the  linear 
operators  "I  4  AfAj'  arc  inverse  monotonous  and 

!!(/•{•  At.4,)-’|U<  l,i  =1,2.  (4) 
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and  the  normalization  condition 


We  define  the  Local  Error  for  (3) 

en  =  u(in+,)-un+,1  (5) 

where  un+1  is  the  result  “un+1  "  obtained  of  applying  scheme  (3) 
taking  u"  -  v(l„). 

Under  the  hypothesis  (2)  for  the  solution  u  of  the  continuous 
problem  (1),  and  assuming  /j  and  f2  are  smooth,  we  obtain 

llenlU  $  C( At)J(consistency  of  the  scheme  (3)),  (6) 

and  taking  into  account  (6)  and  (4)  is  easy  to  prove 

|lu(tn)  -  u"||oo  £  CAl(convergencc  of  the  semidiscretization). 


II.  TOTAL  DISCRETIZATION 


Description:  In  order  to  obtain  a  total  discrete  method  to 
approach  (1),  scheme  (3)  is  discretized  in  space  using  an  expo¬ 
nential  fitting  technique. 

Let  9.i,  be  a  rectangular  grid  (not  necessarily  uniform)  of 
points  (x,y),(0,<  x,y  <  1)  and  let  us  denote  [.ja  the  restric¬ 
tion  of  a  function  defined  in  (0,1)  x  (0,1)  to  flA.  Our  total  dis¬ 
cretization  obtains  approximations  u£  to  (u(fn)]A  by  means  of 
the  following  algorithm 


<0*4°  = 

(ij,«.(iuri=.v«+Af[/1(tB+J)JA, 

^  ]  u*+i(°. !/)  =  (“1  (y,  i n+I  ]» , 
l  =  C«2(y,<„+1)*; 

.  j  ^Au*+.1  =  "a+^  +  At(/j(in+1)jA, 

c)  wri(x,o)=[u,(z,tn+1]A, 

UA+(x,l)  =  (u4(x  t„+,jA; 


(?) 


9/  +9J  +  9/-1- 

In  this  situation,  suposing  h  small  and  under  the  restrictions 

-  .  - 

1  ~  i  +  *i(x,-,y)Af’ 


scheme  (7)  verifies 


IPn+,U-"X+,D~<CAtA.  (S) 

where  uA+1  is  the  result  of  aplving  sheme  (7)  taking 

<  = 

Using  the  discrete  maximum  principle  we  have  proven  that, 
if  we  take  homogeneous  boundary  conditions,  we  obtain  for 
Li't'hi  f  =  1,2 


ii(£.>.Ar,y~<M=i,2.  0) 

We  have  also  obtained  results  (S)  and  (9)  with  other  expo¬ 
nential  fitting  methods  for  some  other  cases,  for  example,  when 
there  exist  attractive  turnig  points,  when  the  velocity  field  is 
paralcl  to  one  of  the  the  axis  or  if  it  is  null  in  f 1. 

Finally,  using  the  results  (6), (8)  and  (9)  it  is  proven 

i![u(<„)]A-«;ii»<c(At-fh). 

(uniform  convergence  of  the  totally  discrete  scheme) 

Note  that  the  resolution  of  (7)6)  at  each  time  level  involves 
the  resolution  at  each  line  of  points  in  flA  of  a  tridiagonal  svtcm 


where  Ll  l  h  and  L2tt<k  are  the  result  of  discretizing,  via  ex¬ 
ponential  fitting,  the  uniparametne  families  of  onc-dimcnsional 
singularly  perturbed  elipticproblcms  (3)6)  and  (3)c)  respectively 
For  the  construction  of  (  and  similarly  for  Lj.,.1,)  on 
each  time  level  t  \vc  proceed  in  the  following  way: 

Let  be  Ih,y  =  {(t0, y), (x, ,y),..., (xN, y)}  C  fl*  with  0  = 
To  <  Tj  <  . . .  <  2/y  =  1  the  line  of  points  in  ft*,  with  fix  ordinate 
y.  We  note  h;  =  xj  -  x,-.,  ,;  =  1, ....  A’  and  h  =  max(hj). 

On  h,Y  we  define  the  exponential  fitting  scheme  in  the  form 

•^i =  Qll TcfiV},,  where 


T’c.M/A^OiP)  S  u*(xq,  y)  =  Ui(y,t), 

y)  s  rj UA(xj-i,y)  X  rjm(xy, y)  +  rtuA(x;+, , y), 

]  =  1,...,.V  — 1, 

2i,AUA(x.v,y)  £  uA(x,v,y)  =  u:(y,<),  and 


of  linear  equations  (  and  the  same  for  columns  of  points  in  fl» 
for  (7)c)  ).  Therefore,  the  computational  cost  is  strongly  de¬ 
creased  with  respect  to  the  standard  implicit  discretizations  of 
multidimensional  evolution  problems 

This  scheme  also  presents  other  important  advantages  for 
computations.  For  example,  in  order  to  resolve  boundary  and 
internal  layers  and  reduce  possible  numerical  diffusion  phenom¬ 
ena,  this  method  admits  mesh  refinement  processes  that  hardly 
increase  the  computational  cost. 

Finally  wc  will  remark  that,  in  order  to  obtain  a  good 
speed-up,  the  algorithm  can  be  easily  implemented  on  paralcl 
computers,  since  the  resolution  at  each  time  level  involves  a  set 
of  uncoupled  linear  systems. 

Numerical  experiments  will  be  presented  in  the  oral  session 
and  the  complete  version  of  this  paper. 


<h9h(x}’,y)  =  qj  9a(x/-]  ,  y)  +  «Js*(x/,  y)  +  gf y»(xJ-+1,  y), 
j  =  1,...,.V  —  1. 

Scheme  (7)  is  completely  determined  by  the  coefficients  rj, 

ri>  ri  >7/  These  coefficients  arc  obtained  by  imposing 

that  the  operator 

"a(w*)  =  T,w  use*  —  Qkwi, 

is  null  on  the  set  of  functions 

{W,exp(Ijf  u,(s)*),xcxp(i  £  u,(r)*)}, 
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Abstract.  A  model  singular!}  perturbed  boundary  value  prob¬ 
lem  with  a  single  shuck  layer  <s  considered,  Yariuus  numerical 
me  thuds  are  anal}  zed  and  difficulties  in  resulting  the  lav  ci  arc 
discussed. 

The  Continuous  Problem 

We  consider  the  following  singularly  perturbed  boundary  value 
problem: 

Tu  :=  ~s u“  -  uu'  -f  c(x)u  =  0,  i  6  /  =  [0,  Ij,  (1) 

Bu  :=  (u(O).u(l))  =  (Uo,Ui),  (2) 

where  0  <  t  <.<.  1,  Vo  and  l\  arc  git  cn  numbers,  c  is  a  suffi 
ciently  smooth  function  and 

c(x)>c.  >0,  x  C  I. 

Thus,  the  famous  Lagerstrom-Colc  model  problem  is  included. 
The  problem  (1-2)  has  a  unique  solution  u.  We  assume  that 
Uo<0<  U\,  and  thus  u'(x)  >  0,  x  6  J.  Furthermore,  let 

y<  ®  J*  c(i)di  4-  U(,  is  0,1,  (3) 

be  the  solutions  to  the  reduced  problem  (1)  with  £  —  0,  and  let 
there  exist  a  point  xm  £  (0,1)  such  that  uo(x')  -f  uj(x*)  =  0. 
Then  u  has  a  shock  layer  at  x  =  x',  cf.  (1).  By  using  the 
technique  from  (5]  we  can  estimate  the  derivatives  of  u: 

lult,(*)|<M{l-re"tcxp(-m|x— x°j/€)),  r£l.  (4) 

Here  x°  is  the  unique  point  in  (0,1  j  such  that  u(x°)  =  0,  m  >  0 
is  an  arbitrary  constant  independent  of  c,  and  by  M  we  denote 
throughout  a  positive  generic  constant  independent  of  £.  x° 
is  not  known  usually,  but  it  can  be  approximated  well  by  x*. 
Moreover,  u„  i  -  0,1,  are  good  approximations  to  u  outside 
the  layer: 

|u(x)—u,(x)l  <  ,\/[s~cxp(  -m;x-x13|/£j],  x  &  /„  t  =  0.1,  (5; 

where  I0  =  [0,  x°j  and  Jj  =  fx°,  lj.  This  can  be  proved  by  using 
inverse  monotonidty  of  the  linear  operatui  L<j  -  ij,"  uy’ 
with  appropriate  boundary  operators.  For  x  £  /,  it  holds  that 

LM[zx  ~  cxp( -£~l  J^v{t)dt)]  >  isu,(x)  =  ±L[u(x)  -  o,(xj]. 

and  then  (5)  follows  by  the  technique  from  [5], 

Numerical  Methods 

The  standard  numerical  method  for  solving  (1  2)  is  diseretiza 
tion  by  the  Engquisi-Osheror  some  similar  finite-difference  sche¬ 
me,  (4J.  vYc  are  interested  in  resolving  the  layer  accurately.  and 
because  of  (4)  (with  t°  approximated  by  x' )  it  seems  reasonable 
to  apply  a  special  discretization  mesh  which  is  dense  near  x*. 
This  approach  gives  good  results  in  the  ease  of  boundary  layers. 
[4,5]  -  the  poinlwise  errors  are  first  order  accurate  uniformly  in 
£.  Here,  however,  the  uniform  accuracy  is  present  in  the  discrete 
Ll  norm  only,  and  the  use  of  the  special  rr.«h  Is  not  justified. 
The  numerical  values  duster  around  a.  point  different  from  s'. 
Another  possibility  is  to  apply  an  iterative  mesh  construction. 


such  as  the  melhud  frum  [2].  Neither  this  gives  satisfactory  re 
suits.  The  numerical  sululiun  luuks  fine  qualitative!},  but  the 
layer  is  shifted  frum  x‘.  There  is  uni}  one  explanation  for  these 
phenomena:  the  discrete  problem  has  its  own  layer  which  is 
shifted  from  the  continuous  one. 

The  best,  but  not  ideal,  results  can  be  obtained  by  the  tech¬ 
nique  which  was  applied  in  [3]  to  a  boundary  layer  quasilinear 
problem.  Let  k  =  —a Inc  with  a  positive  constant  a,  and  let 
so  =-*"  -  ks.  Si  =  x*  -f  kc.  Then  from  (5)  it  follows  that 

|u(x)  —  uj(x)I  <  Me 

for  x  €  [O.so]  K  *  =  0,  and  x  €  [sj.lJ  if  i  =  1.  Thus  we 
shall  approximate  u  Li  ^  and  u,  in  corresponding  intervals  (a, 
can  be  obtained  from  (3),  either  exactly  or  numerically),  and  it 
remains  to  solve  the  problem 

Tv  =  0,  x  e[*,«i),  v(st)  =  Ui(s,),  i  =  0, 1,  (6) 

which  is  practically  unperturbed.  We  shall  do  this  by  applying 
the  standard  central  scheme  on  the  equidistant  mesh  with  the 
step  h  =  2 kefn,  n  €  N.  The  scheme  is  stable  in  the  discrete  L1 
norm  if  n  is  sufficiently  great,  independently  of  C-  An  estimate  of 
the  error  of  this  procedure  can  be  obtained  in  Ll  norm  since  the 
operator  (T.B)  is  Ll -stable.  However,  this  is  not  sharp  enough 
fo"  we  are  interested  in  poinlwise  accuracy.  The  pointwisc  errors 
will  be  illustrated  by  the  example  with  c(x)  =  1  and  Uq  = 
—1,  Ui  ss  1/2.  Only  the  errors  of  the  numerical  solution  of  (6) 
are  interesting.  The  numerical  solution  is  compared  to  the  Inner 
solution  of  the  problem,  [l].  For  a  ss  5  and  c  =  10'*  we  get  the 
errors  S.50E-2, 1.51E-2, 4.40E-3, 4.50E-3  for  n  =  10, 20. 40,  SO. 
respectively.  The  errors  for  the  same  a  and  n  but  for  £  w  10** 
arc  1.35E-1,  4.13E-2, 7.G5E-3. 1.71E-3. 
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Abstract  A  nonsclf-adjoinl  singular  perturbation  problem  in  con¬ 
servation  form  is  considered.  We  construct  a  three  point  difference  scheme 
and'provc  that  the  solution  of  the  dilfcrcncc  scheme  converges  uniformly 
in  small  parameter  e  with  order  A"’1  to  the  solution  of  the  differential 
problem. 

I.  INTRODUCTION 


0) 


A  nonsclf-adjoinl  singular  perturbation  problem  in  conservation 

form 

/c(p(x)u'y  +  q(x)u'~  r(x)u  -  f[x),0  <  x  <1 

u(0)“  PoiU(l)  ”  pi, 

is  considered,  where  e  is  a  parameter  in  (0,1],ij(jc),  r(x),  f[x)ewm,i 

“  {jF:F(x)6C"[0,1],  FM(x)eI.lpschity},  p(x)e w"*J,  0  <  no  ^7—  sj  Ao 

'  P(x) 

_//y\ 

,  0<fl|  5*1.  r(x)>0,  p’(x)>  flj  >  0,  a„,  be ,  a  1 ,  a2 ,  A  1  are 

given  constants,  m  is  a  positive  integer  which  is  given  arbitrarily.  Under 
these  conditions,  there  is  an  unique  solution  for  the  equation  (1). 

Recently,  some  authors  derived  an  accurate  difference  schemes  of  or¬ 
der  one  or  twe  for  (1).  In  this  paper,  we  construct  a  three-point  difference 
scheme  for  (1).  For  any  m  ^  0,  we  prove  that  the  solution  of  the  dilfcrcncc 
.  scheme  converges  uniformly  in  c  with  order  h~* 1  to  the  solution  of  (I ). 


I  A  iZi-i  —  2 ,  +  A  jzi  + 1  —  A &,i  N  —  1 

"  Po.Zl  “Pi, 

where  A  l  (A  -  -1,0.1)  satisfies. 

M11-  f ‘11  (0)1  M6  -  vi(0)K  no, 

we  let 

Vl(s)=  t  h‘vHs)  +  hm*'(pim,  (k  •>  —  1,0,1) 
where  vl.  (n  *•  0,—,m)  satisfies 


M.  °  p(x i)(vL)*'  +  +  <7(jTi))ri(vi,)' 

-  Hxi)xtv[,  -  nI/„, 

vL(-  l)=  v'.i.0(l)  =  0,  Jk  —  0,1,  (S) 

v(»(l)»  v‘-w(-  l)  =  I 

vl»(  —  I)  =  vi.d)  “0,  k  =  —  1, 6,1, n  ■=  1  ,•••,!»* 
here  // 10  «■  g  to  and  for  n  &  I  , 


Hu  «{s*g,.  +  E  r..,4-*in,  -  1L  £[(«-/+  l)ep.-, *!-+«.- /) 

/-•  ‘J  />• 


7-  Zs—p..,w 

*  2  y-* 


where  2la,g,,f„r,  arc  given  by  y. 


yM(x,) 

n ! 


II .  THE  DIFFERENCE  SCHEME 
A.  An  accurate  difference  scheme 

We  construct  an  accurate  difference  scheme  for  the  problem  (1) 

L*ui  -  v 1  (0)u , _ ,  -  m  +  v((0)uiti  »  -  v«(0), 

/»  1,2, •••,*'-  1  (2) 

Uo  -Pd.us  ” pi, 

where  v((s)  (k=- 1,0,1)  satisfies: 

MW-p(*,+  sA)^  +t„U(+,A)]^£) 

r(x,  +  lA)rivI(j)  *  tigt(x,  +  sA),se(  -  1,1), A  =  £  1,0,  (j) 

vl(0)  “  v'-i(O) ->  vi(±  1) «•  0, 
lv|(l)-v'.i(-l)-l, 
h  h* 

herevi  “  7AJ  "  n(*i  +1A)  -  0,g»(xi  +  1A)  =  fix,  +  jA)  . 


C.  The  three— point  difference  scheme 

We  construct  the  three— point  difference  scheme  for  (I)  such-as, 

,Llu)  ■»  X  “  nu)_,  —  ut  +-4|luLi  -  -  A7,,(l  - 

'■ut -uo,«V“Ui,  (6) 

where  ATi  =  £  A'vL(0),A  ■=  -1,0,1. 

•  •I 

m.  THE  CONVERGENCE  THEOREM 

We  will  obtain  the  following  uniform  convergence  result. 

Theorem  Suppose  u)  be  the  solution  of  the  difference  scheme  (6)  and 
u(xi)bc  the  solution  of  (I),  then  for  0  <  A  <  A»  ,  we  have 

|u?  — u(jc,)|<  AfA"*1, 
where  M  is  a  constant  independent  of  t,  h  and  1. 


B.  Approximate  difference  scheme  IV.  NUMERICAL  EXAMPLE 

We  establish  the  following  approximate  difference  scheme.  Consider  the  following  problem 

f  z(n(TT7u0'  +  (-7-2-—  uY  -  -  J— ,  (0  <  a:  <  I), 

_  (  v  ( I  +  x)  2v  1  -p* 

u(0)=  0,  u(l)  =  I, 

<D  This  work  supported  in  part  by  a  grant  of  the  National  Science  Founda  the  exact  solution  is 

don  of  China  and  in  part  by  a  grant  of  the  Natural  Science  Foundation  of  Fujian,  _  (  j 

•j(x)  =  cinTT+T  +  Cj(I  +x)'T  +  4~, 

I  4*  C 


(7) 
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where 


(2-T-l+t) 

(1  +c)('/T-2*f)  * 

(l-'/T-e) 

(1  +  «)('/!- 2 

E*  -  max\u)  -u(x/)|,  here  u(x,)  is  the  solution  of  (7),  u)  is  the  solu- 

lion  of  the  scheme  (6)  when  m  =  1.  Numerical  result  lists  following 
table. 


h-0.1 

i 

1 

6 

9 

Em 

l-h\ 

v(*/) 

0.1705056 

0.6971326 

0.9275933 

5.286932  E-5 

u) 

0.1705048 

0.6971323 

0.9275981 

v(*i) 

0.2659307 

0.7201022 

0,9295832 

h 

1.7007319  E-4 

0.2658965 

0.7201026 

0.9296028 

t-  hi 

u(x/) 

0.3551245 

0.7113618 

0.9268337 

1.856089  E-4 

uf 

0.3552783 

0.7114487 

0.9268539 

h  -  0.025 

1 

1 

26 

39 

E . 

c-h\ 

u(x,) 

0.621421  E-2 

0.7535943 

0.9825791 

5.745888  E-5 

uf 

0.620246  E-2 

0.7535513 

0.9825695 

u(Xi) 

0.2061851 

0.7457681 

0.9815736 

c~  h 

4.41685  E-6 

u) 

0.2061807 

0.7457712 

0.9815731 

“(Xi) 

0.3101401 

0.7423608 

0.9813188 

t-AS 

7.778406  E-6 

V) 

0.3101479 

0.7423628 

0.9813186 

The  numerical  results  show  that  the  numerical  experiment  coincides 

with  the  theoretical  analysis. 

The  authors  gratefully  acknowledge  the  support  ofK.  C.  Wong  edu¬ 
cation  foundation  HongKong. 
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Abctract  The  singular  perturbation  problem  of  the  parabolic  partial 
differential  equations  involving  two  small  parameters  is  considered.  We 
construct  an  exponentially  fitted  difference  scheme  and  prove  that  when  r 
>  <  x  ^  1  — Me*  (where  S  is  a  small  positive  number),  the  so¬ 

lution  of  the  difference  scheme  converges  uniformly  to  the  solution  of  the 
original  differential  equation  with  order  one. 

I .  INTRODUCTION 

Innbts  paper  we  consider  the  singular  perturbation  problem  of  the 
parabolic  partial  differential  equations  involing  two  small  parameters. 
Wang  Guoying  (1)  constructed  a  difference  scheme  with  fitted  factors.  Ap¬ 
pling  the  classical  and  non-classical  estimation  method  to  this  scheme,  he 
proved  that  the  solution  of  this  scheme  converges  uniformly  to  the  original 
differential  equation  with  0(h  \  +  dir)  .  In  this  paper,  using  the  method 
of  decomposing  the  singular  term  from  its  solution  and  combining  an 
asymptotic  expansion  of  the  equation,  wc  prove  that  the  solution  of  the 
difference  scheme  converges  uniformly  to  the  solution  of  the  differential 
problem  with  0(h  +  di)  . 

11.  CONTINUE  PROBLEM 

Wc  consider  the  following  problem 

,  du  ,d3u  .  .du  . 

L^us  £J—  _  co(x,r)—  -  b(x,i)u 

=  f{x,t),  0<  AT  <  1,0  <  I  <  T  (I) 

uo(x) "  u0(x),  xe(0,l) 

u(0,i)=»  *«(/),  u(l,/)-£i(l),  te(0,T) 

Wc  assume: 

(//I):  a,b.ftC'(Q),  uo(x)eC*[0.n.*o,Xi€C,[0,-r] 

*«(0)  «■  «o(0),  gi(0)-uo(l), 

where 

Q  -  {(je,r),0  <  je  <  1,  0  <i<T) 
r  -  {x,0)z|0  <  x  <  I}u{(0,/)10  <  /  <  7-MO, 010  <  I  <  T) 

Q  «*  QyjT. 

(H2):  ,  (x,l)>  3>0,b(x,0>  0>O.V(x.f)e{O,l)x  (O.T). 
c,  p  arc  positive  small  paramclcrs.Whcn  c-«0,p-»0  (1)  is 

degenerated  to  -  6(x,i)u  “  f[x,i)  ,  therefore  it  lost  one  boundary  condi- 
uon  in  each  side  x  =  0  ,  x  =  I  ,  /  »  0  ,  it  appears  boundary  layer  phenom- 


Suppose  problem  (1)  has  the  following  form  of  the  asymptotic 
solution 

*  f 

u(x.o-  Z  I/i'-t,(u;.,Ju.o+  v,.„«,.o 

+  co»-iy({i,0  +  Z,-u(x,il) 

where  u$. u  be  the  solution  of  the  degenerated  problem,  v, _ u(4 1 ,<)  . 
t‘,,-u(,i,/),Z,.iJ(x,i))  are  the  boundary  layer  function  near  x  -  0  ,  x  *>  I 

/  -  0  respectively,  { i  -  j  ,  <Ji  -  1  ~  *  .7“~  ■ 

By  Vishik-Lyusternik  asymptotic  method  we  obtain  (take  first  order 
approximation  and  let  v  -  vo.o,cu  -  a>o.o,Z  »•  Zo.o  ) 
v«i,< )  -  U*(<)  -  b*(0,i)  -  (*,(i)  -  u*CI,r)) 

.  +  'KM}))) 

+  v a‘(°.l)  +  *b(0X)U  ] 

*  I  -  (a(To +?^lT)  +’<M'i.r)  -  o(O.l)  +  V  a‘(0.l)  +  <*(o!iT  j 

“>Mi,l)“  UiO)“  “*(1,1)-  (*•(/)- u*(0.0) 

.  j [°(0.0 -No*  (0,0  +  7»(6.0 1  j 

tXp(  - MLtl  +  v'a’fl.r)  +  <6(1.0  Kl  - x) } 


I  txp{  -  lad.i)  +  v  e’(l,r)  +  <60,0  -  o(O.r)  +  v  a’fO.O  +  <5(0.01  ■ 
Z(x,,)  -  lu.M- u  *  (x.O)Jexp  {~~i— ) 


a(0,t)-'Ja*(0,t)  +  4b(0,/) 


,  o(l,l)  +  Va>(l,0  +  4i(].i) 
- Tc - 


wc  obtain 


,  a  -Wtf2  +46 

il - ~c - -  ' 

-  n(x,r).  b  -  6(x,i) 


IDlv««i,i)|  ^  Cc  "*exp{  -  iitxj 
|D?v««.,OKC,  (x  ,1)6(2 
\Diaj, ,({j,/)|  4  Cc  "*exp{  -  ajix} 
|Dfa)„«,,i)|<C.  (x, 1)6(2 

IDiZ„(x.i;i)|^  C 


a  +  vaJ  +  4  b 


[u);z(i(x,i))l5  Cp  *exp{  -  ~  (x,/)62-»i 


(BThis  work  supported  in  part  by  a  gram  of  the  National  Natural  Seienee  Founda¬ 
tion  of  China  and  in  part  by  a  grant  of  the  Natural  Science  Foundation  of 
Fujian 


v*  "  Z  ),vi(A  i)  rcsprcscnt  S  ncighbourhoodof  corner  (0.0)  and 


ill.  DISCRETE  PROBLEM 

Divide  region  Q  mio  rcclangulaar  mesh,  x,  -jh,  /- 0,1,—,./.  h 

'  ~J’1‘  ”  n&lii  *  0,1, •••,//, ii  ■»  i.  .  Define  mesh  space 

2**  -  {(x;,r.)|0s;/« /,  OsSn^W} 
r**  -  q**  „  Q'* _ 


,  <Z*»  ~  <7-i 
2h 


D D  .  g/  —  &jl 1  —  2^2  +  1 


where  g?  is  ihe  function  defined  in  QtJU  , 
Take 

MHx,fi)exp{  ' tJC>-0)Ar  } 

P/  r*  - — - - - 2 _ 

l-^{— ^-■0.^',} 

if' *"*¥>■ 


a  -  \*<jJ  +  4b 


a +  'J  a2  +  4b 
’  2c 


a-a(x,,i,),  b-b(x,,l.) 

Define  the  difference  operator 

Ll*o‘"  s  -p/*'D,*a>;  +  c*oxD  ,D  .o>1" 

-  a(xi,t.)co  i  Doin',"  -b(x,,i.)a>J*'. 
This  operator  satisfies  the  maximum  principle 
We  construct  the  difference  scheme 

j  /.‘■4,ir;’ 1  •»/}•'  /n2»A‘ 

|“I'Jo(l.),  u)  =  gi(/.).  0<n<A,-l 

‘U?  =Uo(X|),  1  </</  —  I' 

Define  the  mesh  functions  v;.<a;,Z;,C?  in  the  following 
t  L^v}  -  lMx„t.) 
v?  -  v(x„0) 

vf  *»  v(0,r.),  v}  =  v(l,r«) 
j  L'A'wJ  -  l,<o(xi,t.) 

=  Co(X;,0) 

icoj  «  ca(0,r,),  m)  =  cu(l,r.) 

{ l.tA'2.1  =  I,Z{xi,t.) 

I  Z?  =  Z(x„0) 

lZ!  =  Z(0,r.),  Z3-Z(l.r.) 
”I.G(x„t.) 

|g«-cu,,o) 

lCi  »  <7(0, r.).  <7}  -  C(l,i. ). 
then  u;  -  v;  +  ca?  +  Z?  +  <7? 

IV.  MAIN  THEOREM 

Theorem  I  If  u(x,r)  =  v«i.r)  +  o)(pi,r)  +  Zfjc.ri)  +  <7(x,r) 
i/>  •-»;  +  r«;  +  Z;  -K7; 


then  when  r  S  A/p*.  A/e*  si  x  5  I  A/t*.  (0  <  0  <  I ) 

I  IG(x, ./.)•■  <7JK  A/(A  +  Ar). 

|v(x,,r.)  -  v; |  <  A/(A*  -t*  Ar). 

|(o(x,,/.)-  oJ|  ^;A/ (A 1  +  Ar), 

|Z(x,,r.)  -  Z?1  CA/(A  v  Ar). 

c 

Theorem  2  Assume  that  the  coefficient  and  the  right  hand,  initial, 
boundary  functions  of  (1)  arc  sufficrntly  smooth, and  satisfy  conditions 
(H I)  and  (H2),  then  when  r  >  A/p*, A/e*  <  x  ^  I  —  A/e*  ,  the  solution  of 
the  difference  scheme  (2)  converges  uniformly  to  the  soluiton  of  (I).  as  h 
-•0  ,Ar->0  ,  and  the  following  estimation  holds. 

|u?  -  u(x„r.)l  ^  A/(AKA  +  Ar), 

where  5  is  an  arbitrary  number  in  (0,1)  , 

The  authors  gratefully  acknowledge  the  support  of  K.  C  Wong 
eduction  foundation  HongKong. 
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Abstract:  A  kind  of  nonlinear  difference  equations  is 
considered.  Singular  perturbation  method  is  applied  to 
construct  the  asymptotic  approximation  of  tho  solution  to 
the  difference  equation.  Using  the  theory  of  exponential 
dichotomies  we  show  that  the  solution  of  an  order-reduced 
equation  is  a  good  approximation  of  the  solution  to  the 
difference  equation  except  near  boundaries.  The  correctos, 
which  yield  asymptotic  approximations,  are  constructed. 

1,  INTRODUCTION 

We  are  considering  singularly  perturbed  difference¬ 
boundary  problems  of  the  form 

0-/3(x*H-  i!f(uK+1)-f(Uj.)]+c^5  {g(u^+i)-2g(ufc)+g(ufc_,)] 

k  -  1 . .  0  <  c  £  £o  and  u<>  -  a,  un+1  -  0  (1) 

They  seem  the  ’’upwind”  difference  approximation  of  the 
following  class  of  boundary  value  problems  for  nonlinear, 
second  order,, ordinary  differential  equations 

cg(u)xa  -K(u)*  -p/3(x)-0,  u(0)-a,  u(l)-/3,  xc[0,  1),  0  <  e  £  £o 

which  has  been  presented  in  the  studies  of  phase-locking 
in  chains  of  weakly  coupled  oscillators  as  a  continuum 
approximation  ([11). 

In  [21,  Reinhardt  proposed  the  numerical  treatment  of 
linear  singular  perturbation  difference  problems  using 
formal  approximations  and  correctors.  In  this  paper  we 
shall  consider  nonlinear  difference  equations.  In  this  paper, 
by  using  singular  perturbation  technique,  we  construct  two 
lower-order  difference  equations  for  tho  nonlinear 
difference  equation  (1)  such  that  the  sum  of  two 
corresponding  solutions  of  these  equations  is  the 
asymptotic  approximation  of  that  of  (1).  In  this  treatment 
the  main  difficulty  is  to  prove  that  the  solution  of  a 
lower-order  difference  equation,  which  is  called  "outer 
solution”,  is  uniformly  close  to  the  solution  of  (1)  except 
the  boundary  layer.  We  have  proved  that  by  using  the 
theory  of  exponential  dichotomies.  This  idea  is  motivated 
by  the  successful  application  of  exponential  dichotomies  to 
multiple  coupling  in  chains  of  oscillators  [3].  The  methods 
demostrated  here  for  the  nonlinear  difference  equation,  (1) 
can  bo  applied  to  construct  the  combination  solution  for 
the  higher-order  nonlinear  singular  perturbation  difference 
equations. 

In  [1],  N.  Kopell  and  G.  B.  Ermentrout  have  proved  a 
proposition  by  which  we  can  determine  where  the 
boundary  layer  of  the  solution  to  the  singularly  perturbed 
problem  is.  In  the  followings  we  suppose  f  ,  g  and  /3(x) 
satisfy  the  conditions,  i.e.,  there  is  an  interval  J  in  which 
g'(u)  >  0,  f"(u)  <  0  f'(u)  /:  0  and  Q-f(ix)—  f(/3)—  j 0/3(s)ds 
>0,  for  which  tho  solution  to  (1)  has  a  boundary  layer  on 
the  L.H.  side.  For  other  cases,  the  solution  has  a 
boundary  layer  on  the  R.H.  side,  the  similar  procedure  can 
be  used  to  obtain  the  similar  results. 

2,  REDUCED  EQUATIONS  AND  OUTER  SOLUTIONS 

The  reduced  equations  are 

0-j3*-Fg[f(v)t+,)— f(v*)J,  k-0,  ...,n,  and  v„+i-0.  (2) 

Firstly,  we  denote  the  difference  u^— vfc  by  a  new  variable 


7]k  and  derive  a  discrete  equation  of  T]  k  and  let  /?fch  - 
(Uk+,  —  •  Then  there  is  such  a  constant  O  that 

D  -  U)k  +  f  (v*),  k-0,  ....  n  and  vn+l  -  0  (3) 

This  solution  exists  provided  that  vk  stay  in  the  region 
in  which  f(u)  is  monotone,  and  hence  invertible. 

Similarly,  we  can  obtain  the  equations  for  such  Q 

n  -  +  f(u*)  +  -£-[  g(Ufc)  -g(u*_,)  1  (4) 

k  -  1 . n  and  Uo  -  a,  un+1  -  0. 

Using  Taylor  series,  equations  (3),  (4)  can  be  rewritten 
as 

0-[f'(Vfc+1)  -) — ^-g'(vfc+1)](ut+1  —  vk+1) — ^-g'(vk+1)(ufc  -  vk) 

+o(ut+,  -v*+,)+o(ufc  -vk)-f— Jj-0(vfc -vk+1)  (5) 

We  note  that  the  terms  involving  the  form  v*  —  vfc+,_ 
are  all  O  (  h  ).  Thus, 

I?>t+i  “  Afc  TJk  -f-  H  (i7fc+i,  Vk)  +  O  (  e  )  (6) 

where  Ak  -  -~-g'(v*+1)  /  [  f'(vfc+1)  +  ^-g'(vk+1)  1  ,  H  is 
at  least  quadratic  in  its  variables  and-k  -  I,  ...,  n. 

It  is  clear  that  if  f'(u)  0  for  all  u  e  J,  then  the 

absolute  values  of  Ak  are  bounded  uniformly  away  from 
1.  Now  we  wish  to  use  this  to  show  there  are  solutions  ufc 
to  (1)  which  stay  arbitrarily  close  to  any  outer  solution 
defined  by  (3)  that  satisfies  vt  e  J  in  which  f  is  monotone. 
For  definiteness,  we  suppose  f'  >  0  in  J. 

Theorem  1:  Let  {  M*  }  be  a  sequence  of  nXn  invertible 
matrices,  K  £  Z.  Suppose  that  the  linear  difference 
equation  Yx+1-MfcYfc  has  an  exponential  dichotomy  on  Z 
with  constants  K,  o’  and  projections  P*. 

Suppose  that,  for  each  k  in  Z,  H  is  at  least  quadratic  in 
its  variables  and  {r*}  is  a  bounded  sequence.  Then  the 
implicit,  nonlinear  difference  equation 

Yj,+i  -  MkYk  +  H  (Yk+1,  Y*)-+  e  rk  (7) 

has  an  unique  solution  (Y*)  such  that  for  sufficiently 
small  e  and  all  k  e  Z, 

I  yk  I  <;  £  2K  (  1  +  c-cr)(  1  -  e-crr,sup)t„  I  r*  I 

Proof:  The  proof  runs  analogously  to  that  in  [4] 

Theorem  1  can  be  used  to  difference  equations  defined 
for  all  k  £  Z  while  our  system  (6)  is  defined  only  for  1  <( 
k  £  n.  We  must  make  a  suitable  extension  for  system  (6) 
in  order  to  use  the  exponential  dichotomy  theory.  We  note 
that  if  U)k  are  constants,  then  each  outer  solution  vk  is 
also  a  constant,  and  hence  the  linearization  Afc  of  (6) 
around  vfc+1  is  also  a  conc'ant.  To  consider  (6)  as  an 
infinite  system,  wo  may  define  0h  -  0  for  k  ^  0  and  k  ^ 
n+1.  Then,  if  Wk  aro  sufficiently  close  to  a  constant,  thon 
tho  linear  homogeneous  system  associated  with  tho 
suitable  extension  of  (6)  has  an  exponential  dichotomy 
([4]).  Thus,  we  now  establish  tho  following  theorem: 
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Theorem  2:  Suppose  that  the  above  hypotheses.  Then 
there  is  a  solution  to  (1)  that  is  arbitrarily  close  to  the 
outer  solution  of  (2)  and 

I  uk  —  vfc  I  -  0  (-£  )  k  —  1,  ...  n. 

for  sufficiently  smallh. 

3,  CORRECTORS  AND  ASYMPTOTIC  APPROXIMATION 

Suppose  that  in  our  case  a  boundary  layer  behavior 
occurs  at  k  -  0  ,  and  there  is  a  number  ho  such  that  for  0 
<  h  ^  h0  we  have  the  estimate:  -I  uk  -  vfc  I  <.  C  t,  where 
C  is  independent  of  h  and  e.  (  ho  can  be  determined  by  the 
roughness  theorem  for- exponential  dichotomies) 

Analogously  to  12),  we  set 

wfc  -  tkpk,  k  -  0 . n+1  (8) 

and  we  can  obtain 

0  — F  &+yG  k  -  T,  ...,  n+1  (9) 

where  p0  is  a  parameter  which  will  be  determined  by 
boundary  conditions,  F  -  f'(0)  and  G  -  g'(0) 

By  induction,  the  representation  of  pk  immediately  can 
be  obtained  as  follow 

/>*  -  ?  k  -0,  ....  n+1 

In  order  that  {v*+w,,}  presents  an  asymptotic 
approximation  we  choose  p0  -  a  —  v0.  Finally  wc  have 

Theorem  3:  suppose  the  above  hypotheses,  and  0  <  m  <, 
I  f.'(u)  I,  I  g'(u)  I  <.  M  for  all  u  t  J.  Then  {  vk  +  wk  }  is  an 
asymptotic  approximation  of  {  uk  }  for  k-0,  ...,  n+1.  The 
error  satisfies  tho  following  estimates 

lu*  — (  vfc  +  w*  )l  £  It  " 

where  L  is  a  constant  independent  of  t  and  h  and  q  >  1 
is  a  constant. 

Proof:  Firstly,  wc  have 

at  k  -  0,  Uo  —  (  Vo  +  w0  )  -  (  a  —  v<,  )  —  p0  -  0 
at  k-n+1,  u;,+i  — (vn+1  +wfltl)-/3  — (0  +en+1p„+i) - tn+lpn+l 

Generaly,  we  have 

l/’fcl  ^  I  A,  !  (  hm  ^  "+!• 

Therefore,  provided  0  <  e  <  to,  where  to  -  (  — -h  )7  < 
1,  where  q  >  1,  we  can  obtain  the  following  estimates: 

I  ufc  —  (  vfc  +  w*  )  I  £  1  u*  -  vk  I  +  i  w*  I 
£Ct  +  tk\Po 

<:  e1-5  (  C  +  |  po  | ).  k  -  1,  ..  ,  n. 

since  e*(  ^  J*1  £  t  ^  <;  t  v  and  we  suppose  |  ufc  - 
Vk  I  <(  C  t,  where  C  is-a  constant. 

This  completes  tho  proof. 

4,  EXAMPLES 


eu"  +  e“u'  -  simf  -  0,  u(0)  -  0,  u(l)  -  0 

It’s  asymptotic  approximation's 

u-Ln(  1  —  icos^p  )— Ln(l  —  §exp((§  —  l)x/e))  4-  0(e) 

and  the  solution  has  a  boundary  layer  near  the  endpoint  x 
-  0  (see  Figure  1). 


U 


Figure  1  (e  -  0.01  and  h  -  0.02)  asymptotic  solution, 
iteration  solution  and  approximation  solution 

The  second  example  we  shall  consider  is 

eu"  +  eV  -  (|sinf)e2u  -  0,  uiO)  -  0,  ml)  -  0 

This  nonlinear  equation  is  due  to  O’Malley  (5)  and  the 
variable  fitting  factor  is  used  to  find  the  numerical 
solution  ((6))  (see  Figure  2). 


Figure  2  (e-0.01,  h-0.02),  asymptotic  solution, 
iteration  solution  and  approximation  solution 
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Abstract  -  We  are  interested  in  numerical 
methods  for  singular  perturbation  problems. 
Iterative  algorithms  for  domain  decomposition 
are  consided.  Numerical  examples  are  presented 
for  both  one-  and  two-dimensional  problems.  We 
compare  the  performance  of  a  serial  iterative 
algorithm  for  domain  decomposition  and  its  pa¬ 
rallel  implementation. 

1.  INTRODUCTION 

We  are  interested  in  numerical  methods  for 
singular  perturbation  problems.  The  solution 
of  this  problem  exhibits  a  fine  structure  wi¬ 
thin  small  regions  (boundary  and  interior 
layers)  of  the  computational  domain.  The  tra¬ 
ditional  numerical  techniques  for  solving  sin¬ 
gularly  perturbed  problems  require  a  fine  mesh 
covering  the  whole  domain  in  order  to  resolve 
these  fine  local  details.  These  methods  are 
inefficient,  since  the  fine  mesh  is  not  needed 
in  those  parts  of  the  domain  where  the  solu¬ 
tion  has  a  moderate  variation. 

We  present  a  numerical  technique  where  the 
regions  of  rapid  change  of.  the  solution  are 
localized  in  space  and  therefore  the  refine¬ 
ment  is  applied  locally  (near  boundary  and  in¬ 
terior  layers) .  The  construction  of  these  spe¬ 
cial  meshes  is  based  on  mesh  generating  func¬ 
tions  (e.g.  [1]).  Except  the  grid  refinement 
approach,  our  numerical  method  is  based  on  do¬ 
main  decomposition.  The  domain  decomposition 
technique  provides  a  natural  route  to  paralle¬ 
lism. 

We  introduce  and  analyze  iterative  algorithms 
for  domain  decomposition  which  reduce  the  gi¬ 
ven  problem  to  sequences  of  boundary  value 
problems  on  each  subdomain.  This  numerical 
method  is  illustrated  by  solving  singularly 
perturbed  problems  for  elliptic  equations.  We 
consider  the  case  of  two  subdomains.  However, 
the  results  given  also  hold  for  more  general 
situations. 

Firstly  the  problem  in  the  one-dimensional 
context  is  discussed.  The  same  analysis  is  al¬ 
so  generalized  to  the  two-dimensional  case. 
Numerical  examples  are  presented  for  both  one- 


and  two-dimensional  problems.  Here  we  compare 
the  performance  of  a  serial  iterative  algo¬ 
rithm  for  domain  decomposition  and  jts  paral¬ 
lel  implementation. 

2.  ITERATIVE  ALGORITHMS 

We  illustrate  iterative  algorithms  for  domain 
decomposition  for  the  singularly  perturbed 

one-dimensional  elliptic  problem 

.2 

L  u(x)=  fi2  S_H  =f  (x,u) ,  xefi,  £*=(0,1),  (la) 
^  dx2 

U(0)=UQ,  UflJaUj,  (lb) 

f  im2=const>0.  (lc) 

u 

where  (i> 0  is  a  small  parameter.  The  solution 
of  (la)-(lc)  has  boundary  layers  at  x=0,l  and 
the  size  of  boundary  layers  is  of  the  order  of 
h^=fi|lh(fi)  |/m.  For  simplicity,  we  assume  that 
the  solution  u(x)  exhibits  boundary  layer  only 
at  x=0  (the  "reduced"  solution  satisfies  the 
boundary  condition  (lb)  at  x=l) . 

We  introduce  the  overlapping  decomposition  of 
the  domain  £2  into  two  subdomains  £21  and  fi2: 

nj=(o,x),  £22=(x,1),  o<x<x<1.  (2) 

Consider  two  sequences  of  functions  (v”), 

{w°),  nil,  satisfying  the  problems: 

LfJvn(x)=f(x,vn) ,  xefij,  (3) 

vn(°)=V  A*)  "A 

L^(x)=f(x,w"),  xe£22,  (4) 

w°  (i)  =ux . 

We  now  construct  two  iterative  algorithms. 

The  first  one,  Al,  is  the  Schwarz  alternating 
procedure. Here  the  boundary  conditions  v°,  w° 
from  (3)  and  (4)  , respectively,  are  defined  by 
v**W»(x),  )/'=vn (x) ,  nil,  (5) 

(the  initial  guess  v1  should  be  prescribed) . 

The  second  algorithm,  A2,  is  constructed 

using  the  interfacial  problem 

L  zn(x)=f(x,zn),  xenin=(x“,x°) ,  (6a) 

zn(x")=vn(x“) ,  zn(x*)=wn(x") ,  nil, 

where  x  <x<x<x  .  Here  the  boundary  conditions 
from  (3),  (4)  are  determined  by 

vf+.1=zn(x),  v^Wtx),  nil,  (6b) 

(the  initial  guesses  w1  and  v1  are  given) . 

Algorithm  Al  is  a  serial  procedure,  but  algo¬ 
rithm  A2  can  be  carried  out  by  parallel  pro¬ 
cessing. 
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For  algorithms  Al  and  A2  we  have 
Proposition  l.  If  x>x,  then  iterative  algo¬ 
rithm  (3).,.  (4)  ,  (5)  converges  to  the  solution 
of  problem  (1)  with  the  linear  rate  q: 
q=p(x)/p(x)<l,  p(x)=sh(mx/p)/sh[m(l-x)/p] . 
Proposition  2.  Iterative  algorithm  (3)=,  (4) , 

(6)  converges  to  the  solution  of  problem  (1) 
with  linear  rate  q<l  provided  from 

(2),  (6a)  fulfill 

(a)  x-x*S2/i/m,  x*-xi2/i/m; 
or 

* 

(b)  if  /l  is  sufficiently  small  and  x-x  -h  / 

_ *  _  p 

x  -xih^  then  q=0(p) . 

Remark.  Iterative  algorithm  A2  can  be  genera¬ 
lized  straightforwardly  to  multiple-domain  de¬ 
compositions. 

3.  NUMERICAL  EXAMPLES 

We  present  the  results  of  some  numerical  ex¬ 
periments  using  the  iterative  algorithms  A1 
and  A2  described  in  previous  section. 

Example  1.  We  consider  problem  (?.  ) ,  where 
f (x,u)=l-e-u,  uQ=l,  u  =0.  Introduce  a  non- 
equidistant  grid  , OiiSN^} .  The  subdo¬ 

mains  Qj,  Qz  and  J2in  from  (2),  (6a)  are  chosen 

in  the  forms:  x=h  =x.,  x=x.  ,  0<j<k<N  ,  k-j£l, 
~B  — »  p  J  k  x 

2  x  =3W 

In  the  boundary  layer  [0,h^],  the  mesh  gene¬ 
rating  function  is  a  logarithmic  type  function 
from  [1],  We  approximate  the  differential 
equation  of  (la)  by  a  simple  variable-mesh 
difference  formula.  The  nonlinear  algebraic 
systems  (after  descretizations  of  (3),  (4)  and 
(6))  are  solved  by  the  one-step  Newton  method. 
In  Table  l  we  give  the  results  of  iterative 
algorithms  Al  and  A2  for  various  p  and 
overlapping  h=x-x  values.  Here  the  number  of 
mesh  points  Nx=101,  j=51  and  kS52.  Kftl  and 
denote  a  number  of  iterations  for  algorithms 
Al  and  A2,  respectively,  to  achieve  an  error 

—5  • 

of  10  .  If  we  implement  algorithm  A2  on  two 

parallel  processors  then  tA2/tQ=0.525  where 
tA2  and  tQ  are  execution  times  for  algorithm 
A2  and  for  the  undecomposed  method  from  [1], 
respectively  (j=51,  k=52,  KA2=K0=4) • 


TABLE  1 


P  \h 

KA1 

KA2 

0.01 

0.05 

0.1 

0.01 

0.05 

0.1 

0.1 

33 

10 

6 

26 

11 

8 

0.05 

16 

6 

4 

13 

6 

5 

0.01 

4 

4 

4 

4 

4 

4 

0.001 

4 

4 

4 

4 

4 

4 

Example  2.  We  consider  the  two-dimensional 


elliptic  problem 
2  2 

P2  [  +  --jr  1 =l-e-u,  (x,y)=Qc(0,l)x(0,l) , 

L  oxr  dy*  •» 

u(0,y)=cof~(iry/2) ,  u(l,y)=of  ye[0,i), 

u(x,.)=0,  g^|y=o=°f  *[0,1-]. 

Introduce  a  non-equidistant  grid  x(d  ,  whe- 

x  y 

re  as  in  example  1,  and  is  a  uniform 
one-dimensional  mesh  in  y.  The  results  are 
presented  in  lable  2.  Here  Nx=41,  Ny=25  and 
j=21,  kZ22 ,  J?,.n=(xJ_1,xk+1)x(0,l) .  If  we  im¬ 

plement  algorithm  A2  on  two  parallel  proces¬ 
sors  then  tA2/tQ=o.54l  ( j  =2 1 ,  k=22,  KA2=K0=4)- 


TABLE  2 


P  \h 

KA1 

KA2  __  i 

0.01 

0.05 

0.1 

0.01 

0.05 

0.1 

0.1 

59 

15 

9 

38 

14 

10 

0.05 

31 

9 

6 

20 

8 

6 

0.01 

7 

4 

4 

6 

4 

4 

0.001 

4 

4 

4 

4 

4 

4 

A2-like  algorithms  can  be  used  for  solving 
singularly  perturbed  problems,  where  boundary 
and  interior  layers  have  a  complex  geometry. 
In  Fig.  1  we  present  the  solution  (for 
of  the  following  problem 


-U-J 

r  o. 

<-  ax2  ay2  J 

1 

L  -l, 

0,  (x2+y2)1/2<0.5. 


(x,y)=fie(0,l)x(0,i)„ 

u(x,o)=o,  x£ [o, o. 25) ,  u(x,i)=i,  xe[0,i], 

^y^T0'  ^(0.25,1),  3x|  x=0,  i=o,  ye[0,i). 

obtained  by  using  A2-like  algorithm. 


Fig.  1. 
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SPECTRAL-FINITE  ELEMENT  SCHEME  FOR  NAVIER-STOKES  EQUATIONS 


GUO  BEN-YU  A 

Shanghai  University  of  Science  and 
Technology 

Shanghai,  201800  P.R.C. 

Abstract  A  spectral-finite  element  scheme  is 
proposed  for  the  lateral  periodic  and  non-slip 
boundary  problem  of  unsteady  Nayier-Stokes 
equations.  The  "inf-sup"  condition  is  justifi¬ 
ed,  and  the  convergence  rates  are  presented. 

I.  SCHEME 

Let  Q  e  R“  be  a  convex  polygon  and  I  =  (0,25t). 
ile{(x,y)  /  x=(xjtX2^e^’  Yet}-  We  consider 
Navier-Stokes  equations  as  follows 


~+  (  U-7)  U  +  V  P-i>VzU=-f  ,  in  Ax(0,T], 


<  V-U  =  0  ,  in  Ax[0,T]  ,  (l) 

l  U(x,y ,0)  = UQ(x,y)  ,  in.fi., 

where  U,  P  and  i)  are  the  velocity,  the  ratio 
of  pressure  over  density  and  the  kinetic  vis¬ 
cosity  respectively,  f  and  UQ  are  given  func¬ 
tions  with  the  period  2%  for  the  variable  y. 
We  consider  the  latst..!  periodic  and  non-slip 
boundary  conditions.  It  means  that 

U(x , y , t)  ■=  0  ,  for  xegQ,  yel, 

U(x,0,t)  =  U(x,2fl,t)  ,  for  x  e  Q  ,  (2) 

P(x,0,t)  =  P(x,2?t,t)  ,  for  xeQ. 

In  addition,  the  pressure  satisfies  the  nor¬ 
malization  condition 


AND  CAO  WE1-MING 

Shanghai  University  of  Science  and 
Technology 

Shanghai,  201800  P.R.C. 
o 

and  L  (Q)  respectively,  q=l,2,3.  On  the  other 
^  hand,  for  spectral  approximation  in  the  peri¬ 
odic  direction,  we  define  for  any  positive 
integer  N  the  subspace 

5H=viJV '  v5-j|. 

We  choose  the  trial  subspace  for  the  velocity 
as  follows 

Vh,N=  I  Vh1)fiSNMVh2)®SN}  x  {Vh3>aSNi  * 

while  the  approximate  pressure  p  is  in  space 

.  ,  _  J-i  ft  o  l  nli  2  /  a  \ 


in  Ax[0,T] ,  (1)  Lh,N~  {Lh®SNl^L 


M(P)=J^P(x,y,t)dxdy  =  0.  (3) 

Let  Cp(ft)  be  the  set  of  infinitely  differen¬ 
tiable  functions  with  the  period  27t  for  the 
variable  y.  11^(11)  is  the  completion  of  C“(fl) 

in  H*(ft-)  and  H*p(A)  =  Hj(il)nL2(I.Hj(Q)). 
Furthermore 

L2Ol)  =  {  weL2(ft)  /  M(w)  =  0  }  . 

2 

■  Let  (-,•)  be  the  scalar  product  in  L  (jl)and 
define 

J  (  u,^>,  v)=j(  (?V)u,  v  )—  ~  (  ( </>•  7 )  v ,  u  )  . 

The  generalized  solution  of  (1-3)  is  the  pair 
U(t)  e  [  Hq  p(H)]2  and  P(t)-e  L2((l)  such  that 
|  (yfU(t),v)+ J(U(t),U(t),v>  -  (P(t),7.v) 

I  +P(  VU(t),  Vv)  =  (  f(t),v)  ,  f  ve(Hjpai)]3  , 


(V-U(t),  w)  =  0  , 
U(0)  =Un  . 


«el2(R)  , 


Now,  we  construct  the  spectral-finite  element 
scheme.  For  finite  element  approximation  in 
the  non-periodic  directions,  we  suppose jthat  {Ch} 
is  a  regular  family  of  finite  triangulations 
of  Q.  Subspaces  v£*^  and  L^,  which  are  compos¬ 
ed  of  continuous  piecewise  polynomials  in  Q, 
are  finite  dimensional  approximations  to  Uq^Q) 


Let  t  be  the  mesh  size  in  time  t  and 

Ut(t)  =-J-  (  U(t+T)  -  U(t)  )  . 

The  spectral-finite  element  scheme  for  sol¬ 
ving  (4)  is  to  find  the  pair  u(t)  o  vh  and 

p(t)e  Ljl  such  that 

(  ut(t),v  )+J(  u(t)+Stut(t),u(t),v)  -  (p(t) 

+  0rpr(t)  ,V-v)  +■»)(  V(u(t)+or*ut(t),  Vv  ) 

(  =(f(t),v),  ^veVh,N  ’  (5) 

p(pt(-c)iWv  +  (  V-(u(t)+8tut(t)),  w)  =  0  , 

weLh,N  ’ 

■  u(0)  =Hh(Nu0  ,  P(0)  =  0  , 

where  £,0>O  and  <T  >  |  are  parameters.  The 
parameter  p > 0  is  artificial  compression  coef¬ 
ficient  (see  [1]).  JTh  «  is  a  projection  from 
tHjoi))3  intoVh  N. 

II.  "INF-SUP"  CONDITION  AND  CONVERGENCE 

For  convenience,  we  introduce  firstly  several 
non-isotropic  Sobolev  spaces.  For  r,s^0, 

Hr,s(ft)  =  L2(I,Hr(Q))AHs(I,L2(Q)) 
equipped  with  the  norm 

If  r,s  > 1 ,  we  define  also 

Mr,s(fl)  =  Hl(I,Hr-l(Q) )A  H9‘1(r,H1(Q))AUr,S(Il). 
with  the  norm 

2  2  2  1/2 
®^Hr,S(a)  (  ^lfr,S(ft-)+  1!''iJHr~I(I,H1(Q))+  ®^II9"1(I,H1(Q))>  . 

Mq^OI)  isthe  completion  o£  Cp(a  L2(I,H*(Q)) 
in  Mr,sOl).  Besides,  we  denote  by  H- 1!^  and  |- 
the  norm  and  semi-norm  of  HM(A),and  lot  |I*  0  =li* 


1«  *.d  Vh.V<>>8»<2>. 


give  two  assumptions  for  0nd  L^  as  the 
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following-: 

(HI):  anH  Is j(  satisfy  the  two-dimensional 

"inf— s.,>"  condition,  i.e.,  there  exists  a  con¬ 
stant’'  ^>0,  independent'  of  h,  such  that  (cf.[2]) 

(  'j^h  ’  ^  2 

_*  v  ,  . 


^%e  V 

(H2):  There  exist  k>l  and  C>0  such  that  for 
r^2  and  r  =  min  (  r ,  k+1 )  ,. 


inf  I  y - v 


vheLh 


r.  I  ^  C  hr_1 1  v  |  - 
h  1  Hr(0V 

H^Q) 

f  v  e  Hr(Q),  (-Uqi3),. 

I]  C  hr_1 1  v  l  -  . 

h  L2(Q)  Hr  *(Q) 

V  v  e  Hr  lQ). 


With  the  above  two  assumptions,  the  three- 
dimensional  "inf-sup"  condition  holds  for  Vh  ^ 
and  Lh((ji 

Lemma  1-  There  exists  a  constant  P>0,  inde¬ 
pendent  of  h  and  N,  such  that 

(  V-v.  /t) 

•l'  ’-T7r->,SWi  • 

M  e  bh  ,‘N 

By  Lemma  1  and  an  error  estimate  of  the  com¬ 
bined  spectral-finite  element  approximation 
derived  from(H2),  we  obtain  the  following 
result. 

Lemma  2  If  (U(t)  ,P(t'))  e  M^JCA)  x  h£_1  * 8-1  (ft) 

with  r}l  and  s^l,  is  the  generalized  solution 
of  (4),  (U*(t),P*(t)) e VhjNxLh>N  is  its  be  kes 
projection,  i.e., 

|  (  V(U(t)-<J*(t)),  Vv)=0,  VveV 

J  **  r  r  e.  \ 


(4)  and  (5)  respectively.  U  e  Ut(0,T;Ml,®(,ft  )  ) 

A  H2(G,T:L2ai  )  ),  P  e:C  (0,T;Hp-1  ,s-1(fl))  A  H1 

(0,T;L2(ft )  ) ,  with  rJTl  and  s^l.  If  the  follow¬ 
ing  conditions  are  fulfilled, 

(i)  Assumptions  (HI)  and  ( h 2 )  hold,  and  h£j^; 

28  00  2.0-1 

(ii)  T>20TT  or  >;T(C0h  2+n2)<-0^I7?-  . 

(iii)  there  exist  £q<T  and  constant  Cj>0, 
such  that 

t  U*(0)-u(0)|2  +  p  ||P*(0)-p(0)|2+  Ct')  (llufo)- 

t\<t-x  c 

+  I U*(t’)-U(t')  {2  +t|ut(t) 1 1  +  p||pjt)|| 2  ) 

<  Cj  (  fi“2+N2)"3/2't"1  ; 

then  for  all  t^tg, 

|  U(t)-u(t)  | ?  +  /5||PCt )-p( t ) (J 2+  rZZZZI  (||U(t)- 

u(t’)|  2  )  ^  C  (p  +z2  +  h2(r_1^+N?(1's^).  (7) 

Remark  If  &  =  6  > \  *  then  we  have  (7) 
nolds  for  tg=T  . 
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I  (  V(U(.t )-'}  (C)  ) ,  v  v  )  =  u  , 

l  (  V-(U(t)-U*(t)),  w  )  =  0  , 


V  w  e  L.  , 
r. ,  i< 


lu(t)-U*(t)l1+-|P(t)-P*(t)I 

Lemma  3  (  Inverse  inequality)  There  exists  a 

constant  Cq>0,  depending  only  on  the  triangula¬ 
tion  {Ch}>  such  that 

|v|2  <  (C0h"2+N2)i  vH2  ,  WeVhN  . 

In  order  to  get  the  convergence  rates  for  the 
numerical  solution  of  (5),  we  need  only  to 

■ft  # 

estimate  |U  (t)-u(t)|j  and|]P  (t)-p(t)fl  ,  where 

(U*(t),P*(t))  is  defined  in  (6).  By  a  similar 
analysis  to  that  of  [3],  we  can  establish  the 
convergence  theorem  as  bellow. 


Theorem  Let  (U,P)  and  (u,p)  be  solutions  of 
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Abstract 

New  numerical  methods  for  the  solution  of  still. partial  differential  cquu 
tion  systems  together  with  the  availability  of  fast  computers  with  high  stui 
age  capacities  now  allow  the  globally  implicit  simulation  of  mstationary 
combustion  processes  in  two  space  dimensions.  Computations  of  ignition 
processes  m  hydrogen-oxygen  mixtures  are  performed  by  solving  the  cor¬ 
responding  conservation  equations  (i.e.,  conservation  of  mass,  energy,  mo¬ 
mentum,  and  species  mass)  using  a  detailed  reaction  mechanism  (consisting 
of  37  elementary  reactions)  and  a  mul*ispecics  transport  model.  Thermal 
ignition  is  simulated  by  an  additional  source  term  in  the  energy  conserva¬ 
tion  equation.  Spatial  discretization  on  a  structured  two-dimensional  grid 
that  is  adapted  statically  in  two  spatial  directions  leads  to  large  differential- 
algebraic  equation  systems  which  arc  solved  numerically  by  an  implicit  ex¬ 
trapolation  method.  Results  arc  presented  for  the  simulation  of  a  laser- 
induced  thermal  ignition  of  a  hydrogen-oxygen  mixture  in  a  cylindrical  re¬ 
action  vessel.  Due  to  the  principal  nature  of  the  problem  considered,  appli¬ 
cation  to  many  other  problems  seems  to  be  possible,  e.g.  supersonic  flow, 
chemical  vapour  deposition,  atmospheric  chemistry  etc.. 

Mathematical  Model 


following  the  kinetic  theory  of  gases  and  using  the  Curhss-llirschfthkr  ap¬ 
proximation  [3,4].  Thus,  the  transport  coefficients  depend  non-linearly  on 
temperature  as  well  as  mixture  composition.  Tlieiiuocliuiiical-ptopcitics, 
namely  specific  enthalpies  and  heat  capacities,  both  depend  on  tcinpcralnic 
and  are  computed  from  polynomial  fils  of  data  iiom  the  .IAXA1  tables 

The  chemical  reaction  mechanism  used  foi  the  simulation  of-an  induced 
ignition  of  a  hydrogen-oxygen  mixture  eonoisea  of  37  elemental}-  reactions 
[2],  necessary  for  a  detailed  description  of  the  oomph  \  pioies&is-a  hlit,  take 
place  during  the  ignition  process 

For  the  simulation  of  laser  induced  thcurial  ignition  in  a  hydiogcn  oxygen 
mixture  (shown  below),  a  source  term  is  introduced  into  the  energy  conser 
vation  equation  The  energy  density  is  assumed  to  decrease  in  axial  direction 
and  to  have  a  Gaussian  like  shape  in  radial  direction  (sec  [6]  for  details) 

Transformation  of  the  two-dimensional  conservation  equations  into  La- 
grangian  coordinates  cannot  be  performed  as  easily  as  in  the  case  of  one¬ 
dimensional  geometries,  mainly  due  to  the  distortion  of  the  grid  point  sys¬ 
tem  [7],  Therefore  in  the  approach  of  this  work,  the  two-dimensional  insla¬ 
tionary  conservation  equations  arc  solved  in  Euknan  formulation,  taking 
into  account  spatial  and  temporal  pressure  and  density  fluctuations. 


Mathematical  simulation  of  chemically  reacting  multi-component  com¬ 
pressible  flow  is  performed  by  solving  the  corresponding  system  of  conser¬ 
vation  equations  (Navier-Stokcs  equations)  which  may  be  written  as  [1]: 

|£+div(pu)  =  0  (1) 


dph 

dl 


flljl  +  p  “  gra<*  w‘ +  <*lv  Jl 

+  grad  P  +  div  II  +  div  (p  vo  v)  =  0 
of 

OP  — 

■  —  +  div  (pv/i)  -  Cgrad  p  +  div  j.  +  11 :  grad  v  =  q 
at 


(2) 

(3) 

(4) 


with  P  =  pressure,  T  =  temperature,  n,  =  number  of  species,  uv  =  mass 
fraction  of  species  i,  Mi  =  molar  mass  of  species  i,  tv,'  =  molar  scale  rate  of 
formation  of  species  i,  h  =  specific  enthalpy^  =  density,  u  =  velocity,  j#  = 
heat  flux,  ji  =  diffusion  flux  of  species  i,  II  =  stretch  tensor,  q  =  source 
term  for  deposition  of  energy,  f  =  time. 

The  equation  system  is  simplified  by  restricting  the  problem  to  two- 
dimensional  geometries  (infinite  rectangular  column,  finite  cylinder}.  For 
cylindrical  geometries  (considered  in  the  example  below),  there  arc  two  dif¬ 
ferent  boundaries,  namely  the  axis  of  the  cylinder  and  the  vessel  surfaces. 
Along  the  axis  of  the  cylinder  symmetry  boundary  conditions  arc  used.  The 
outer  boundary  conditions  (i.e.  those  at  the  vessel  surface)  arc  simplified  by 
assuming  non-catalytic,  adiabatic  walls.  Nevertheless,  other  boundary  con¬ 
ditions  can  be  introduced  easily  in  order  to  account  for  interaction  of  surface 
processes  with  the  gas-phase  reaction,  as  was  shown  for  one-dimensional  ge¬ 
ometries  [2]. 

In  order  to  allow  a  detailed  description  of  the  underlying  chemical  and 
physical  processes,  detailed  transport  as  well  as  detailed  reaction  models 
arc  used.  Transport  coefficients  arc  computed  from  molecular  parameters, 


Solution  Method 


The  partial  differential  equation  system  describing  the  reacting  flow  con¬ 
sists  of  n,  +4  partial  differential  equations  (continuity,  momentum,  energy, 
and  species  conservation  equations).  Together  with  the  boundary  conditions 
it  forms  an  initial/boundary  value  problem  winch  can  be  solved  numerically. 
Several  properties  of  this  partial  differential  equation  system  require  special 
solution  methods.  The  main  problems  arc  orders  of  magnitude  differences 
in  the  time  and  length  scales,  and  m  particular  the  stiffness  introduced  by 
the  chemical  kinetics. 

Spatial  discretization  on  a  rectangular  mesh  using  finite  differences  leads 
to  3  system  of  coupled  ordinary  differential  and  algebraic  equations  which 
can  be  solved  numerically  by  an  semi-implicit  extrapolation  method  [8,9] 
Dus  to  the  large  differences  of  physical  length  scales  (here  particularly  vessel 
diameter,  flame  front  thickness,  and  diameter  of  the  external  energy  source) 
adaptive  gridding  has  to  be  used.  In  this  work,  the  mesh  is  adapted  statically 
in  radial  and  axial  direction,  using  a  tensor  product  grid,  i.e.  a  structured 
rectangular  mesh.  In  the  present  computations,  a  50  x.  40  mesh  is  used 
Details  of  the  adaptive  gridding  procedure  can  be  found  in  [10] 

Standard  central  difference  approximations  for  the  convective  terms  of 
the  conservation  equations  can  cause  severe  numerical  instabilities  (“over 
shoots”)  in  regions  of  high  gradients  and  curvatures  Therefore,  these  terms 
have  to  be  treated  differently  Coupling  of  the  discretization  scheme  to  the 
flow  direction  by  use  of  backward  and  forward  differencing,  depending  on 
the  direction  of  the  flow  (“upwind  differencing")  has  the  disadvantage  that 
the  accuracy  of  the  difference  approximation  is  only  of  the  order  of  the  grid 
point  distances.  This  leads  to  a  large  amount  of  numerical  diffusion  ;  -d 
thus  to  the  flattening  of  sleep  gradients  Especially  in  the  simulation  1 
reacting  flows,  Such  steep  gradients  are  present  m  the  r.  a.lmn  zones  (e  g 
flame  fronts),  and  numerical  diffusion  would  falsify  the  results  remarkably 
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The  approach  used  in  this  paper  is  based  on  the  idea  to  use  central  dif¬ 
ference  approximations  whenever  possible  and  a  modified  upwind  scheme, 
based  on  monotonicity  preserving; interpolation,  otherwise.  It  is  described 
in  detail  in  [10], 

Another  problem  arising  in  the  numerical  solution  of  the  partial  differ¬ 
ential  equation  system  is  the  resolution  of  shock  fronts.  In  order  to  mold 
severe  numerical  instabilities  resulting  if  the  shock  is  not  resolved  by  the 
mesh,  we  apply  an  artificial  viscosity  term  ("numerical  diffusion")  proposed 
by  Richtmyer  and  Morion  (sec  (7))  which  spreads  the  shocks  over  a  small 
number  (typically  3)  of  grid  points. 

The  system  of  ordinary  diffcrential/algcbraic  equations  (resulting  after 
spatial  dicretization)  is  solved  using  the  serni  implicit  extrapolation  code 
MM  EX  [8,9].  The  Jacobian  matrix-required  for  the  numerical  solution  has 
a  block-nonadiagonal  structure.  The  dimension  of  the  Jacobian  is  given  by 
»p<te»i»m  where  n i  is:  the  number  of  grids  in  the  radial,  n,„  the  number 
of  grids  in  the  axial  direction,  and  nP4t  the  number  of  partial  differential 
equations.  For  the  example  shown  below,  the  dimension  of  the  Jacobian 
is  26000.  The  computation  of  the  Jacobian  is  pcrformed  ninnerically  by 
difference  approximation.  In  order  to  evaluate  the  Jacobian  in  a  time  saving 
way,  use  is  made  of  the  block-nonadiagonal  structure  [10].  Due  to  the 
large  dimension  of  the.system,  the  solution  of  the  linear  equation  systems 
(required  by  the  time  integration  method)  has  to  be  performed  by  iterance 
methods  (see  [6,10]  for  details). 

The  simulation  of  the  hydrogen-oxygen  igniton  (see  below)  takes  about 
50  hours  on- an  IBM  3090;  the  code  contains  about  30,000  lines  written  in 
FORTRAN. 


Results 

As  an  example  for  the  simulation  of  a  chemically  reacting  flow,  the  model 
described  above  has  been  used  to  simulate  a  spatially  two-dimensional  ig¬ 
nition  processes  in  a  hydrogen-oxygen  system  with  cylindrical  geometry. 
In  order  to  simulate  induced  ignition  by  a  laser  beam,  thermal  ignition 
is  induced  along  the  axis  with  a  decreasing  energy  density  (absorption  of 
energy). 

Spatial  profiles  of  temperature  and  pressure  in  the  reaction  vessel  at  1  /is. 
i.e.  just  after  the  external  energy  source  has  been  turned  ofT,  can  be  seen  m 
Figure  1.  The  temperature  profile  directly  represents  the  spatial  distribution 
of  the  ignition  energy  density.  It  decreases  in  axial  as  well  as  in  radial 
direction.  A.similar  behaviour  shows  the  pressure,  because  the  heating 
period  is  too  short  (I  /is)  for  the  pressure  to  equilibrate  all  over  the  reaction 
volume.  Thus,  the  pressure  increase  is  approximately  proportional  to  the 
temperature  increase.  The  temporal  development  of  the  ignition  pro,  .  —  i- 
sliown  in  Figure.  I,  too.  At  the  outer  boundary  of  tin.  ignition  tolium  if,, 
pressure  gradient  causes  the  formation  of  a  shock  wave  moving  m  tin.  I.i.b.u 
direction  and  a  rarefaction  wave  moving  towards  the  cylinder  xve  Aft- 1 
She  shock  wave  has  readied  the  vessel  surface  (after  as  •!  /is),  it  i>  reflected 
and  forms  a  converging  shock.  Ignition  (rapid  temperature  ri-r)  occur- 
afler  a  short  induction  period  at  locations  where  the  amount  of  energy 
deposited  during  the  healing  period  was  high  enough.  Subsequently  the 
flame  front  formed  is  moving  in  radial  direction  towards  the  outer  boundary 
Simultaneously,  the  flame  propagates  in  the  axial  direction  (in  accord-mc 
with  experimental  results  [11]).  Two  cfTctls  cause  this  flame  propagation 
Different  induction  limes  (depending  on  the  local  temperature/  I,  a. I  to  ., 
successive  ignition  along  the  axis,  and  at  the  same  ttnv  a  "regular'll. me 
propagation  lakes  place. 


rv*)  *1  »£<*«*  • 


*1  Tl*J  *t  *«»«  » 
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Fig.  1:  Calculated  time  dependent  profiles  of  pressure  and  tempera¬ 
ture  in  an  igniting  stoichiometric  hvdrogen-oxygcn  mixture,  cylindrical 
geometry,  sec  [6]  for  details 


Conclusions 


It  is  possible  to  simulate  ignition  processes  in  hydrogen-oxygen  mixtures 
using  detailed  chemistry  and  multi-species  transport  for  two-dimen  .iottal  ge¬ 
ometries  without  simplifications  like  using  a  constant  density  approximation 
or  the  uniform  pressure  assumption.  Operator  splitting  (which  is  a  poten¬ 
tial  source  of  unreliable  results)  is  avoided  by  using  a  fully  implicit  iikiIkhI. 
The  method  can  be  applied  to  even  more  complex  reaction  systems 

Because  the  hydrogen-oxygen  system  is  an  example  for  a  chain  branching 
ignition  process,  it  allows  an  understanding  of  the  complex  interaction  ..f 
chemical  reaction  and  flow  in  systems  of  practical  importance. 

Furthermore,  the  methods  described  m  this  paper,  allow  th--  tr--.it m  m 
of  reactive  (lows  other  than  those  in  combustion  problems  (e.g.  -up-  r-,  -in. 
flows,  chemical  vapour  deposition  etc.). 
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PLANE  COUETTE  FLOW  AS  A  TEST  CASE  FOR  PHYSICO-CHEMICAL  MODEL  STUDIES 

IN  HYPERSONICS 


G.S.R.SARMA 

DLR,  Institute  for  Theoretica!  Fluid  Mechanics 
Bunsenstr.  10,  D-3400  GSttingen,  Germany 


Abstract-  III  hypcisuiiic  Runs  of  cuircni  and  future  icchnuiugicti 
interest  complex  reactive-diffusive  processes  occur  in  high-temper¬ 
ature  multicomponent  gas  mixtures.  The  Couette  flow  lends  itself 
as  a  convenient  tool  for  testing  the  admittedly  complicated  physi¬ 
co-chemical  models  needed  to  understand  and  analyse  such  proc¬ 
esses.  In  view  of  its  simple  geometry  both  the  physical  and  math¬ 
ematical  aspects  of  the  required  models  cun  be  investigated  ihiuugh 
extensive  and  inexpensive  parameter  studies.  Since  the  configura¬ 
tion  has  some  features  of  both  external  flows  (boundary  layers  on 
vehicles)  and  internal  flows  (in  ducts  and  engines)  such  model  stu¬ 
dies  yield  information  relevant  to  realistic  prototype  configurations. 
It  is  hoped  thereby  to  contribute  towards  an  understanding  of  the 
complex  interaction  of  the  various  physico-chemical  mechanisms 
involved  and  their  relative  importance  so  that  some  tractable 
models  and  simplifications  for  numerical  and  experimental  studies 
can  be  identified.  We  illustrate  our  current  approach  through  a  few 
ty  pical  results  of  such  studies  for  dissociating  nitrogen  and  oxy  gen. 

NOMENCLATURE 


Symbols  _ 

a  -  molecular  sound  speed  -  =  specific  heat  at 

constant  pressure,  h  ”  specific  enthalpy,  kf,  A,  -=  dissociation  and 
recombination  reaction  rate  constants,  -  Jk,,  -  htl  at  T„, 
p  -  pressure,  D  -=  specific  dissociation  energy.  /)„  «  binary 
diffusion  coefficient  in  atom  molecule  mixture,  K  -  thermal  con¬ 
ductivity-  M„  Jf,  =  atomic,  molecular  weight.  T  *  temperature, 
T0,  T,  -  characteristic  temperatures  fbi  dissociation  am! 
vibration,  T„  -  DSf.JS!,  fr  =  relative  speed  hr  seen  the  plates. 
3  =  universal  gas  constant,  a  -  species  concentration.  S  - 
distance  between  parallel  plates,  jj,  ~  temperature  exponent  in 
reaction  equilibrium  constant  K„  ,  -  adiabatic  exponent 
/<  =  dynamic  viscosity-  v  =  kinematic  viscosity-  k  »  thermal  dif- 
fusivity  =  type,;  p  *  density-  0  -  7',/7j;  r  -  shear  stress;  x,  « 
flow  time  scale;  r,  =  chemical  reaction  time  scale. 

Subscripts 

0,  \\~  lower  wall;  I-  upper  wall  (temperature)  and  atomic  species; 
2:  molecular  species;  ref:  reference  quantity. 

Dimensionless  parameters 

DamkChlcr  number  Dam  =  -  rjr.;  Lewis  num¬ 

ber  Lc  -  D,Jk;  Mach  number  Ma,-  V'a.;  Prandtl  number  Pr  - 
v/k;  Schmidt  number  Sc  -  r //>„  «  Pr/Lc. 

1.  INTRODUCTION 

In  view  or  the  resurgence  of  interest  in  hypersonic*  for  space 
transportation  systems  the  basic  acrolhermodynamic  problems  of 
high  temperature  gas  dynamics  arc  under  intensive  study  in  order 
to  assist  the  R  &  D  efforts  for  an  efficient  and  economic  design  of 
the  proposed  prototype  configurations.  The  challenging  new 
aspects  involved  in  the  Row  fields  in  these  configurations  are 
related  to  the  multicomponent  reactive-diffusive  gaseous  mixtures 
present  around  the  vehicles  and  in  the  propulsion  systems  [I],  [2], 
Since  the  fundamental  physico-chemical  processes  occurring  in 
these  configurations  arc  highly  complicated  and  depend  on  a  large 
number  of  uncertain  and  incomplete  sets  of  experimental  data  and 
theoretical  models  it  is  felt  worthwhile  to  investigate  the  effect*  of 
such  inputs  on  some  global  quantities  of  practical  interest  such  as 
heal  transfer  and  skin  friction  at  the  vehicle  walls,  in  this  *cn»c 
hypersonic  Couette  flow  is  under  investigation  in  p.micuiii  to 
identify  the  effects  of  transport  property  variations,  reaction  rate 
coefficients  and  boundary  conditions.  The  pioneering  work  of 
Clarke  f3J  on  Couette  flow  was  based  on  analytically  useful 
approximations  such  as  constant  Prandil  and  Lewis  number*  and 
LighthiU's  ideal  dissociating  gas  (IDG)  model  [4]  and  other 
assumptions  regarding  transport  properties.  We  present  here  some 


preliminary  resuits  based  on  these  and  mute  general  niuJels  and 
data  foi  dissociating  nitrogen  and  oxygen  from  (5J  -  [9j. 


Conftjurs'Jcn 


Boundary  Conditions  (3.  c.) 


U  - - 

- - — .  I.  B.e.  I  isotSernacsauliticmSs 

l  T(0)=To,Ttf)=Tf 

.  y  i 

K  4  A  6  B  jc.  2  Isothermal,  nonaulytic  watte 
do/dy  =  0,  ysO.S 

tT„  B.e  3  Isothermal. catalytic wati y  =  0 

_ ;  Insulated,  noncataiySe  winy  eS 

<JT/dy=do/dy=0.y=0,5 


lug.  I  Dissociating  diatomic  gas  in  Couette  flow. 


II.  PROBLUM  FORMULATION  AND  SOLUTION 


Fig.  I  illustrates  the  configuration  and  boundary  conditions  under 
consideration.  We  set  up  the  general  problem  of  a  diatomic  gas 
undergoing  a  dissociation/rccombination  reaction  in  a  Couette  (low 
without  assuming  constant  Pr  and  Lc,  as  was  done  by  Clarke  [3J. 
It  consists  of  a  system  of  coupled  nonlincat  ordinary  differential 
equations  with  associated  boundary  conditions.  The  relevant 
boundary  value  problems  yncglccling  Sorct  and  Dufour  effects 
(5);  in  dimensionless  form  arc  stated  below.  L.  A.  T_  and  other 
quantities  (c.  g.  pt,  A’,  etc.;  evaluated  at  T.  arc  used  as  reference 
values.  Mathematically,  the  problem  retains  the  essential  nonlinear 
features  arising  from  the  physico-chemical  processes  of  interest  in 
hypetsomes.  We  solve  the  boundary  value  problems  by  a  multiple 
shooting  method  m  the  general  case  using  thermophysical  data 
from  (5J  -  [SJ  and  by  Newnon-Raphson  iteration  in  the  special  case 
of  chemical  equilibrium  [3). 

Momentum: 


conHiva 


CD 


finergy: 

ffj+ymij 

dit  1 

»+«,)  dy  f 

,  0  du 

-  N  -  e»nsiani 

Spedes: 

d  f  I  J  D,i 

±i.l] 

Dam  f 

dy  [  /  |  (!+*,) 

*  fj 

r’  \ 

2Aj-,3i  * 

Cl  +  <*,)’ 


(2) 


{*i  -  f  I  -  <$f GJT‘*1  exp»  -T^m% 


We  may  note  that  kK  and  L,  arc  m  general  different  depending  on 
the  catalytic  efficiency  of  the  atom  ar.d  molecule  as  the  respective 
eoirision  partner  (u  t.  X  -  A  er.\s  in  Fig.  IT 

Typical  rise: nai  and  '.hernia.  houp.daiy  conditions  are  mdst-ateJ  in 
fig.  I.  The  m>  slip  condition  holds  in  each  cave,  sfiftj  -  f»  and 
ml)  -  I . 


The  dimensionless  groups  occurring  above  are  defined  by 


wtit J  i%„ 

?A-,  ll  ’  • 


and  d,  - 
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Gw  is  related  to  the  dimensional  equilibrium  constant 
Kc  -  CJ*1'  cxp(  -  Tnl’l) 
by  thccquation 

Km  =  (pGjaTJT*  cxp(  -  TDn). 


(4) 

(5) 


The  specific  enthalpy  of  the  diatomic  molecule  is  taken  to  be  [3], 

[4],  [8],  [9] 

<6) 

where 


W 

{ cxp(7’v/7)  —  1} 


(7) 


is  due  to  the  harmonic  oscillator  vibrational  energy  of  the  molecule 
and  '■ontributes  accordingly  to  molecular  specific  heat  cpl  and 
conouctivity  K2  [  3]  -  [  5]. 

F(T)  in  cqn.  (2)  represents  the  enthalpy  difference 

(Wd) 

{ exp(rv/7)  -  1} 

IDG  model  [3],  [4]  is  tantamount  to  assuming  /•,„(/)  =  1/2, 
i;e  =  0,:F(T)  =  1,  and  (7.  equal  to  some  average  value  via  a  preas¬ 
signed  constant  pD  [4]. 


Tv  K 

T„  K 

IDG 

Poff/C"!1 

IDG-modifi 

P:,{T„)  Si  cm1 

cation 

7;  K 

Nitrogen 

M2  =  28 

M,  =  14 

3395 

I 13261 

130 

137.4 

2698 

Oxygen 

Mj  =  32 
A/,-16 

2275 

59355 

150 

170 

1807 

Table  I.  Characteristic  reference  values  used  in  the  calculations. 
(Data  based  on  values  given  in  [4],  [9]). 

III.  RESULTS  AND  DISCUSSION 

A.  General  Model 

The  predominant  influence  for  the  cases  considered  by  Clarke  [3] 
(to  be  discussed  later)  is  that  due  to  the  variation  in  Lewis  number 
and  the  reaction  rate  coefficients.  Variation  of  l’r  in  the  temper¬ 
ature  range  considered  is  not  signficant.  On  the  other  hand  Lc  can 
vary  by  more  than  a  factor  of  two  as  a  function  of  temperature  and 
atomic  concentration.  In  general  we  do  not  assume  Pr  and  Lc  to 
be  constant.  We  solve  cqns.  (1)  -(3)  using  the  mixture  formulas 
[5]  -[7]  for  transport  coefficients  and  reaction  rate  coefficient  data 
from  Wray  ct  al.  cited  by  Vinccnti  and  Kruger  [8],  so  that  we  have 
a  standard  dissociating  diatomic  gas  in  chemical  nonequilibrium. 
Furthermore  (assuming  thermal  equilibrium)  we  include  the  vibra¬ 
tional  contribution  both  to  the  molecular  enthalpy  as  well  as  spe¬ 
cific  heat.  The  ideal  dissociating  gas  (IDG)  of  Lighthill  [4]  model 
assumes  that  half  the  vibrational  states  arc  excited  and  also  that  the 
equilibrium  constant  for  the  dissociation/rccombination  reaction  is 
such  that  a  characteristic  constant  density  p„  related  to  the  atomic 
species  concentration  a„,  at  chemical  equilibrium  can  be  defined 
by 

(I  -  «leq)l*2tf1  =  (/>//>,;)  cxp(7'„/7).  (9) 

This  />„  is  a  function  of  temperature  in  general  and  has  a  relative 
maximum  at  a  temperature  T„  <  T,  [4],  [8], 

Profiles  of  velocity,  temperature  and  atomic  concentration  and 
variation  of  the  heal  flux  IP  to  the  colder  wail  and  the  skin  friction 


S  in  the  general  ease  have  been  discussed  in  [10],  [11]  under  b.  e. 
1  (with  U  =  3,5  km/s,  p  =  I  atm,  5  =  I  cm,  7'0=  1000  K).  The 
profiles  of  T  and  a  indicate  that  temperature  and  concentration 
maxima  can  occur  in  the  interior  (and  not  necessarily  at  the  hotter 
wall).  This  is  known  to  occur  in  hypersonic  boundary  layers  [12], 
In  fact  it  is  even  present  in  Couettc  (low  at  lower  speeds  [43]  and 
is  due  to  viscous  dissipation.  The  temperature  maxima  move 
towards  the  hotter  wall  with  increasing  applied  temperature  gradi¬ 
ent  as  molecular  energy  transport  dominates  viscous  dissipation. 
The  velocity  profiles  deviate  slightly  from  linearity- essentially  due 
to  compressibility.  A  steeper  rise  in  heat  transfer  rate  is  noted  at 
temperatures  (~  2500  K  for  oxygen  and  ~  4500  K  for  nitrogen) 
where  appreciable  dissociation  begins.  This  is  due  to  the  availability 
of  more  energy  carriers,  so  to  say.  The  skin  friction  S  on  the  other 
hand  is  not  significantly  affected  by  dissociation  and  increases 
mainly  due  to  the  viscosity  increase  with  temperature  (nearly  linear 
velocity  profiles  contributing  little  to  this  increase). 


II.  Vibrational-Contribution 


In  Figs.  2,  3  we  show  the  rcsults  of  a  comparative  study  of  models 
for  the  vibrational  contribution  to  the  heat  transfer  and  shear  stress 
for  nitrogen  (Fig.  2  (a),  (b))  and  oxygen  (Fig.  3).  In  both  gases 
vibrational  modes  arc  activated  around  800  K  but  oxygen  is  fully 
dissociated  by  5000  K  when  nitrogen  starts  dissociating  appreciably 
[12].Thc  relative  differences  Dll,  DS  (=  absolute  difference/  mean 
value)  in  heat  flux  II  and  skin  friction  5  induced  by  the  choice  of 
models  and  approximations  are  illustrated  in  Figs.  2,  3.  The  refer¬ 
ence  values  arc  those  from  the  full  equations  of  §11.  The  IDG 
model  and  three  of  its  modifications  arc  considcrcdhcre.  In  all  the 
modifications  e„  =  45?/Af2  (IDG  value).  In  modifications  two  and 
three  the  equilibrium  constant  is  that  of  IDG  i.c. 


cxp( 


III 

r 


l 


each  with  a  different  (constant)  pn . 


In  the  first  modification 
A,  -  h  =  I)  (i.c.,  7)>7) 

and  K,  has  the  experimental  (dimensional)  value  [8],  viz., 
Kc=CeV'  cxp(  -  7'„/7)  . 

In  the  second  modification 

(/l,  -  h2)  =  ^ I  +  )  ,  Pl)  =  Pl)(lm ) 

i.  c.,  vibrational  contribution  is  averaged  without  neglecting  7'/7'/), 
and  in  the  third  modification 

p.i “ Pi){i'»i).<  h>-h2~^-(x 


The  interest  in  the  last  two  modifications  is  that  the  mam  assump¬ 
tion  in  IDGj  viz.,  f •„*(/)  =  1/2,  happens  to  hold  exactly  at  the 
temperature  7„  where  pB  has  its  relative  maximum  [14].  IDG  uses 
a  (smaller)  representative  value  of  pn  [3],  [4],  We  see  thatthc  IDG 
model  is  quite  good  for  oxygen  (F  ig.  3)  and  the  relative  difference 
in  1 1  actually  goes  through  zero  at  temperatures  where  the  vibra¬ 
tional  activity  in  oxygen  is  overtaken  by  dissociation.  Here  IDG 
overestimates  the  heat  transfer  up  to  ~  2800  K  and  undcrstimatcs 
it  at  higher  temperatures.  But  for  nitrogen  (which  is  vibrationnlly 
active  even  at  higher  temperatures)  the  IDG  model  is  improved  (cf. 
-DII  gets  smaller)  in  modifications  two  and  three  (lug.  2  (a)).  IDG 
consistently  underestimates  II  for  nitrogen  even  for  7000  K.  The 
deviations  among  the  different  modifications  manifest  themselves 
at  temperatures  where  appreciable  dissociation  begins  (lugs.  2 
(a),(b)).  Oxygen  also  shows  this  tendency  for  DII  (Fig.  3). 

The  difference  in  1 1  both  for  nitrogen  and  oxygen  is  a  few  percent 
in  magnitude  but  is  found  to  be  of  opposite  sign.  Macroscopically 
the  representation  of  vibrational  energy  is  subsumed  m  l  „* 
involving  the  ratio  7,/7n  (cf.  cqns.  (0)  -  (8)).  lienee  the  above  dis¬ 
tinction  between  the  two  gases  is  to  be  attributed  to  the  large  dif¬ 
ference  in  their  respective  dissociation  temperatures  (cf.  Table  I), 
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Fig.  2  Comparison  of  the  vibrational  contribution  in  IDG  and  its 
modifications  vs.  the  general  ease  under  b.  c.  1  :  Relative 
difference  in  (a)  heat  flux  II  and  (b)  skin  friction  S  for 
nitrogen 


Fig.  3  Comparison  of  the  vibrational  contribution  in  IDG  and  its 
modifications  vs.  the  general  ease  under  b.  c.  1:  Relative 
difference  in  heat  flux  II  for  for  oxygen. 

Relative  differences  in  S  arc  quantitatively  even  smaller  than  in  1 1 
since  skin  friction  is  not  significantly  affected  by  dissociation  or 
vibration  but  even  here  we  find  qualitative  differences  between  the 
two  gases.  For  oxygen  the  relative  difference  in  S  is  found  to 
steadily  decrease  with  temperature  whereas  for  nitrogen  (Fig.  2  (b)) 
the  different  modifications  show  mutual  deviations  at  temperatures 
where  dissociation  begins  but  vibrational  modes  arc  still  active. 
Modification  no.  I  slightly  improves  on  IDG  here. 

C.  Boundary  conditions 

Increase  in  heat  flux  II  under  b.  c.  2  with  0  is  similar  to  that  under 
b.  c.  1  correlating  with  the  rapid  increase  of  dissociation  for  nitro¬ 
gen  at  about  4500  K.  Skin  friction  increases  rather  slowly  as  under 
b.c.  1  [II]. 


Under  b.  c.  3  the  dimensional  values  of  the  global  quantities  II,  S, 
and  temperature  T(l)  at  the  upper  insulated,  noncatalytic  wall  and 
A  =  a,(l)/c<i(0)  were  computed  [11]  as  functions  of  the  lower  wall 
temperature  7’.  up  to  1 000  K.  Since  the  lower  wall  quantities  arc 
used  in  our  nondimcns'ionalization  the  computed  results  in  dimen¬ 
sionless  form  arc  not  easy  to  compare  in  this  ease.  Hence  the  actual 
dimensional  values  were  used.  Heat  transfer,  skin  friction  an-  7', 
arc  found  to  increase  with  T.  almost  linearly  while  the  concen¬ 
tration;  ratio  varies  very  steeply  in  view  of  the  negligible  atomic 
species  concentration  at  the  low  T.  values  [1 1]. 

D.  Transport  coefficients 

We  now  turn  to  the  special  ease  [3]  of  chemical  equilibrium  under 
b.  c.  1  to  illustrate  the  effects  of  tranport  coefficient  variation.  We 
regard  here  Pr  and  Lc  as  dimensionless  representatives  of  diffusive 
tranport.  It  may  also  be  noted  that  the  equilibrium  ease  serves  as 
a  useful  upper  bound  for  estimating  heat  transfer  and  was  also  used 


Fig.  4  Chemical  equilibrium  0,-0  flow  under  b.  c.  1.  Variation 
of  (a)  heat  flux  II  arid  skin  friction  S  and  (by  temperature 
overshoot  /„„  and  corresponding  velocity  U„,„  with  Ma „ 
and  Lc. 
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as  such  in  Space  Shuttle  comparisons T 121.  Setting  I’r  =  3/4,  y  = 
4/3,  p  --  L  atm  and  assuming  as  in  [3]  wc  compute  tlic 

velocity  and;tcmperaturc  profiles  for  given  <*,„(/)  at  equilibrium. 
Wc  observe  that  a,M(7)  in  the  (low  field  is  compatible  with  the 
catalytic  wall  in  b.  c.  1.  Clarke  showed  that  setting  constant  values 
for  Pr  and  Lc  considerably  reduces  the  nonlinearity  in  the  problem 
and  allows  integration  of  the  (modified)  cqn.  (2).  In  the  equilibrium 
case  he  used  the  IDG  model  for  iq,,  whereas  wc  test  other  models 
as  well.  Fig.  4  (a)  shows  that  the  heat  flux  in  contrast  to  the  skin 
friction  is  quite  sensitive  to  variations  of  I.c,  especially  at  lower 
Mach  numbers.  Skin  friction  shows  a  slight  dependence  on  I:c  at 
high  Mach  numbers.  Although  both  1 1  and  S  increase  with  Mu.  as 
to  be  expected  their  variation  with  Lc  is  different.  The  latter  dif¬ 
ference  with  respect  to  Lc  may  be  interpreted  as  due  to  the  role  of 
diffusion  (proportional  to  Lc).  Diffusion  of  species  increases  energy 
transport  and  also  tends  to  equalize  momentum,  i.  c.,  to  reduce 
velocity  gradients  in  the  fluid  layers.  Thus  with  increasing  Lc  skin 
friction  is  reduced.  But  this  effect  is  only  slight  and  confined  to  the 
higher  Mach  numbers. 

As  indicated  in  the  inset  of  Fig.  4  (b)  temperature  overshoots,  i.c., 
temperatures  higher  than  at  the  hotter  wall,  can  occur  in  the  flow 
field.  In  Fig.  4  (b)  wc  show  the  maximum  temperature  7mt<  and  the 
corresponding  \Jm„  as  functions  of  Ma.  and  Lc.  Variation  of  (/„„ 
shows  (since  velocity  profiles  arc  almost  linear)  that  7„„  moves 
towards  the.  middle  of  the  flow  field  at  all  Lc.  Thus  temperatures 
at  which  ionization  and  radiation  would  become  important  factors 
for  electromagnetics  and  heat  transfer  (c.  g.  7m„  ~  10000  -  K  at 
Ma.  =  18)  can  arise  in  the  flow  field.  Under  such  circumstances  the 
basic  problcmsTiavc  to  be  reformulated  appropriately.  It  is  found 
that  the  temperature  overshoots  start  to  occur  in  nitrogen  at  iower 
Ma.  than  in  oxygen  but  arc  then  overtaken  by  oxygen  at  higher 
Ma..  This  has  corresponding  implications  for  air  in  which  nitrogen 
is- the  more  abundant  component. 


differences  for  oxygen  in  II  (I  ig.  5(a))  and,  /m„  (Tig.  3(b))  as 
functions  of  Lc  and  Mu.  with  reference  to  the  equilibrium  constant 
in  terms  of  />„  used  in  the  IDG  model  [3J  and  that  of  Wray  et-al. 
cited  by  Vincent!  and  Kruger  [8J.  As  already  mentioned,  the  equ 
librium  concentration  in  the  general  case  is  given  in  terms  of  (I. 
by 


a  i  ( equilibrium )  = 


(7v7'fl,t+l)  cxp(  -  7/;/7) 

4  +  Gll,7<’!'+,)exp(-7'„/7) 


(10) 


I  he  differences  arc  a  few  percent  here  and  are  found  to  be  even 
smaller  for  S  and  L„„.  thus  the  IDG  model  is  in  this  sense  quite 
useful  especially  for  oxygen. 


IV.  CONCLUSIONS 


IDG  model  offers  a  numerically  acceptable  approximation  for 
nitrogen  and  oxygen  for  heat  transfer  and  skin  friction  but  the 
intrinsic  differences  between  the  two  gases  arc  nevertheless  quali¬ 
tatively  discernible.  Although  the  computations  tested  specific 
assumptions  and  approximations  in  particular  examples  the  results 
shown  in  the  simple  cases  considered  illustrate  the  feasibility  of 
assessing  various  physico-chemical  models  and  role  of  parameters 
with  regard  to  their  influence  on  practically  relevant  quantities  of 
interest  in  hypcrsonics.  Such  efforts  should  prove  especially  valu¬ 
able  in  optimal  use  of  experimental  and  numerical  efforts  through 
identification  of  trends  to  be  expected  and  selection  criteria  for 
useful  models.  In  view  of  the  relative  simplicity  of  the  configuration 
geometry  efficient  numerical  means  can  be  devised  to  analyse  even 
elaborate  and  complicated  physico-chemical  models. 
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ABSTRACT  -  Thin  silicon  films  on  a  cooled  substrate  are  often 
found  to  develop  highly  nonlinear  interface  morphologies  upon  ra¬ 
diative  heating.  We  develop  a  boundary  integral  representation  of 
the  thermal  field,  and  obtain  numerical  solutions  for  nonplanar  solid- 
liquid  interfaces. 

I.  INTRODUCTION 

Radiative  heating  of  silicon  is  an  important  processing  technique 
for:  silicon  wafers,  especially  for  making  silicon  on  insulators  which 
are  dielectrically  isolated  from  a  substrate,  and  also  for-annealing 
of  buried  layers  created  by  ion  implantation.  Two-phase  mixtures 
of  solid  and  liquid  silicon  have  been  observed  to  form  during  the 
laser  processing  of  thin  silicon  films  on  substrates  such  as  fused  sil¬ 
ica.  Furthermore,  it  has  been  observed  that  the  morphology  of  the 
interfaces  separating  liquid  and  solid  phases  may  either  be  planar  or 
corrugated,  depending  upon  the  values  of  the  experimental  param¬ 
eters.  The  experimental  results  for  the  two-phase  silicon  mixture 
appear  to  be  fully  consistent  with  the  fact  that  liquid  silicon  has  a 
higher  reflectivity  than  solid  silicon.  Upon  heating  the  silicon-layer 
above  its  melting  point,  supercooled  liquid  can  form  adjacent  to 
superheated  solid  silicon.  This  thermal  configuration  gives  rise  to 
a  two-phase  mixture,  and  leads  to  conditions  under  which  planar 
solid-liquid  interfaces  within  the  mixture  become  morphologically 
unstable. 

In  this  paper  we  extend  the  linear  analysis  by  Kurtzc  and  Jackson 
{Journal  of  Crystal  Growth  71  (1985)  385)  for  a  periodic  array  of 
silicon  lamellae,  and  develop  a  numerical  technique  to  treat  the  fully 
nonlinear  free  boundary  problem. 

II.  NUMERICAL  METHODS  AND  RESULTS 


Jackson  and  Kurtzc  consider  a  two  dimensional  model  for  heat 
flow  in  the  film  consisting  of  twe  dimensional  diffusion  equations 
with  source  terms  that  result  from  the  imposed  heat  fluxes  J  through 
the  plane  surfaces  of  the  film;  in  each  phase  the  source  term  is  taken 
to  be  a  constant.  The  diffusion  equations  thus  assume  the  form 


1  8Tl  _  d2?’/, 
a.L  dt  dx1  dy1 

for  the  liquid  phase,  and,  for  the  solid  phase, 


(1) 


1  dTs  _  PTs  &Ts 
as  dl  ~  Ox*  +  dy 2  +  Jsi 


(2) 


here  the  quantities  a/,  and  as  are  the  thermal  diffusivities  of  the 
liquid  and  solid,  respectively. 

At  a  crystal-melt  interface  the  Gibbs-Thomson  condition, 


Steady  solutions  to  the  nonlinear  governing  equations  may  be  ex 
pressed  in  terms  of  boundary  integrals,  which  also  provide  an  accu 
rate  and  efficient  computational  procedure.  This  effectively  reduces 
the  dimensionality  of  the  problem  Lom  two  to  one,  and  allows  the 
calculation  of  interface  shapes  that;  are  not  easily  expressed  as  a 
single-valued  function.  Implementation  of  the  boundary  integral 
technique  for  the  treatment  of  arbitrarily  shaped  interfaces  is  facili¬ 
tated  by  using  a  relative  arclength  representation  for  the  solid-liquid 
interface.  We  set  e  =  s/St,  where  s  is  the  arclength  along  the  inter¬ 
face  and  St  is  the  total  arclength  of  the  interface  over  a  full  period. 
We  then  describe  the  interface  parametrically  as  the  set  of  points 
{z(e),  y(e)}  for  0  <  e  <  I;  the  functions  y(e)  and  (z(e)  -  e)  are  both 
periodic  functions  of  e.  Given  an  interface  shape,  the  temperature 
at  a  point  z'  =  z'  +  iy'  in  the  liquid  can  be  written  in  the  form 

Tl(z')  =  \JL(y  ~  nL)>  +  jf  (5) 

where 

Gl(z,  z')  =  log  |  sin  ir(z  -  z')!  +  ^  loB  I sin  *(*  ~  z")\  (6) 

is  a  periodic  Green’s  function  with  reflection  symmetry  about  the 
line  y  =  Hi;  here  the  image  point  z"  is  given  by  z"  =  z'-f  i(27f/,-y'). 
The  normal  derivative  and  the  integration  in  Eqn.  (5)  are  performed 
with  respect  to  the  unprimed  variables,  .and  s  is  the  arclength  along 
the  interface  curve  7  over  a  single  period.  The  outward  normal  to 
the  curve  7  is  given  by  the  vector  (yc,  -xc)j St •  The  unknown  dipole 
distribution  07,  is  determined  by  the  Dirichlet  boundary  conditions 
(3)  for  Ti-  An  integral  equation  of  the  second  kind  for  07  is  ob 
tained  by  letting  z'  tend  to  a  point  on  the  boundary  7;  this  equation 
is  discretized  and  inverted  to  give  an  approximation  to  the  dipole 
distribution  07,.  Having  found  01,  we  compute  the  normal  derivative 
dTijjdn  required  in  the  conservation  of  heat  condition  at  the  inter¬ 
face,  Eqn.  (4).  A  similar  procedure  is  used  to  compute  dTs/dn.  In 
general,  for  arbitrary  interface  shapes,  the  heat  flux  equation  is  not 
satisfied,  so  iteration  of  Eqn.  (4)  using  Newton’s  method  is  applied 
to  find  the  unknown  interface  {z(e),  y(e)}.  For  each  updated  guess 
of  the  interface  shape,  the  entire  integral  equation  solution  method 
is  repeated  in  order  to  find  new  values  of  dTi/dn  and  dTs/dn. 
Provided  the  initial  guess  is  sufficiently  close,  the  procedure  quickly 
converges  to  an  interface  shape  consistent  with  all  equations  and 
boundary  conditions. 

We  choose  to  parametrize  the  interface  by  the  tangent  angle  0(e), 


tl  =  ts  =  tm-tmtk, 


(3) 


and  express  0(e)  as  a  Fourier  scries, 


gives  the  equilibrium  melting  temperature  at  a  curved  interface, 
where  T  =  7/Z,  is  a  capillary  coefficient,  7  is  the  surface  tension,  L 
is  the  latent  heat  of  fusion  per  unit  volume  of  solid  phase,  end  K 
is  the  mean  curvature  of  the  interface.  Conservation  of  heat  at  the 
interface  requires 

ki^Ti  ■  h  -  ksVTs  •  h  =  -Lvn,  (4) 

where  n  is  the  unit  normal  vector  at  the  interface  pointing  into  the 
liquid  phase,  ki  and  ks  are  thermal  conductivities,  and  is  the 
normal  velocity  of  the  interface. 


OO 

0(c)  -  (on  cos  2nrre  +  b„  sin  2wrc) .  (8) 

nsO 

Given  the  function  0(e),  the  interface  shape  (z(e),y(< :))  can  be  com¬ 
puted  from  the  0(c)  and  the  initial  values  z(0)  =  0  and  y(0)  by 
quadrature. 

For  numerical  purposes  we  retain  a  finite  set  of  Fourier  coefficients 
for  0(c)  by  truncating  the  infinite  senes  at  n  —  A/.  The  boundary 
integral  equations  arc  then  discretized  using  the  trapezoid  rule,  this 
results  in  a  numerical  approximation  with  spectral  accuracy.  The 
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heat  mnservation  boundary  condition  ^4)  is  also  discretized  to  give 
a  system  of  nonlinear  equations  in  the  unknowns  an,  bni  and  y( 0). 

We  have  used  values  appropriate  to  silicon  in  our  numerical  calcu¬ 
lations.  -Periodic  solutions  having  wavelength  A  are  computed  must 
efficiently  by  choosing  the  computational  domain  to  have  length  X,  2 
in  the  i-direction,  with  no-flux  boundary  conditions  applied  at  i  —  0 
and  x —  A/2,  vve  achieve  this  in  practise  by  imposing  this  symmetry 
on  the  Fourier  coefficients,  setting  an  —  0.  On  this  domain  one  may 
compute  solutions  which  are  periodic  with  wavelength  A,  and  also 
solutions  which  are  higher  harmonics  witii  wavenumbers  which  arc 
integer  multiples  of  ui  =  2ir/A. 


Figure  1.  A  sequence  of  interface  shapes  tracked  along 
the  A  solution  branch. 

Fig.  1  shows  a  sequence  of  interface  shapes  calculated  using  a 
continuation  method  starting  with  a  planar  shape  at  the  onset  of 
instability  of  a  perturbation  with  wavelength  equal  to  A.  We  define 
the  amplitude  A  of  an  interface  shape  to  be  the  square  root  of  the 
sum  of  the  squares  of  the  Fourier  coefficients  for  the  tangent  angle, 
so  that  the  amplitude  is  zero  for  the  planar  state.  As  the  solution 
branch  is  traced  out  to  larger  amplitudes,  nonlinear  effects  cause 
higher  order  harmonics  (in  particular  the  first  harmonic)  to  develop. 
The  fundamental  component  gives  way  to  the  appearance  of  its  first 
harmonic,  and  ultimately  disappears  entirely. 

The  computational  domain  also  allows  solutions  with  wavenum¬ 
bers  that  arc  integer  multiples  nu>  of  the  fundamental  wavenumber 
a;;  these  solutions  bifurcate  from  the  base  state  at  progressively 
higher  values  of  the  power  Jl-  The  result  of  tracking  several  such 
solution  branches  is  shown  in  Fig.  2,  which  is  a  plot  of  the  amplitude 
of  the  steady  state  intcrfacial  shapes  as  a  function  of  the  power  Jl- 
We  also  calculate  numerically  the  linear  stability  of  each  of  the  com 
puted  nonlinear  steady  states.  On  the  plot,  stable  nonlinear  inter 
face  shapes  arc  represented  by  solid  curves  while  the  dashed  curves 
represent  unstable  interface  shapes.  The  planar  state  first  loses  sta¬ 
bility  to  the  fundamental  mode  (n  -  1)  at  Jj,  —  1.7(107)  K/cm3, 
which  bifurcates  supcrcritically.  This  fundamental  solution  branch 
increases  in  amplitude  with  increasing  power  until  it  reaches  a  limit 
point  near  Jl  -  3.4(107)  K/cm3,  after  which  it  increases  in  ampli¬ 
tude  with  decreasing  power;  this  branch  loses  stability  at  the  limit 
point.  It  terminates  at  finite  amplitude  at  a  secondary  bifurcation 


point  on  the  nonlinear  solution  branch  corresponding  to  solutions 
with  period  A/2  (n  _  2).  This  A/2  family  of  solutions  bifurcates  sub 
critically  from  the  planar  solution  at  Jl  -  3.5(107)  K/cm3,  and  the 
family  is  initially  unstable  to  two  types  of  perturbations,  for  small 
amplitudes,  the  unstable  disturbances  are  approximately  sinusoidal 
with  wavenumbers  ui  and  2ui.  The  A/2  family  reaches  a  limit  point 
near  Jl  -  2.3(107)  K/cm3,  where  it  sheds  one  mode  of  instabil 
ity,  and  then  encounters  the  secondary  bifurcation  point  with  the 
fundamental  solution  branch,  where  the  remaining  mode  of  insta 
bility  is  lost,  the  A/2  family  is  then  stable  for  increasing  values  of 
the  power.  The  A/3  family  bifurcates  subcritlcally  at  Jl  =  7.0(107) 
K/cm3,  and  initially  has  three  modes  of  instability.  The  A/3  family 
also  has  a  limit  point  at  Jl  =  3.0(107)  K/cm3,  which  is  followed  by 
two  secondary  bifurcation  points,  after  which  it  continues  to  larger 
power  as  a  stable  solution  branch.  To  avoid  further  complicating 
the  figure,  only  the  primary  solution  branches  are  shown,  and  the 
solution  branches  issuing  from  these  secondary  bifurcation  points 
arc  omitted. 


Figure  2.  Bifurcation  diagram  of  interface  amplitude  A 
versus  the  power  Jl  for  solutions  branches  corresponding 
to  integer  multiples  nu  of  the  fundamental  wavenumber 
u>. 

Further  primary  solution  branches  for  the  families  with  periods 
A/4  through  A/8  arc  also  shown  in  this  figure;  their  points  of  bifur¬ 
cation  occur  off-scale.  Although  the  separation  between  these  bi¬ 
furcation  points  from  the  planar  state  arc  increasing  well-separated, 
they  arc  also  progressively  more  subcritical,  and  have  limit  points 
that  all  occur  within  the  range  shown  in  the  figure  with  amplitudes 
at  the  limit  point  in  the  range  1.5  <  A  <  2.  In  each  case  the  family 
with  period  A/n  initially  has  n  modes  of  instability,  and  the  trend  of 
shedding  instabilities  at  secondary  bifurcation  points  once  the  limit 
point  is  passed  also  seems  to  hold;  to  avoid  further  complicating 
the  figure  the  secondary  bifurcation  points  arc  not  shown  for  the 
primary  modes  with  n  >  3.  The  primary  mode  with  n  =  4,  for 
example,  regains  stability  at  Jl  =  6.9(l07)  K/cm3,  as  indicated  by 
a  dot  in  the  figure. 

We  arc  indebted  to  K.  A.  Jackson  for  suggesting  this  problem. 
This  work  was  conducted  with  the  support  of  the  Microgravity  Sci¬ 
ence  and  Applications  Division  of  NASA,  and  the  Applied  and  Com¬ 
putational  Mathematics  Program  of  DAIIPA. 
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Abstract  Wave-breaking  events  on  the  surface  of  the  ocean  entrain 
air,  which  creates  a  layer  of  bubbles  immediately  beneath  the  surface. 
The  sound  speed  in  the  layer-increases  monotonically  with  depth, 
forming  a  surface  duct  in  which  sound  may  propagate  in  the  foim  of 
normal  modes.  Since  sound  is  ciirrendy  being  used  to  study  a  number 
of  surface  processes,  including  gas  transfer  across  the  air-sea  inter¬ 
face,  the  effect  of-the  profile  on  the  observations  is  of  some  concern. 
An  analytical  theory  of  sound  propagation  in  surface-ducts  has 
recently  been  developed,  based  on  an  inverse-square  profile,  which 
provides  an  exact  solution  for  the  acoustic  field  in  terms  of  a  sum  of 
normal  modes.  On  the  basis  of  the  theory,  it  is  possible  to  obtain  the 
solution  of  certain  inverse  problems;  for  example,  once  the  parameters 
of  the  profile  have  been  prescribed,  the  source  depth  can  be  estimated 
from  the  width  ofthe  modulation  structure  that  appears  in  the  acoustic 
spectrum  at  the  receiver.  The  theory  also  provides  an  interpretation  of 
the  acoustic  signatures  of  wave-breaking  events  observed  in  the  La 
Perouseand  FASINEX  experiments. 

I.  INTRODUCTION 


Figurcl.  The  fifth  mode  at  progressively  increasing  frequencies, 
as  indicated  by  v  which  scales  with  f.  Sec  the  text 
for  funher  details. 


When  an  ocean  wave  breaks,  air  is  entrained  and  forcedbelow  the 
sea  surface,  where  it  fragments  into  a  large  number  of  micro-bubbles. 
Acoustically,  the -bubbles  have  two  important  effects,  for  a  few 
milliseconds  after  the  instant  of  closure  a  bubble  rings,  that  is  to  say, 
it  oscillates  in  the  radial  or  breathing  mode,  hence  acting  as  a  very 
effective  acoustic  source,  this  being  the  mechanism  which  is 
responsible  for  much  of  the  sound  produced  by  breaking  waves,  and 
the  presence  ofthe  large  population  of  bubbles  reduces  the  speed  of 
sound  immediately  below  the  surface  by  as  much  as  20  m/s.  The 
sound  speed  profile  down  through  the  bubble  layer  is  monotonic 
increasing,  which  gives  rise  to  upward  refraction,  thus  creating  the 
condition  necessary  for  the  formation  of  a  surface  waveguide.  The 
sounds  from  breaking  waves  are  trapped  in  this  bubbly  waveguide 
and  hence  undergo  dispersion,  which  manifests  itself  in  the  form  of 
well-defined  features  in  the  spectrum  observed  at  a  receiver  in  the  duct 
[1]. 

An  analytical  model  of  sound  propagation  in  the  ocean-surface 
bubble  layer  has  been  developed  [2],  based  on  the  so-called  inverse- 
square  profile: 


1 

c2(z) 


,  z  S  z,  , 


(1) 


where  c(z)  is  the  speed  of  sound  as  a  function  of  the  depth  coordinate, 
z,  the  parameter  d  provides  a  measure  of  the  effective  depth  ofthe 
duct, -and  c„  is  the  asymptotic  value  of  the  sound  speed  in  the  limit  of 
infinite  depth.  In  the  coordinate  scheme  of  Eq.  (1),  the  origin  of  z  lies 
above  the  sea  surface,  which  falls  at  z  =  Zj.  Below  the  surface,  the 
ocean  is  treated  as  a  semi-infinite  medium,  and  the  surface  itself  is 
assumed  to  be  a  plane,  pressure-release  boundary.  The  most  sig¬ 
nificant  features  of  the  new  theory  are  described  briefly  below,  with 
emphasis  placed  on  their  relevance  to  the  interpretation  of  wave¬ 
breaking  spectra. 


which  shows  the  fifth  mode  at  four  different  frequencies.  The  asterisk 
on  each  curve  depicts  the  extinction  depth,  whicii  becomes  shallower 
as  the  frequency  nses.  Thus,  ai  a  fixed  depth,  as  indicated  by  the 
horizontal  dotted  line  in  Fig.  1,  the  phenomenon  of  mode  drop  out 
occurs,  below  the  drop-out  frequency  the  extincuon  depth  falls  below 
the  line,  so  a  receiver  on  the  line  detects  the  mode,  but  as  the 
frequency  increases  and  the  extinctiondepth  passes  upwards  through 
the  line,  the  same  receiver  delivers  a  null  response  since  the  mode  is 
now  in  extinenon.  The  drop-out  frequency  of  the  mode  is  defined  as 
that  frequency  for  which  the  extinction  depth  is  coincident  with  the 
receiver  on  the  line.  Obviously,  the  drop-out  frequency  depends  on 
the  depth  of  the  line  and  on  the  mode  number. 


Figure  2.  Spectral  shape  of  modes  3, 8, 12  and  17  at  a  fixed  depth. 
The  vertical  lines  indicate  the  drop-out  frequencies  of  the 
respective  modes. 


II.  PROPAGATION  IN  AN  INVERSE-SQUARE  DUCT 

The  Helmholtz  equation  can  be  solved  exactly  for  the  harmonic  field 
from  a  point  source  in  an  inverse-square  channel  bounded  above  by  a 
pressure-release  surface  and  extending  below  to  infinity.  The  solution 
takes  the  form  of  a  branch  line  integral,  representing  short-range 
radiation,  and  an  infinite  sum  of  normal-modes.  Only  the  modal 
component  c  *  the  field  is  significant  in  the  present  context. 

Immediately  below  the  sea  surface  each  mode  shows  oscillatory 
behaviour,  down  as  far  as  the  extinction  depth.  The  oscillatory  region 
is  where  the  modal  energy  is  concentrated.  Below  the  extinction  depth 
the  oscillations  cease  and  the  mode  exhibits  an  exponential  decay  to 
zero.  The  oscillatory  and  evanescent  regions  arc  illustrated  in  Fig.  1, 


1  Research  supported  by  the  United  States  Office  of  Naval  Research, 
under  contract  N00014-91-J-11 18. 


Fig.2  shows  the  magnitude  of  several  modes  at  a  fixed  depth  as  a 
function  of  frequency.  In  this  example,  the  parameters  of  the  inverse 
square  profile  arc  representative  of  the  surface  bubble  layer  in  the 
FASINEX  experiment  [1].  Each  mode  occupies  a  finite  bandwidth, 
within  which  it  displays  several  well-defined  peaks.  It  is  evident  that 
on  performing  a  coherent  modal  synthesis,  to  obtain  the  power 
spectrum  of  the  field,  interference  between  the  overlapping  regions  of 
the  modes  will  occur.  Thus,  the  resultant  spectrum  will  inevitably 
'how  a  complicated  structure  of  peaks  and  troughs.  It  is  reasonable  to 
suppose  that  a  measured  spectrum  of  sound  (from  breaking  waves  or 
any  other  source)  in  a  surface  duct  should  be  similarly  complex. 

In  the  analysis  of  such  spectra,  the  mode  drop-out  frequency  would 
seem  to  be  a  useful  interpretive  tool,  and  indeed  it  is,  as  Farmer  and 
Vagle  [1)  have  demonstrated;  but,  at  best,  it  is  rather  crude.  This 
observation  is  illustrated  in  Fig.  2,  where  it  can  be  seen  that  the  drop¬ 
out  frequency,  depicted  by  the  vertical  lines,  falls  close  to  the  principal 
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maximum  in  the  odd-order  modes,  but  it,  almost  coinudent  with  the 
highest  zero  in  the  even-order  modes.  In  general,  the  drop-out  freq¬ 
uency  is  not  an  accurate  indicator  of  the  position  of  the  principal 
maximum  in  the  spectrum  of  a  mode,  diffenng  perhaps  by  10%  or  so, 
as  in  modes  8  and  12  in  Fig.. 2.  When  a  number  of  modes  are 
superposed,  this  discrepancy,  is  compounded  by  the  fact  that  each 
mode  shows  secondary  maxima  which  may  be  comparable  in 
magnitude  with  the  principal  maximum,  making  interpretation  of  the 
peaks  in  the  spectrum  doubly  difficult.  Both  problems  are  eliminated 
by  computing  the  full  theoretical  spectrum  for  comparison  with  the 
experimental  observations. 

m.  Wave-breaking  spectra 

Farmer  and  Vagle  [1]  recorded  the  sound  of  breaking  waves  at  two 
locations,  identified  as  La  Perouse  and  FASINEX,  with  a  shallow 
hydrophone  at  a  depth  of  14  m  and  24  m,  respectively.  A  surface 
bubble  layer  was  present  in  both  cases,  its  depth,  as  measured  by  the 
parameter  d  in  Eq.  (1),  being  a  factor  of  2.5  greater  in  FASINEX  than 
La  Perouse.  The  observations  were  made  over  the  frequency  band 
from  1  to  20  kHz. 

The  observed  spectra  from  the  two  locations  are  different  in 
structure,  that  from  La  Perouse  shows  half  a  dozen  well-defined, 
relatively  narrow  peaks,  whereas  the  FASINEX  spectra  show  several1 
broad  bands  of  energy  separated  by  distinguishable  gaps.  These 
features  are  believed  to  be  genuine,  rather  than  artifacts  of  the 
instrumentation,  because  they  are  repeatable  over  a  number  of  wave¬ 
breaking  events  but  with  minor  variations  due  to  the  slowly  changing 
nature  of  the  bubbly  surface  duct  (D.  M.  Farmer,  private  commun¬ 
ication,  September  1990): 

xKH 


Figure  3.  Inverse-square  spectra  (solid  lines)  for  a)  La  Perouse  and  b)  FASINEX. 
The  cross-hatching  indicates  observ  ed  spectral  peaks  in  a)  and  spectral 
bands  in  b).  The  vertical  dotted  lir-'S  in  a)  depict  the  drop-out 
frequencies  of  the  indicated  mooes. 

Fig.  3a  shows  the  spectrum  (solid  line)  of  a  wavcbrcakmg  event  at 
La  Perouse,  as  computed  from  the  inverse-square  theory  using 
channel  parameters  obtained  from  measurements  [1J  of  the  sound 
speed  profile  through  the  bubble  layer.  For  comparison,  the  cross- 


hatched.horizontal  stripes  indicate  the  spectral  maxima  observed  by 
Farmer  and  Vagle  [1].  Notice  the  isolated  spectral  maxima  and  the 
fidelity  of  the  match  between  theory  and  experiment. 

Similarly,  Fig.  3b  shows  the  inverse  square  theory  (solid  line) 
compared  with  experimental  observations  (cross  hatching)  for 
FASINEX,  the  deeper  of  the  two-surface  channels.  Again,  the 
theoretical  spectrum  contains  well  defined  maxima,  but  in  this  case 
clustered  into  groups,  or  bands,  separated  by  regions  of  little  or  no 
energy.  The  positions  of  the  bands  closely  match  the  experimental 
observations  [1],  as  indicated  by  the  cross  hatching. 

The  detailed  agreement  between  the: inverse-square  theory  and 
experiment  suggests  strongly  that  in  La  Perouse  and  FASINEX  the 
observed  spectral  structure  is  an  effect  of  propagation  through  the 
upward-refracting  surface  bubble  layer.  An  alternative  proposal  [3], 
that  the  spectral  features  are  an  effect  of  the  source  (non-linear  bubble 
oscillations),  may  be  valid  in  other- situations,  where  the  surface 
bubble  layer  is  not  well  developed,  but  in  the  La  Perouse  and 
FASINEX  data  sets  the  propagation  does  appear  to  dominate  the 
spectrum. 


IV.  SPECTRAL  PEAKS  AND  SPECTRAL  BANDS 

The  two  spectra  in  Fig.  3  show  well  defined  maxima  that  are 
obviously  related  to  the  spectral  peaks  in  the  individual  modes.  In  Fig. 
3b,  these  peaks  are  strongly  modulated,  to  form  bands  which  are 
separated  by  gaps,  where  little  energy  exists.  In  fact,  a  similar 
modulation  is  present  in  Fig.  3a,  but  so  much  slower  that  it  is  barely 
noticeable.  (The  spectral  period  of  the  modulation  is  inversely  prop 
ortional  to  d,  the  effective  depth  of  the  channel,  which  is  larger  in 
FASINEX  than  in  La  Perouse  by  a  factor  of  2.5). 

Apart  from  d,  the  modulation  also  depends  on  the  source  depth, 
z*.  If  Afo1  is  the  spectral  period  of  the  modulation  (i.e.  the  distance 
between  the  bands),  then  the  following  approximate  relationship 
holds: 


Af0'  = 


2»  '"(f)  ’ 


(2) 


It  follows  that,  once  the  parameters  of  the  profile  are  known,  it  is 
possible  to  perform  an  inverse  calculation  to  determine  the  depth,  z', 
of  the  source  from  a  measurement  of  Afo'. 

On  applying  this  argument  to  the  FASINEX  data,  a  source  depth  of 
1.5  m  is  obtained,  and  this  is  the  value  that  was  used  in  the  comp¬ 
utation  of  Figs.  3a  and  3b.  Now,  this  is  unexpectedly  deep  for 
acoustically  active  bubbles.  The  bubble  layer  is  known  to  extend 
down  to  several  metres,  but  most  of  the  constituent  bubbles  are 
mature  and  hence  quiescent.  It  is,  perhaps,  possible  that  the 
roughness  of  the  sea  surface  and  the  non-uniformity  of  the  bubble 
layer  could  be  factors  in  leading  to  an  exaggerated  estimate  of  the 
depth  of  the  bubble  sources.  Although  this  cannot  be  discounted,  the 
fact  that  such  good  agreement  between  theory  and  experiment  is 
observed  in  Fig.  3  suggests  that  the  bubbly  duct  does  act  as  a 
deterministic  waveguide with  a  planar-  pressure-release  boundary,  at 
(east  over  the  short  ranges  considered  here.  Such  behaviour  would  not 
be  expected  if  non-uniformity  in  the  channel,  for  whatever  reason, 
were  a  significant  factor. 


v.  Concluding  remarks 


The  inverse-square  theory  of  sound  propagation  through  an  upward- 
refracting  surface  channel  shows  excellent  agreement  with  obser¬ 
vations  [1]  of  wave-breaking  spectra  obtained  at  two  locations  with  a 
ncar-surface  hydrophone.  This  agreement  supports  the  conclusion  that 
the  spectral  structure  present  in  the  observed  wave-breaking 
signatures  is  introduced  as  the  signal  propagates  through  the  bubbly 
surface  duct. 
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Abstract- A  class  of  methods  for  marching  acoustic  waves  for¬ 
ward  in  range  is  presented,  based  on  a  far  field  elliptic  ap¬ 
proximation  to  the  Helmholtz  equation.  The  stability  of  the 
methods  is  analyzed  and  two  particular  schemes  are  examined 
in  more  detail.  Explicit  stability  criteria  are  obtained  for  these 
two  schemes,  amounting  to  easily  verified  restrictions  on  the  step 
sizes.  The  stability  criteria  are  affirmed  in  sample  computations. 

I.  INTRODUCTION 


successful.  In  the  next  sectio..  w  e  outline  some  marching  schemes 
for  (1),  in  section  III  we  derive  stability  criteria  for  the  schemes 
and  examine  two  particular  schemes  in  more  detail.  Some  re¬ 
sults  of  computations  testing  the  criteria  are  presented  in  section 
IV. 

II.  MARCHING  SCHEMES 


We  are  concerned  here  with  the  problem  of  determin.  ng  the 
acoustic  wave  due  to  a  source  of  given  frequency,  ui,  in  the  ocean 
waveguide.  We  suppose  the  solution  is  known  (e.g.  by  measure¬ 
ment)  out  to  some  range,  r0,  and  we  wish  to  propagate  the 
solution  forward  to  larger  ranges.  To  simplify  the  discussion 
we  consider  here:only  the  azimuth-independent  case  and  utilize 
the  range  coordinate  r  and  depth  coordinate  z.  Thus,  we  in¬ 
vestigate  the  following  problem  for  the  Helmholtz  equation  with 
variable  wave  speed  c(r,  z),  pressure  release  boundary  at  the  sur¬ 
face  z  =  0  and  hard  bottom  z  —  B. 

VJp  +  n2(r,  z)p  =  0,  r0  <  r,  0  <  z  <  B,  (la) 

p(r,°)  =  °,  |?(r,H)  =  0,  r0<r,  (lb) 

p(r,z)  given,  r  <  r0,  (lc) 

where  ic(r,  z)  =  £o/c(r,  z). 

When  backscatter  is  unimportant,  parabolic  equation  meth¬ 
ods  are  widely  used  (e.g.,  see  [5]  and  references  cited  therein) 
to  inarch  the  solution  forward  in  range.  Here  we  continue  some 
investigations  [1,  3,  4,  6]  into  marching  with  a  far  field  elliptic 
equation  that  retains  the  potential  to  include  backscatter. 

To  develop  a  far  field  elliptic  approximation  to  problem  (1), 
let  ko  denote  a  reference  wave  number  and  the  usual  Hankel 
function  satisfying 

4°(*or)  «  \IZ^;e'{hT~*h)’  V  »  (2) 

If  we  now  make  the  substitution  p  —  w{T,z)H^\k^r),  and  use 
the  far  field  property  (2),  then  ^i)  leads  to  the  problem 

xurr  -{-  2ih,wr  +  wlt  +  klfrw  =  0,  (3a) 

Hr,  0)  =  |^(r>  B)  =  0,  r0  <  r,  (3b) 

iu(r,  z)  given,  r  <  ro,  0  <  z  <  B,  (3c) 

where 

$(r,  z)  =  («(r,  z)/k o)2  -  1.  (4) 

Problem  (3)  is  ill-posed!  There  are  solutions  arbitrarily  small  at 
r  =ro  but  arbitrarily  large  at  r  =  r0  +  5  for  small  5  >  0.  Yet, 
as  seen  in  [1,  3,  4,  6],  marching  methods  for  problem  (I)  can  be 

‘This  research  supported  in  part  by  ONR  Contract  N00014- 

90- J-1031. 

tThis  research  supported  in  part  by  ONR  Contract  N00014- 

91- J-1119. 


In  this  section  we  develop  a  family  of  marching  schemes  for 
problem  (3)  by  (i)  introducing  Fade  rational  approximations  for 
an  operator  in  (3a),  (ii)  discretizing  the  resultant  approximate 
problem  and  (iii)  specifying  a  technique  for  solving  the  discrete 
problem. 

We  first  rewrite  the  far  field  elliptic  equation  (3a)  as 

(■^+ikofw~(iko)2[<l>  +  l  +  ^--^}w  =  0  (5) 

and  use  a  Pade  rational  approximation  j^©j2  for  the  operator 


where 


1  +  h  =  (y/T+Hy , 
h  =  <j>- 


(6) 


iiL 

%dz*’ 

We  apply  the  chosen  approximation  in  (5)  and  operate  with  Q 7 
to  obtain 


Q2xurr  +  2ikoQ2wr  +  t$(P2  -  Q2)w  =  0.  (7) 

We  specify  mesh  points  by  choosing  a  range  step  size  dr  and 
a  depth  step  size  dz  =  B/M,  for  a  chosen  integer  M.  Set 

=  w(r0+ndr,mdz),  m  —  0, 1,...,M+1;  n  =  — 1,0, 1,2, . .. 

and 

v>n  =  (wln,...,w*,)T,  n  =  -1,0, 1,2,... 

The  boundary  conditions  are  discretized  as  u;®  =  0  and  w*l+1  = 

Various  marching  schemes  can  be  obtained  by  making  differ¬ 
ent  choices  of  the  operators  F,  Q  and  their  discretizations  Pn,  Qn 
and  from  using  different  methods  to  solve  the  discrete  system  for 
wn+i-  For  example,  if  we  use  central  differences  to  approximate 
wr  and  wrr,  then  (7)  leads  to  a  discrete  system 

n  ^J,Wnrl  -2w„-f 

c"  m  >  (8) 

+  XkoQl(W-^2rn'1)  + 


where  Pn  and  Qn  are  M  x  M  matrices. 

We  illustrate  the  above  approach  by  specifying  two  such 
schemes. 

Scheme  I  is  the  basic  marching  method,  close  to  that  devel¬ 
oped  in  [3),  obtained  by  making  the  choices 

P\h)  =  l  +  h,  <?’(*)  =  1.  (9) 

Then  equation  (8)  becomes 
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0  = 


wn+i  -  2wn_±  wn-i 

(Ar)2 


+  2iko( 


Wntl  -  Wn-l 

2Ar 


)  +  klhnwnt  (10) 


where  is  the  My.  M  tridiagonal  matrix  having  mth  diagonal 
entry  —  (2/(£oAz)2)  and  all  entries  in  the  adjacent  diagonals 
are  a0  =  (fcoAz)-2,  except  the  entry  in  row  M  column  M  —  1  is 
2a0.  Equation  (10)  is  easily  solved  explicitly  for  wn+i  in  terms 
of  wn  and  Since  xu  is  given  for  r  <  r<>,  w_i  and  wo  are 

known  and  enable-the  marching  to  proceed. 

Scheme  II  is  obtained  using 


P(h)  =  l  +  \h,  Q{h)  =  \  +  \h,  (11) 


so  that  is  the  usual  Pade(l,l)  approximation  to  \/l  +  h. 
Then  P2  and  are  5-diagonal  matrices.  We  use  a  5-diagonal 
system  solver  in  this  case  to  solve  (8)  for  wn+1. 


RANGE  (KM) 
FIGURE  1. 


III.  STABILITY 

Each  of  the  schemes,  I  and  II,  leads  to  an  interpretation  as 

WnU  =  MnWn.  (12) 

Here  Wn  =  (wn,  w„-i)T  is  a  2JI/- vector  and  .VI „  is  a  2M  x  2 M - 
matrix  of  the  form 


,V(  —  tI 

'Mn  I  0 

(13) 

with 

1  1  —  ikqAr 

^  1+tiqAr’  1+iI^Ar 

(14) 

T„  =(2  +  *2(Ar)2)/  -  ^(Ar)2(Q2)-‘P2 

(15) 

For  stability,  we  require  that  all  eigenvalues,  A,  oi  Mn 

satisfy 

i  A  I<  1 

(16) 

The  eigenvalues  of  Mn  are  obtained  from  the  eigenvalues,  x,  of 
T„  by  the  relation 

0  =  A2  -  jjxX  +  r.  (17) 

For  schemes  l  and  II  the  x’s  are  real  and  one  derives  from 
(14),  (16)  and  (17)  the  stability  condition 

s2  <  4(1  -J-  (£»Ar)2).  (18) 

For  both  methods  l  and  II  in  the  constant  coefficient  case  the  x’s 
can  be  found  explicitly  and  the  stability  condition  (18  )  yields 
the  following  restrictions  on  the  step  sizes.  These  limits  gave 
reliable  guidelines  for  choices  of  step  sizes  in  the  test  problems. 

Scheme  I:Az  > -i,  Ar  <  Az[(^2)2  -  1)^  (19) 

Z 

Scheme  II:Az  >  Ar  <  ^-((AqAz)2  -  3]  (20) 


conservative  estimates  from  (19), (20)  give 

Scheme  I:  Az  >  22.2m  (21) 

Scheme  II:  Az  >  19.2m.  (22) 

With  Az—  25m  in  Scheme  I,  Ar  <  12.9m  is  required  by  (19). 

With  Az.=  20m  in  Scheme  II,  Ar  <  9.95m  is  required  by  (20). 

Figure  l  shows  propagation-loss  curves  for  this  problem,  based 
on  calculations  using  Scheme  I  (dashed  curve)  with  Az  =  25m, 
Ar  =  lm  and  using  Scheme  II  (solid-curve)  with  Az  =  20m, 
Ar  =  3m.  The  reference  solution  (dotted  curve)  was  obtained 
using  the  higher  order  methods  of  (5).  Note  the  improvement 
of  Scheme  II  over  Scheme  I  (at  the  cost  of  some  small  high 
frequency  oscillation).  The  Scheme  I  curve  did  not  improve  sig¬ 
nificantly  as  Az  was  decreased  below  25m.  In  fact,  the  Scheme  I 
calculation  became  unstable  for  Az  in  the  vicinity  of  the  limiting 
value  22.2m  given  in  (21). 
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Abstract  -  A  technique  for  handling  vertical  density 
variations  in  a  three-dimensional  ocean  has  been 
introduced  by  Lee-Schultz-Saad.  It  is  generally 
believed  that  the  acoustic  effect  of  density  varia¬ 
tion  in  the  vertical  direction  is  stronger  than  that 
of  a  density  variation  in  the  horizontal  direction. 
We  extended  the  above  treatment  to  handle  horizontal 
density  variations  in  a  3-dimensional  ocean  by  the 
same  numerical  technique  and  incorporated  this 
extended  technique  into  the  FOR3D  (a  3-dimensional 
wave  propagation  prediction  code) .  This  updated  code 
was  applied  to  examine  the  effect  between  vertical 
and  horizontal  density  variations  in  a  selected 
region.  Findings  will  be  reported. 


A  complete  mathematical  model  to  accommodate 
density  variations  in  all  directions  must  contain  the 
capability  of  handling  the  horizontal  density  varia¬ 
tion.  A  mathematical  model,  based  upon  Ref,  1,  is 
developed  to  handle  horizontal  density  variations 
which  has  the  expression 


u_  =  (-ik  +  ik  [1  +  |  X*  -  |<xV  +  |  Yf))u, 
r  0  0  2  8  2 

where 


p(e,z)  36  (p(e,z)  3e)- 


(A) 

(5) 


I.  INTRODUCTION 

Density,  variations  in  the  ocean  medium  influence 
the  acoustic  intensity;  thus,  techniques  must  be 
developed  to  handle  these  density  variations 
adequately.  A  number  of  techniques  are  in  existence 
for  such  treatment.  In  this  paper  we  enhance  the 
numerical  technique  developed  by  Lee  ct  al.  [1]  for 
handling  vertical  density  variations  to  handle 
density  variations  horizontally.  The  purpose  of  this 
enhancement  is  to  examine  the  effect  caused  by  both 
vertical  and-;horizontal  variations.  It  is  generally 
believed  that  the  density  variation  in  the  vertical 
direction  has  a  stronger  influence  on  acoustic 
intensity  than  the  density  variations  in  the 
horizontal  directions.  A  mathematical  model  having 
density  variations  in  all  directions  is  presented.  A 
numerical  solution  follows.  This  numerical  solution 
is  incorporated  into  an  existing  3-dimensional 
computer  code  F0R3D  [2].  This  updated  code  is  applied 
to  examine  the  overall  density  variations  in  a 
selected  region  whose  inputs  were  obtained  from 
Harvard  University  [3, A),  We  report  our  findings 
based  on  this  set  of  data  in  a  selected  region. 

Some  discussions  ace  given  at  the  end. 


II.  A  MATHEMATICAL  MODEL  AND 
ITS  NUMERICAL  SOLUTION 

A  3-dimensional  mathematical  model  [13  having 
vertical  density  variations  has  the  expression 

ur  =  <_iko  +  iko11  +  2  X+  "  8<X+)2  +  2  Y1)u’  (1) 


This  formulation  allows  Eq.(A)  to  be  solved  by 
the  same  numerical  procedure  used  to  solve  Eq.(l).  As 
a  result,  Eq.(A)  can  be  solved  in  two  steps  by  2 
tri-diagonal  systems  of  equations,  provided  both 
vertical  and  horizontal  density  variations  are 
treated  satisfactorily  on  the  interface.  Vertical  and 
horizontal  density  variations  are  accounted  for  in 
steps  1  and  2,  respectively.  Detailed  numerical 
solutions  of  Eq.(l)  as  well  as  the  numerical  density 
treatment  can  be  found  in  Ref.  1. 

III.  AN  APPLICATION 

An  environment  was  selected  from  a  Gulfcast 
generated  by  the  Harvard  Open  Ocean  Hodel  [3, A].  A  25 
Hz  source  was  placed  100  meters  in  depth  above  the 
continental  slope  at  latitude  39.5°N,  and  longitude 
72<>W.  Propagation  loss  predictions  were  computed  in  a 
3-dimensional  wedge  that  measured  10°  in  width. 
Direction  of  propagation  of  the  center  ray  emanating 
from  the  source  located  at  the  vertex  of  the  wedge 
was  180°T.  The  water  depth  in  the  wedge  is  variable 
and  ranges  from  approximately  500  meters  to  approxi¬ 
mately  3500  meters.  Density  in  the  water  and  in  the 
bottom  are  assumed  to  be  1.0  g/cm3  and  1.8  g/cm3,. 
respectively.  Four  propagation  loss  predictions 
computed  by  the  F0R3D  model  are  shown  in  Fig.  1. 

Since  F0R3D  computes  propagation  loss  in  two  steps, 
it  was  possible  to  modify  the  code  such  that  differ¬ 
ent  densities  are  accounted  for  in  steps  1  and  2.  In 
step  1,  density  variations  in  the  vertical  plane  are 
accounted  for  resulting  in  a  2-dimensional  solution. 

In  step  2,  azimuthal  density  variations  in  the 
horizontal  plane  are  accounted  for  resulting  in  a 
3-dimensional  solution.  The  following  table  summarizes 
the  various  combinations  of  density  conditions  under 
which  these  solutions  were  computed. 


Step  1 

Step  2 

where 

Water 

Bottom 

Vertical 

Horizontal 

Curve 

Density 

Density 

Density 

Density 

X+  =  n2(r,0,z) 

-1  + -§  [P<z4  fc»l. 

(2) 

X 

3 

1.0  g/cm 

3 

1.0  g/cm 

3 

1.0  g/cm 

3 

1.0  g/cm 

ko 

2 

3 

1.0  g/cm 

3 

1.8  g/cm 

1.8  g/cm3 

1.8  g/cm3 

Y  =  -i- 

2  2  2  ' 

(3) 

3 

3 

1.0  g/cm 

3 

1.8  g/cm 

3 

1.8  g/cm 

3 

1.0  g/cm 

kr  39* 
o 

A 

1.0  g/cm3 

3 

1.8  g/cm 

1.0  g/cra3 

1.8  g/cm3 
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Fig.  1:  Propagation  loss  with  vertical  and  horizontal  density  variations 


Curve  1  represents  the  solution  at  300  meters  in 
depth  when  density  is  set  to  1.0  g/cm3  everywhere; 
that  is,  there  is  no  density  variation.  For  curve  2, 
density  in  the  bottom  was  set  to  1.8  g/cm3  and 
correctly  accounted  for  in  both  steps  1  and  2.  In 
curve  3,  horizontal  density  variations  were  deliber¬ 
ately  not  accounted  for;  that  is,  no  azimuthal 
density  variation  was  detected  by  F0R3D  when  passing 
from  water  into  a  seamount.  For  curve  4,  vertical 
density  variations  were  not  accounted  for.  A  com¬ 
parison  of  curve  1  (no  density  variations)  with  curve 
2  (with  density  variations)  shows  differences  of  as 
much  as  10  dB.  Comparing  curve  3  with  4  shows  that 
the  average  level  of  propagation  loss  is  midway 
between  curves  1  and  2  and  approximately  the  same 
implying  that  neither  the  vertical  nor  the  horizontal 
treatment  of  density  dominates  in  the  solution.  How 
ever,  by  comparing  curves  1  with  4  and  2  with  3,  it 
can  be  seen  that  the  chape  of  the  curve  is  influenced 
by  the  density  variations  in  the  vertical  plane. 


IV.  CONCLUSIONS 

The  results  show  that,  in  general,  neither  the 
vertical  nor  the  horizontal  treatment  of  density 
variations  dominate  in  the  prediction  of  propagation 
loss.  Both  contribute  equally  well  to  the  solution 
and  must  be  accounted  for.  However,  the  shape  of  the 
propagation  loss  curve  is  determined  by  the  density 
variations  in  the  vertical  plane. 


ACKNOWLEDGMENT 

This  research  was  supported  jointly  by  ONR 

Research  Grant  N00014-  91-WX-24038  and  Naval 

Underwater  Systems  Center  Independent  Research 

Project  A65025. 

REFERENCES 

1.  Lee,  D.,  M.  H.  Schultz,  and  V.  Saad,  "A  three- 
dimensional  wide  angle  wave  equation  with  vertical 
density  variations,"  in  COMPUTATiONAL  ACOUSTICS: 
Ocean  Acoustic  Models  and  Supcrcomputing,  eds.  D. 
Lee,  A.  Cakmak,  and  R.  Vichnevetsky, 

North-Holland,  Amsterdam,  1990,  143-154. 

2.  Botscas,  G.,  D.  Lee,  and  D.  King,  "F0R3D:  A 
computer  model  for  solving  the  LSS  three- 
dimensional  wide  angle  wave  equation,”  Technical 
Report  7943,  Naval  Underwater  Systems  Center,  New 
London,  CT,  USA,  1987. 

3.  Robinson,  A.  R.  and  L.  J.  Walstad,  "The  Harvard 
Open  Ocean  Model:  Calibration  and  application  to 
dynamical  process,  forecasting,  and  data 
assimilation  studies,"  J.  Applied  Numerical 
Mathematics,  Vol.  3,  1987,  89-131. 

4.  Glenn,  S,  H.  and  A.  R.  Robinson,  "Nowcasting  and 
forecasting  of  oceanic  dynamic  and  acoustic 
fields,  in  COMPUTATIONAL  ACOUSTICS;  Ocean 
Acoustic  Models  and  Supcrcomputing,  eds.  D.Lee, 
A.Cakmak,  and  R. Vichnevetsky ,  North-Holland, 
Amsterdam,  1990,  117-128. 


540 


HARMONIC  ANALYSIS  IN  PHASE  SPACE-APPLICATIONS 
TO  DIRECT  AND  INVERSE  WAVE  PROPAGATION 


LOUIS  FISHMAN  AND 

Department  of  Mathematical 
and  Computer  Sciences 
Colorado  School  of  Mines 
Golden,  CO  80401  USA 


RONALD  I.  BRENT 
Department  of  Mathematics 
University  of  Lowell 
Lowell,  MA  01S54  USA 


Abstract  -  The  application  of  phase  space  and  functional  intcgal 
methods  to  scalar  and  vector,  direct  and  inverse,  wave  propagation 
problems  is  briefly  outlined, 

I.  INTRODUCTION 

This  paper  addresses  wave  propagation  in  extended,  inhomoge¬ 
neous,  multidimensional  environments  capable  of  channeling  energy 
over  many  wavelengths.  Sound  propagation  in  the  ocean  and  elec¬ 
tromagnetic  guided- wave-propagation  are  two  examples.  For  the 
most  part,  the  application  of  classical,  “macroscopic”  methods  has 
resulted  in  direct  wave  field  approximations,  derivations  of  approx 
imate  wave  equations,  and  discrete  numerical  approximations.  In 
the  last  several  decades,  however,  developments  in  Touricr  analysis, 
partial  differential  equations,  mathematical  physics,  among  others 
have  been  synthesized  into  what  is  now  called  harmonic  analysis 
in  phase  space  [FO].  This  analysis  on  the  configuration  space  Rn 
done  by  working  in  the  phase  space. Rn  x  Rn  has  produced  sharp, 
“microscopic”  tools  (pseudo  differential  and  Fourier  integral  opera 
tors,  wave  packets)  appropriate  for  attacking  wave  propagation  prob 
lems  in  extended  environments  [FO].  In  conjunction  with  the  global 
functional  integral  techniques  [SC]  pioneered  by  Wiener  (Brownian 
motion)  and  Feynman  (quantum  mechanics),  and  so  successfully 
applied  today  in  quantum  field  theory  and  statistical  physics,  the 
n-dimensional  wave  field  propagators  can  be  both  represented  ex¬ 
plicitly  and  computed  directly.  The  phase  space,  or  “microscopic,” 
methods  and  path  (functional)  integral  representations  provide  the 
appropriate  framework  to  extend  homogeneous  Fourier  methods  to 
extended  inhomogeneous  environments,  in  addition  to  suggesting  the 
basis  for  the  formulation  and  solution  of  corresponding  arbitrary- 
dimensional  nonlinear  inverse  problems  (WE]. 

II.  WAVE  EQUATION  MODELING  AND  rOKMAL 
WAVE  FIELD  SPLITTING 

For  sound  propagation  in  the  ocean,  the  initial  modeling  is 
provided  by  the  n-dimensional  scalar  Helmholtz  equation, 


4>+(z)  \ 

«nz)  j 

'  (-IkBr1  +  1)  iB, 

(  4>Hx) 

l  (lW)tB, 

(-i^Bj1  +  l)  iB,  j 

{  4>-(x) 

It  is  straightforward  to  show  that  (J y  -  (i)  imply  (4 y  and,  conversely, 
that  (2)  -  (4y  imply  (1).  Moreover,  (2)  and  (4)  are  consistent. 
Choosing  Bi  to  correspond  to  the  forward  (outgoing)  wave  radiation 
condition  and  B2  to  correspond  to  the  backward  wave  radiation 
condition  completes  the  identification. 

Sound-propagation  in  the  ocean,  certain  guided-wave  electromag¬ 
netic  propagation  problems,  and  borehole-to-borchole  seismic  mod¬ 
eling  arc  near  one-way  propagation  problems  in  extended  environ¬ 
ments.  To  zeroth-order,  these  propagation  problems  can  be  viewed 
as  transversely  inhomogeneous,  suggesting  a  wcak-backscattcr  per¬ 
turbation  approach  to  the  general  direct  and  inverse  wave  propa¬ 
gation  problems.  In  this  context,  the  transversely  inhomogeneous 
problem  is  first  solved  and  then  used  to  attack  the  more  general 
formulation  (WE].  Mathematically,  this  is  expressed  through  the  ap¬ 
proximate  diagonalization  of  the  first-order  Helmholtz  system  in  (4). 

For  a  transversely  inhomogeneous  environment,  /fi(x)  =  K7(xt),  (4) 
is  diagonal.  The  forward  evolution  (one-way)  equation, 

(«'/*)  w*. &)+ (*’(*,) + (l/wyv  (*,*) = 0 ,  (5) 

is  the  formally  exact  wave  equation  for  propagation  in  a  transversely 
inhomogeneous  half-space  supplemented  with  appropriate  outgoing 
wave  radiation  and  initial- value  conditions  (WE). 

Unlike  the  transversely  inhomogeneous  scalar  Helmholtz  equa¬ 
tion,  which  factors  in  terms  of  a  formal  square  root  operator,  the 
transversely  iiihonr  ogcncous  Maxwell's  equations  do  not  admit  such 
a  simple  decomp  isilion.  The  frequency-domain  form  of  Maxwell's 
equations  in  three  spatial  dimensions  is  taken  to  be 


(^-+Pl<2(x))^r)  =  0  ,  (1) 


where  A'(i)  is  the  refractive  index  field  and  k  is  a  reference  wave 
number.  The  environment  can  be  characterized  by  a  refractive 
index  field  with  a  compact  region  of  arbitrary  (11  dimensional) 
variability  superimposed  upon  a  transversely  inhomogeneous  ((n-1)- 
ditncnsional)  background  profile.  Splitting  the  wave  field  <2(e)  into 
two  components,  <P+(i)  and -^"(*),  via  the  transformation 

<Kz)  \  /  1  1  W  d+(£) 

)  \  iB,  iBj  j  [  £-(r) 

where  Bi  and  Bj  arc  the  two  operator  solutions  of  the  simple 
quadratic  operator  equation 

B1-  (k!k'2(r)  +  Vj)  =0  ,  (3) 

results  in  the  equivalent  formulation  (WE] 


0lK{x)  +  Q(t)  -  0;E{x)  +  g{x)  -  £(  1)  =  0  ,  (G) 

where,  under  transversely  inhomogeneous  conditions,  the  matrix 
operators  A3(£i)  and  S(£t)  are  defined  in  (BR).  For  transversely 
inhomogeneous  environments,  the  electric  field  vector  (£)  can  be 
split  into  physical  forward  (E+)  and  backward  (£")  propagating 
wave  field  components.  The  exact  diagonalization  is  given  by  [BR] 

J"-  U®' 

[&-(•))  {  0  IS,  j  (  -£-(.) 

where 

\  <%£(*)  J  [  iB,  iBj  J  £“(x)  J 

L  is  the  3x3  identity  matrix,  and  g,  and  g;  are  the  two  matrix 
operator  solutions  of  the  generalized  quadratic  operator  equation 

->£(£,)•  g-  AJ(Z,)  =  0.  (0) 
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For  a  transversely  inhomogeneous  environment,  (6)  is  equivalent  to 
(7)[BR). 

III.  PHASE  SPACE  AND  PATH  INTEGRAL  CONSTRUCTIONS 

The  formal  one-way  Helmholtz  wave  equation  (5)  can  be  recast 
and  analyzed  within  thc-phasc  space  framework  as  a  Wcyl  pseudo- 
differential  equation  in  the  form  [WE] 

(i/i:)dj;<?+(x,Tt)  +  (I-/  2-)n_1  f  dx'dp 

J[pn-7 

(&.(&+ 1[)/2)  exp  (jfc£(  (z,  -  i[))  «5+(z,r[)  =  0  ,(10) 
where  2)  >s  the  symbol  associated  with  the  square  root 
Helmholtz  operator  B  —  +  (1/PjVjj  ^ .  In  the  We,  I 

pseudo-differential  operator  calculus,  the  operator  symbol  flBt/'igr 
is  defined  through  the  -Wcyl  composition  equation 

fiB»(M)  =  a'5(2)  -£  = 

(fc/")2'1-5  [  iltflxdydxQnd  +  p,x.  +  q) 
Jr*"-*  “  “ 

■  Db (v  +  P’ A  +  ?) CXP (2,*(£ •’J-L-i))  •  (II) 
with  Ui}2(p,q)  the  symbol  associated  with  the  square  of  B,  B’  = 
(if*(2)  +  (T/>)V|)  [WE]. 

Solution  representations  for  pseudo-differential  collations  sucii 
as  (10)  can  be  directly  expressed  in  terms  of  infiiiitc-dimciisiuiini 
functional,  or  path,  integrals  [SC],  following  from  the  Markov, 
or  semigroup,  property  of  the  propagator.  The  path  integral 
representation  for  the  propagator  takes  the  form  [WE] 

•<*p 

+  WiV)//(!!jl,iJ„xJ.l,)))  (12) 

where  /l^(7^2",7,)  is  related  to  the  standard  iiseudo-difTcrenlial 
operator  symboF  [WE]. 

The  one-way  marching  algorithm  is  based  on  (1)  the  marching 
range  step  (following  from  the  path  integral),  (2)  a  sophisticated 
symbol  analysis  (reflecting  the  detailed  study  of  the  (Helmholtz) 
Wcyl  composition  equation  (11)),  and  (3)  Fourier  component,  or 
wave  number,  filtering  in  phase  space  (for  increased  efficiency, 
decreased  computational  time,  and  reduced  error).  The  detailed 
numerical  algorithm  is  discussed  in  [WE].  Sufficiently  accurate 
approximations  of  the  square  root  fDO  symbol  over  the  relevant 
region  of  phase  space  result  in  very  accurate  numerical  wave  field 
calculations  [WE]. 

The  phase  space  and  path  integral  constructions  for  the  one  way 
Helmholtz  equation  (5)  can  be  extended  to  the  one-way  Maxwell 
equation  (7).  The  explicit  phase  space  constructions  are  particularly 
important  in  this  case  since  the  propagation  operator  Is  defined 
through  a  generalized  quadratic  operator  equation  rather  than  in  a 
simple  manner  in  terms  of  formal  square  root  operators.  In  analogy 
with  (10),  the  one-way  equation  (7)  lakes  the  form  [HU] 

(«'m£+(*,&)+  m-f  Jw  d&Pt  exp  (i%  •  (£,  -  ri)) 
•%(&’(&  -I- Z»/*)  •■EWr)  =  0  •  U3) 

with  the  corresponding  composition  equation  given  by 


’  (SyU  +  P.S  +  2)  -  (>/*)£(£  +  £)) 

' Uei'l +E,^  +  q) exp (2ii(z  y- L  i)}  .  (14) 

In  (14),  Q^{p,n) is  defined  in  [BR],  p  =  (pi,p2),  q  =  (91, 9j).  and  the 
solution  Qjj(2>2)  corresponding  to  the  outgoing  (forward)  radiation 
condition  is  chosen.  The  operator  symbol  in  the  scalar  case  lias  been 
replaced  by  an  operator  symbol  matrix  in  the  vector  ease.  Analogous 
path  integral  and  inarching  algorithm  constructions  follow  [BR]. 

For  wave  propagation  problems  in  the  presence  of  two  (generally 
different)  transversely  inhomogeneous  half-spaces  separated  by  a 
planar  transition  region  of  arbitrary  length  and  inhomogcncity,  the 
one-way  phase  space  and  path  integral  methods  can  be  combined 
with  invariant  imbedding  techniques.  For  the  Helmholtz  equation, 
designating  the  left  and  right  boundaries  of  the  transition  region  at 
x  =  a  and  1  =  6,  respectively,  and  generally  locating  a  source  in  cadi 
half-space,  tiic  incident  wave  fields  arc  connected  to  the  scattered 
wave  fields  through  the  operator-valued  scattering  matrix  §(n,0), 

(&S)  - 

_  (  T+(a,fc)  R-(a,6)  \  /  *+(«,&)  \ 

“  V  R+(a,&)  T-(a,6)  )  '  ^  <T((,,2,)  )  ' 

The  scattering  matrix  is  defined  in  turns  of  the  appropriate  furwai  J 
(right-travclingy  and  backward  (left-traveling)  reflection  and  trans 
mission  operatois  associated- with  the  transition  region.  Invariant 
imbedding  [WE]  intuitively  views  the  scattering  matrix  fur  a  finite 
region  as  being  composed  of  scattering  matrices  of  a  large  nunibci 
of  contiguous  subregions,  and  thus  computes  the  effect  of  adjoining 
a  very  thin  slab  to  the  right-hand  side  of  the  transition  region.  The 
resulting  coupled  invariant  imbedding  initial-value  system  is  [WE] 


%S(n,6)  = 


(  1  R-(n,6)  \  (  l  0  \ 

V  0  T -(a,&)  )  '  ^  0  -1  ; 


VxA,uqJ  =  (l-'M*  J  dljdrt iqdt 


In  ( 10),  14.(6)  is  the  operator- valued  matrix  in  (4)  evaluated  at  x  =  L. 
The  initial  conditions  for  (10)  are  determined  by  the  appropriate  pla¬ 
nar  interface  problem  at  b  =  a.  The  invariant  imbedding  procedure 
transforms  the  Helmholtz  boundary-value  problem  of  (-1)  into  an 
initial-value  problem  through  the  complete  specification  of  the  two- 
coinpoiicnl  wave  field  column  vector  at  cither  x  =  a  or  1  =  6.  The 
formal  operators  in  (4),  (15),  and  (10)  are  explicitly  represented  as 
Wcyl  pseudo-diirercntial  operators  [WE].  Equation  (10)  provides  the 
basis  for  both  direct  and  inverse  algorithms  [WE]. 
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Abstract  The  question  of  the  utilization  of  parabolic  equations 
to  approximate  the  elastic  wave  equations  with  liquid/solid  In 
terface  is  studied.  The  main  consideration  is  the  development 
of  numerical  schemes  which  are  stable.  Crank  Nicolson  dis 
cretization  schemes  for  a  parabolic  elastic  system  of  equations 
with  interface  are  discussed.  Two  approaches  to  the  solution 
of  the  system  are  considered,  in  one  the  full  problem  is  dis 
cretized  directly,  in  the  other  the  solid  and  liquid  parts  are 
solved  successively. 


tion  of  the  system  are  considered,  m  one  the  full  problem  is 
discretized  directly,  in  the  other  the  solid  and  liquid  pans  are 
solved  successively.  The  Crank-Nicoison  discretization  method 
is  employed  in  the  case  of  all  equations  in  an  attempt  to  ensure 
stability. 

In  the  next  section  we  present  the  system  of  equations 
which  constitutes  the  parabolic  approximation  to  the  elastic 
wave  equation  with  interface.  In  section  three  we  describe  the 
Crank-Nicoison  discretization  of  the  system  and  suggest  an  ap¬ 
proach  to  breaking  it  into  two  systems  to  be  solved  successively. 


X  Introduction 

Recently,  considerable  attention  has  been  given  to  ques¬ 
tions  revolving  around  the  effects  of  the  ocean  bottom  interface 
on  propagation  in  the  water  column.  In  fact,  the  Office  of  Naval 
Research,  USA,  is  currently  supporting  fundamental  research 
in  this  area  through  an  accelerated  research  initiative  called 
Acoustics  Reverberation  Special  Research  Program.  Here,  the 
interest  is  in  scatter  from  the  ocean  bottom,  the  partitioning 
of  the  incident  acoustic  wavefield  by  the  bottom/subbottom, 
and  re-radiation  into  the  water  column. 

Parabolic  approximation  methods,  having  been  applied  ex¬ 
tensively,  and  successfully,  to  underwater  acoustics  problems 
in  the  water  column  are  beginning  to  be  utilized  in  the  case 
of  an  elastic  medium,  namely,  the  ocean  bottom,  see  e.g.  [6, 
7,  3, 1,  2j.  This  activity  usually  involves  the  approximation  of 
the  elastic  wave  equations  by  a  parabolic-type  partial  differen¬ 
tial  equation  and  the  implementation  of  interface  conditions  to 
represent  the  liquid/solid  interface  under  consideration.  In  [6], 
Shang  &  Lee  vhoose  to  focus  on  the  implementation  of  this  in¬ 
terface  in  2-D  by  working  to  connect  the  traditional  parabolic 
equation,  (PB),  which  is  applied  in  the  liquid  medium,  to  a 
parabolic  approximation  of  the  elastic  wave  equations  in  the 
elastic  medium.  The  scheme  developed  :n  [6j  is  unstable.  In 
this  paper,  we  reconsider  the  approach  in  [6],  with  the  goal  of 
creating  a  numerical  scheme  with  robust  stability  properties. 
The  essence  of  the  approach  in  [6]  involves  the  utilization  of 
a  parabolic  approximation  to  the  elastic  wave  equations  which 
Shang  &  Lee  extract  from  the  work  of  McCoy  [4],  a  clever  Tay¬ 
lor  polynomial  approximation  to  a  second  derivative  gleaned 
from  (5],  and  three  systems  of  equations  -  one  representing  the 
liquid  medium,  an  interface  system  of  three  equations  in  three 
unknowns,  and  a  system  representing  the  elastic  medium.  In 
the  development  presented  here,  two  approaches  to  the  solu- 
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2  BACKGROUND 


We  adopt  the  notation  of  [6}  and  refer  the  reader  to  [6] 
for  a  detailed  description  of  the  derivation  of  the  material  pre¬ 
sented  in  this  section.  The  parabolic  approximating  equations 
utilized  here  emanate  from  potential  equations  in  both  media. 
In  the  elastic  medium  the  potential  equations  might  be  thought 
of  as  a  series  of  “local"  potential  equations  (the  medium  is 
said  to  be  locally  isotropic)  which  have  been  joined  so  as  to 
have  nonconstant  parameter  functions.  In  the  liquid  medium 
the  parabolic  approximation  process  is  well  established  and  for 
these  purposes  yields  the  standard  (PE) 

dAi  ...  .  ,  . 

dr  dz  .  (2.D 

-  =  5- !<?!•■*> = 

where  ^  Is  a  reference  wave  number.  Tl.e  parabolic  system 
approximating  the  elastic  wave  equations  Is  given  by 

dAt  .  .  d7Aj  dB2 

—  =aiAi~02-z—  -rc3— - 
dr  dz3  dz  /2o) 

dDl  r’n  +Hd'D*  -  dA> 

where  C2  and  c£  are  coupling  coefficients  whose  definitions  along 
with  other  symbols  esc  given  by 

cj  =  (i/2ko)  i*o(r« -)  ~  £/■>!•  b  ~  */2Eo . 
ej=-(-l/2*i>)<Afc?«). 

<4  -  (imc)!%(r.z)  ~  ill,  %  ~  h2ks, 
4={-I/2Xs){A^), 

1  ,r 

*=* 
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where  =  2{kDjks)en  -  ep ,  Ak  =  ks  -  Hd  ,  and'*  denotes 
complex  conjugate.  -Now 

kD  =  WS/4)  =  PjWS/(A2  +  2/ij)  , 


and- 

%  =  <*>74  =  paw*/#*s  1 

where  A,  and  /i  are  Lame  parameters,  w  frequency,  and  addi¬ 
tionally,  e.  g.,  A  represents  an  approximation  to  A(r,  z)  with 
relative  error  ex, 

Aj  =  Aj  [1  +  ex(r,  z)] , 

over  an  interval  of  length  A r. 

Again,  the  derivation  of  the  interface  conditions  in  terms 
of  the  parabolic  potentials  is  contained  in  [6].  We  re-piesent 
them  here  for  purposes  of  completeness.  We  would  also  like 
to  call  attention  to  the  fact  that  in  their  derivation  the  usual 
PE  terms  are  dropped,  namely,  terms  of  the  form  -  ,  )() 

The  continuity  of  vertical  components  of  displacement  and  of 
stress  translate  respectively  to 


dA\  _  dA2  /2i?2  -t  r,  \  n  . 

17  =  Kd~&  +  Ks  V 17  +  lksBl) 1  (2l3a) 

-Piv’Ai  =  2/ia  (ft  +  K. 

+  (I?1  +  -  kDAi )  +  kd  . 

Finally,  the  vanishing  of  the  horizontal  components  of  stress 
on  the  interface  yields 

<2-3‘> 

where  _ 

Ac  =  kp  —  fco,  Aj  =  —  &o,  and  Ajd  =  kg  —  kp, 


3  DISCRETIZATION 

The  system  of  equations  (2.1),  (2.2),  (2.3a-c)  constitutes 
the  parabolic  elastic  potential  system  with  interface.  We  re¬ 
mark  that  each  of  the  three  equations  (2.3a-c)  is  considered  to 
hold  on  the  interface.  In  particular,  these  equations  represent 
the  “slip”  interface  condition  and  thus  -'e  shall  have  a  value 
for  each  of  the  unknown  functions  Alt  A2,  and  B2  on  the  inter¬ 
face.  We  shall  perform  a  Crank-Nicolson  discretization  of  each 
of  ‘he  equations  in  the  system.  The  resulting  discrete  system 
whici  acludes  all  of  the  unknowns  is  a  very  large  system.  One 
solution  approach  to  this  aspect  of  the  over-all  problem  is  to 
attempt  to  divide  the  problem  along  the  natural  boundary  of 
the  liquid/solid  interface. 

The  equations  (2.3a-c)  require  special  attention  since  A,  is 
defined  only  for  values  of  z  on  or  above  the  interface,  and  A2, 
B2,  only  for  values  on  or  below  it.  In  particular,  second  partial 
derivatives  require  extraordinary  measures.  Several  possibili¬ 
ties  suggest  themselves:  i)  to  replace  the  second  order  partial 
derivatives  in  z  in  (2.3b-c)  by  using  the  appropriate  approx¬ 
imating  partial  differential  equation  in  (2.2)  at  the  interface 
points,  e.  g.  in  (2.3b)  d,A:Jdz2  is  replaced  by 


i  (dA* 

b3\  dr 


—  c2* 


where  j  represents  the  interface  level,  ii)  to  approximate  these 
second  order  z-partial  derivatives  by  a  Taylor  polynomial,  e. 

(■^4,  ~~Tz  (17). + 77  -  (M-)  • 

iii)  to  use  the  value  of  the  second  derivative  at  a  lower  node. 

It  would  be  desirable  to  develoo  a  stability  analysis  and/or 
computer  implementation  of  ea  these  approaches  to  the 
“full”  system.  Our  efforts  have  u  .  concentrated  to  date  on 
dividing  the  full  system  into  two  parts  along  the  interface.  Gen¬ 
erally,  we  have  included  the  discretized  (2.3a)  in  the  liquid  sub¬ 
system,  and  discretizations  of  the  modified  (2.3b  c)  equations 
in  the  solid  subsystem.  In  attempting  to  accomplish  the  dis- 
assouation  into  subsystems  somewhat  arbitrary  decisions  are 
made,  e.g.  in  solving  the  subsystem  for  -42,  B2  at  the  (n  +  l)"1 
range  step,  certain  values  of  A,  are  required  at  the  (n  -|-  £),fc 
range  step,  thus  as  a  consequence  of  breaking  the  system  into 
two  subsystems  we  replace  these  values  by  the  corresponding 
values  at  the  nth  range  step.  Methods  i)  and  ii)  have  been 
implemented- in  the  context  just  described  and  seem  to  give 
reasonable  agreement  with  an  exact  solution  of  a  test  problem 
presented  in  [6]  over  the  first  few  hundred  iterations.  Resid¬ 
uals  eventually  become  unacceptably  large  as  the  number  of 
iteraf’ins  continue.  Methods  related  to  iii)  remain  a  subject 
for  future  research. 
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Abstract  -  The  improved  simulation  of  sonic  boom  propagation 
through  the  real  atmosphere  requires  greater  understanding  of 
how  the  transient  acoustic  pulses  popularly  termed  sonic  booms 
are  affected  by  atmospheric  turbulence.  Two  primary  turbulence 
effects  have  been  identified:  (1)  the  thickening  of  the  nominally 
abrupt  shock  at  the  beginning  of  the  pulse  waveform  and  (2)  the 
spiking  and  rounding  of  the  portion  of  the  waveform  that  imme¬ 
diately  follows  the  shock.  The  turbulence-induced  thickening  ef¬ 
fect  is  typically  larger  than  (although  occasionally  much  weaker 
than)  the  thickening  effect  caused  by  molecular  relaxation,  which 
involves  nonlinear  effects.  The  present  paper  describes  novel 
procedures  to  simulate  these  effects. 

I.  INTRODUCTION 

Sonic  boom  distortion  by  turbulence  has  been  considered 
by  many  authors  (I  -  3);  previous  work  includes  attempts  (gen¬ 
erally  regarded  as  successful)  by  Pierce  (4)  and  by  Crow  (5,  6) 

to  explain  the  random  spiking  and  rounding  of  waveforms,  al¬ 
though  a  complete  and  satisfactory  statistical  theory  has  not  yet 
been  achieved.  The  effects  of  turbulence  on  rise  times  were  con¬ 
sidered  by  Plotkin  and  George  (7),  Pierce  (8),  and  by  Ffowcs- 
Williams  and  Howe  (9).  None  of  the  latter  theories  were  re- 
garded-as  wholly  satisfactory,  however,  and  several  authors  sug¬ 
gested  tK.t  tuirbulence  played  a  minor  role  in  the  rise  time  phe- 
nofuv.i.  and  thatthe  dominant  mechanism  was  molecular  relax¬ 
ation.  Recently,  the  author  and  his  colleagues  have  discovered 
(10),  after  a  somewhat  careful  comparison  of  data  with  theoreti¬ 
cal  predictions  based  on  the  molecular  relaxation  model,  that  that 
mechanism  tends  to  underestimate  actual  rise  times  by  factors  of 
the  order  of  three.  Thus,  the  overall  question  of  how  turbulence 
affects  sonic  boom  waveforms  deserves  further  consideration. 

II.  SONIC  BOOM  WAVEFORMS 


Time  (ms) 


Fig.  1.  Sonic  boom  waveform  recorded  at  ground  during 
overflight  of  an  SR  71  at  66,000  ft  altitude  with 
speed  of  Mach  2.6. 


Time  (ms) 

Fig.  2.  Early  portion  (rise  phase)  of  the  waveform  shown 
in  Fig.  1. 


A  typical  sonic  boom  waveform,  acoustic  portion  of  pres¬ 
sure  versus  time,  is  shown  in  Fig.  1.  Note  that  the  peak  pres¬ 
sure  is  of  the  order  of  70  Pa.  and  that  the  waveform  duration 
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is  of;the  order  of  200  ms.  -The  standard  idealization  of  sucha 
waveform  is  that  of  an  N-wave,  an  abrupt  initial  shock  followed 
by  a  linear  decrease  of  pressure  through  zero,  terminated  by  a 
second  abrupt  shock.  This  particular  waveform  has  one  ofthe 
aberrations  believed  (4)  to  be  caused  by  turbulence,  in  that  there 
are  small  spike  features  near  the  leading  and  trailing  edges  of 
the  shock,  such  that  theqump  in  overpressure  at  the  shocks  is 
slightly  higher  than  that  of  the  overall  N-shape  that  fits  most 
of  the  waveform.  Other  aberrations  commonly  observed  are 
rounded  profiles  where  the  initial  shock  is  replaced  by  a  much 
smaller  jump  followed  by  a  slower  transition  of  the  duration  of 
typically  10  to  15  ms  up  to  the  nominal  N-shaped  profile. 

Figure  2  shows  the  first  6  ms  of  the  waveform  of  Figure  1. 
On  the  scale  with  which  this  portion  of  the  waveform  is  plotted, 
it  is  evident  that  the  sudden  increase  in  pressure  corresponding  to 
the  shock  is  not  abrupt  and  has  a  duration  whose  order  of  magni¬ 
tude  is  4  ms.  This  portion  of  the  waveform,  here  termed  the  rise 
phase,  is  often  characterized  by  a  single  number  called  the  rise 
time,,  typically  taken  as  that  time  for  the  pressure  to  rise  from 
10%  to  90%  of  its  peak  value. 

in.  OUTLINE  OF  THE  THEORY 

A  turbulent  atmosphere  may  be  characterized  by  a  ambi¬ 
ent  fluid  velocity  v  and  sound  speed  c  that  vary  from  point  to 
point.  Techniques  for  synthesizing  particular  realizations  (drawn 

from  an  ensemble)  of  such  fields  are  described  in  a  recent  paper 
by  Karweit  et  al.  (11).  The  suggestion  is  made  here  that  one  do 
the  synthesis  is  two  stages.  In  the  first  stage,  one  leaves  out  all 
higher  order  wavenumber  vector  components  beyond  some  cut¬ 
off  wavenumber  ku,  to  the  extent  one  is  certain  that  geometrical 
acoustics  will  be  very  nearly  wholly  applicable  for  the  propaga¬ 
tion  ofthe  sonic  boom  from  the  aircraft  trajectory  to  the  consid¬ 
ered  observation  point.  The  resulting  medium  is  here  called  the 
background  medium. 


Here  the  amplitude  function  continually  adjusts  to  preserve 
the  Blokhintzev  invariant,  in  accord  with  the  equation 


d  f  2?2(.s)|v  -1-  crt|(c  +  v  •  n)5A  j  =  Q 
ds  \  pc3  j 

where&A  is  ray  tube  area.  The  quantity  g  satisfies  the  coupled 
equations 


The  quantity 


dgv  _  dg 
9v  +  Tv~dt  ~  v  df 


[■ 

Jo  Pc{c  +  v  •  n) 


is  the  age  variable  for  the  ray. 


(4) 

(5) 


Lets  £  and  g  be  two  arbitrarily  curvilinear  coordinates  such 
that  in  the  vicinity  of  the  central  ray,  the  coordinates  xi,  rj,  and 
s,  define  an  othogonal  curvilinear  coordinate  system  with  met¬ 
ric  tensor  equal  to  unity  along  the  central  ray.  To  discover  the 
diffraction  correction  to  Eq.  (3),  one  notes  that  for  a  homoge¬ 
neous  medium,  in  the  absence  of  dissipation,  relaxation,  and  non¬ 
linear  effects,  and  with  an  ambient  fluid  velocity  in  only  the  -f  s- 
direction,  the  quantity  ^-satisfies  the  wave  equation 

For  a  pulse  propagating  nearly  in  the  f  s  direction,  this  would 
simplify  to 


Consequently,  the  appropriate  modification  of  Eq.  (3)  becomes 


dg  (df\~ldg  ,  2  f  d2  d2  \  [’  , 
diHefc)  ds  + c\d?  + dg2]  Jo  °  3 

dA  drC  2dg  ,d2g  y-y  dgv  _ , 

+  9Ts-6d^  +  ^Ac^-d7-° 


Given  such  a  background  medium,  one  identifies  a  central 
ray  that  propagates  according  to  the  ray  tracing  equations  de¬ 
scribed  in  the  author’s  book  (12)  and  in  a  recent  paper  (.13),  and 
one  describes  distance  along  such  a  ray  by  a  parameter  s,  and 
nominal  time  of  arrival  (ignoring  nonlinear  effects)  of  the  lead¬ 
ing  shock  by  r(s).  The  theory  originally  due  to  Hayes  (14),  and 
described  in  the  author’s  text  (12),  applies  for  nonlinear  propaga¬ 
tion  in  the  background  medium  along  the  central  ray.  When  such 
a  theory  is  modified  to  take  molecular  relaxation  into  account, 
one  has  (10): 

P  =  t )  (1) 


where  f  (f ,  g,  s )  is  travel  time  [with  the  total  turbulence  with 
higher  wavenumbers  taken  into  account)  along  paths  defined  by 
the  background  medium.  Readers  may  discern  some  similarities 
in  this  result  with  the  parabolic  equation,  especially  the  formula¬ 
tion  of  Kriegsmann  and  Larsen  (15),  and  with  the  nonlinear  PE 
formulation  of  McDonald  and  Kuperman  (16). 
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Abstract-The  computational  formula  of  the 
adiabatic  modal  travel  time  perturbation  has 
been  derived.  The  linear  constiuent  and  the 
nonlinear  constituent  are  decomposed.  Numeri¬ 
cal  results  demonstrate  that  significant  non¬ 
linearity  of  modal  travel  time  perturbation 
can  be  caused  by  strong  oceanic  mesoscale 
eddies . 


1 .  THE  EXACT  FORMULA 

The  exact  modal  travel  time  perturbation  is 


where  U„  and  U„  are  modal  group  velocities 
corresponding  to  the  unperturbed  sound  speed 
profile  (SSP)  c<,(z)  and  the  perturbed  SSP 
c(z),  respectively.  In  Ref.[1],  a  rigorous 
formulation  for  calculating  the  modal  group 
velocity  has  been  given: 

co 

—  =  r  ( V1  ~  di-  (i) 

Um  CmJ  C* 

o 

where  c„  is  the  modal  phase  velocity  and  fa  is 
the  normalized  eigenfunction.  Substituting  eg. 
(2)  into  eq.(1),  we  get  the  exact  modal  travel 
time  perturbation  as  follows: 


2.  THE  PERTURBATION  FORMULA 

The  modal  travel  time  perturbation  can 
also  be  expressed  by  differential  formula¬ 
tion  according  to  the  definition  of  modal 
group  velocity: 

TT  ~  (75  U) 


Then,  the  modal  travel  time  perturbation  is 
given  by 


The  integrand  of  eg. (5)  can  be  obtained 
from  the  eigen-value  problem.  The  differential 
equation  holding  for  unperturbed  mode  is: 


and  the  differential  eguation  holding  for  per¬ 
turbed  mode  is: 

<V 

Multiplying  eq..[£]  by  fa,  and  eq.[?]  by  fa, 
and  subtracting  the  products  gives: 

(il  -iC)\  **  = 

» 

0 

We  take  the  following  approximations: 

*  V*  (  —rr)  a  > 

0°) 


Then,  we  get 


(■fa  ~  fa~)  = 


>; jf 

r  &  ** 


Substituting  eg .  (//)  into  eg.  (  5"),  the  modal 
travel  time  perturbation  is  expressed  in  a 
"differential"  form: 

*  l  *~f*3j*  'J 
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3.  THE  NONLINEARITY  ANALYSIS 


As  we  can  see,  that  the  nonlinearity  is 
mainly  caused  by  the  deformation  of  eigen¬ 
function  in  terms  of  y£,  •  writting 


Then,  the  linear  and  nonlinear  constituent 
are  decomposed  as  follows: 


=  st?  +  5tcr  ™ 

where  is  the  linear  constituent: 

sC fa  ar> 

0 

and  lig>  is  the  nonlinear  constituent: 

*  ( j* 


DR?1 00  Km,  DZ=500  m,  2E=1000  m,  DC=-6  (cold), 
and  DC=+15  (warm)  respectively.  Modal  travel 
time  perturbations  are  calculated  for  acoustic 
frequency  f=10  Hz  and  mode  number  m=1,2,3.  The 
results  for  weak  cold  eddy  are  listed  on  Tab.1 
and  the  results  for  strong  warm  eddy  are 
listed  on  Tab. 2. 


Tab.l  Modal  travel  time  perturbation  for  a 
weak  cold  eddy. 

>»  I  Ct-  s>'Lx  a-W(^.s+..  e=  A/ft-  (%) 


St-  ft,  _-*£>  a-.ZC'-qL 

eg.  (3)  (12)  ( 1 5 )  CmS) 

450.1  448.8  440.5  -9.6 

369.4  369.1  341.6  -27.8 

257.5  257.5  245.3  -12.2 


Tab. 2  Modal  travel  time  perturbation  for  a 


strong  warm  eddy. 

?tCT  STtw  st«Jr>  asftff-a, 

eg. (3)  (12)  (15)  o*s) 

-806.3  -810.3  -1101.1  -294.7 
-804.8  -811 .0  -  853.9  -  49.1 
-581 .7  -586.0  -  613.2  -  31 .5 


E=^/£t*(%) 


Obviously,  the  nonlinear  term  vanishes 

whan  the  deformation  of  eigenfunction  £</•„,  is 
not  significant.  However,  there  are  some 
cases  that  the  nonlinearity  is  significant 
and  for  these  cases  the  conventional  linear 
inversion  scheme  will  not  be  appropriate. 
Numerical  examples  are  presented  in  the 
following  section. 


4.  NUMERICAL  EXAMPLES 


The  ocean  model  for  numerical  computation 
consists  of  a  canonical  Munk  profile  [i]  as 
background  and  a  Gaussian  eddy  perturbation 
as  follows: 

c0«i  =  /yoc»{/  +  u-\y\}  cm 

Atcr*)  =(pc)  •  [$$}'-  [~^Y  }  <■'*) 

where  ^  =  2( z-1 000) /l 000.  The  parameters  of 
a  weak  cold  eddy  and  a  strong  warm  eddy  are: 


CONCLUSIONS 

( 1 )  . As  we  can  see  from  Tab.l  and  Tab. 2  that 

the  modal  travel  time  perturbation  cal¬ 
culated  by  differential  formula  eg. (12) 
rs  very  close  to  the  result  ginen  by  the 
exact  formula  eq.(3). 

(2) . The  nonlinearity  of  modal  travel  time 

perturbation  caused  by  a  weak  cold  eddy 
(DC=-6  m/s),  as  illustrated  in  Tab.l, 
is  not  significant.  However,  for  a  warm 
strong  eddy  (DC=+15  m/s),  as  illustrated 
in  Tab. 2,  is  significant. 
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Abstract 

A  new  approach  to  ocean  acoustic  tomography  uses  matched  field 
processing  for  narrow  band,  low  frequency  sources  distributed  around 
the  region  perimeter  and  detected  on  widely  distributed  vertical  ar¬ 
rays.  A  key-component’  to  the  success  of  this  new  approach-is  an 
algorithm  to  compute  “the  global  maximum”  of  the  processor  out¬ 
puts  over  the  very  large  set  of  candidate  environments  In  this  paper 
we  discuss  algorithms  based  on  the  “back  propagation”  algorithms 
used  in  medical  tomography  but  modified  to  allow  for  non-uniform 
values  along  each  source-receiver  path  and  weighted  according  to  the 
length  of  the  path  segment  of  interest.  Computational  results- to 
date  show  that  the  algorithms  can  result  in  extremely  accurate  and 
efficient  tomographic  solutions. 

X.  INTRODUCTION 

Ocean  acoustic  tomography  is  a  technique  involving  the  transmission  of 
acoustic  fields  through  an  ocean  region  and  subsequently  inferring  the  3-D 
sound-speed  profiles  of  the  region  by  examining  those  fields.  Over  the  last 
decade  ocean  tomography  experiments  have  shown  that  examination  of  the 
acoustic  multipath  arrivals  interpreted  in  terms  of  ray  theoretic  models  can 
be  highly  effective  (Munk  and  Wunsch,  '79;  Behringer  ct  a!.,  '82;  Cornuelle 
et  air,  ’89).  However,  such  an  approach  requires  “high"  frequency  signals 
(above  100  Hz),  and  so  results  will  be  degraded  by  such  factors  as  uncer¬ 
tainties  in  the  sourcc/receiver  locations,  internal  waves  and  tides,  rough 
surface  scattering,  etc.  The  measurement  process  itself  can  be  extremely 
time-consuming  requiring  weeks  at  sea  to  navigate  the  perimeter  and  send 
signals  through  the  region.  In  addition,  the  use  of  high  frequencies  which 
attenuate  rapidly  as  a  function  of  range  limits  the  size  of  the  regions  which 
can  be  sampled.  More  generally,  working  with  data  in  the  time  domain 
requires  high  time  resolution  receivers  to  distinguish  arrivals  and  to  detect 
changes  in  those  arrivals  which  result  from  sound-speed  variability.  Our 
new  technique  examines  interference  patterns  across  vertical  arrays  of  hy¬ 
drophones  for  single  frequency  (not  lime  domain)  low  frequency  data  (10 
-  30  Hz)  modeled  by  highly  accurate  normal  mode  methods.  The  sour-  s 
will  be  explosive  shots  dropped  from  an  airplane  flying  around  the  perime 
ter,  and  so  experimental  time  will  decrease  froni'wceks  to  days.  The  new 
technique  will  effectively  transfer  the  burden  from  intense  oceanographic 
surveys  to  intense  computer  demands. 

II.  APPROACH 

The  essence  of  the  new  approach  is  to  find  the  family  of  sound-speed 
profiles  which  maximizes  the  matched  field  processing  (MFP)  power1  com 
puled  for  each  vertical  array  receiving  signals  from  the  known  shot  sources 
That  is,  signals  received  at  the  arrays  arc  cross-correlated  with  modeled  sig¬ 
nals  which  have  propagated  through  candidate  environments,  and  we  seek 
to  maximize  those  correlations.  If  the  problem  is  properly  posed,  i.c.,  if 
we  impose  sufficient  constraints,  then  the  maximum  MFP  power  will  occur 
on’y  for  the  true  environment. 

The  first  stage  of  the  process  is  to  characterize  the  environment  in  as 
few.  parameters  as  possible.  Oceanographers  have  developed  a  method  for 
deriving  efficient  basis  functions,  known  as  empirical  orthogonal  functions 
(EOFs),  from  measured  data  (Davis,  ’76)  Consequently,  an  occaii  region 
might  be  very  accurately  described  in  terms  of  only  2  or  3  EOFs.  The 
simulated  “double  eddy”  environment  and  their  associated  (modified)  EOFs 
used  for  the  results  in  this  paper  are  described  in  detail  in  Tolstoy  et  ah, 
’91. 

The  next  stage  is  to  grid  the  ocean  region  into  cells  where  each  cell 
corresponds  to  one  sound-speed  profile,  i.c.,  2  or  3  EOF  coefficients.  We 
also  need  to  consider  the  geometry  of  our  problem:  how  many  vertical  arrays 
will  we  use  and  where  will  we  deploy  them;  how  many  sources  will  we  use 
and  where  will  we  drop  them?  For  the  results  to  be  discussed  here  we  will 
use  four  vertical  arrays  and  36  sources  distributed  as  shown  in  Fig.  I.  Each 
array  will  have  28  phones  spaced  at  37.5  in  for  processing  20  Hz  signals. 


’See  Oueker  (1076)  and  Fiz-lt  (11871  for  detail*  alio  il  MFP 


The  first  phone  will  be  just  below  the  surface  of  the  water  and  thus  span 
-the  upper  1000  m  of  water  where  all  the  sound  speed  variability  is  found 
We  assume  that  the  sound-speed  profiles  at  the  source  and  array  cells  have 
been  measured. and  their  EOF  coefficients  arc  known.  The  complete  values 
of  the  dominant  EOF  coefficient  aic  shown  in-Fig.  2. 

Finally,  we  need  an  algorithm  to  perform  the  inversion,  ne,,  to  compute 
the  unknown  EOF  coefficients  which  maximize  the  MFP  power  at  the  arrays 
for  alt  the  source  signals. 

III.  THE  ALGORITHM 

First,  we  shall  initialize  our  algorithm  with  a  simple  test  environment. 
In  patticular,  we  will  assume  that  we  know  the  range  of  possible  values  for 
the  EOF  coefficients  throughout  our  region  and  then  use  their  mid-range 
values  as  a  first  estimate  for  all  the  unknown  values  (see  Fig  3)  We  know 
that  this  estimate  is  not  very  good  because  the  MFP  power- computed  at 
each  array  for  each  source  is  very  low.  In  Fig.  4  we  sec  a  plot  of  the  MFP 
-power  P„  for  each  receiver-source  path  for  r  -  1.  The  maxima  should  be 
about  28  (the  number  of  phones). 

Let  /3i(ij),/3i(ij)  denote  the  true  EOF  coefficients  for  the  iytli  cell 
Consider  the  f j 111  cell,  and  iterate  through  all  possible  values  of  the  EOF 
coefficient  ft.  Let  denote  the  maximum  power  found  for  the  path 

from  source  s  to  array  r  intersecting  the  tjth  cell  (all  other  coefficients  along 
the  path  are  fixed),  i.c., 

KM  =  maxPr>. 

i>  i 

Let  ft‘.„(ij)  be  the  corresponding  coefficient,  and  be  the  length  of 

the  path  through  the  cell.  Then,  define  the  new  coefficient  estimate  by 

Next,  consider  ft  and  repeat  the  procedure.  Then,  proceed  to  the  next 
cell.  When  all  cells  have  been  processed  (one  sweep),  repeat  from  the  first 
cell  (note  that  all  the  cells  may  have  changed  their  coefficients  and  so  path 
contributions  from  the  non  ryth  cell  will  have  changed).  For- the  results 
presented  here,  the  process  was  stopped  when  the  total  power  F’ioi.iI  = 

Pn  was  no  longer  increasing. 

For  the  example  discussed,  we  obtained  excellent  results  for  31  sweeps 
with  a  maximum  sound-speed  error  everywhere  of  less  than  0.2  m/sec. 
However,  there  were  other,  array  configurations  for  winch  the  algorithm 
stalled,  i.e.,  stopped  before  giving  good  results.  So,  we  also  considered 
variations  of  the  algorithm  by  selecting  the  ft(iy)  which  simply  maximized- 
Y,,  Y,,  'fPr’^rn  or  Yr,  PrA\,-  In  general,  we  found  that  these 

variations  sometimes  unproved  results  over  the  original  but  sometimes  did 
not,  and  were  also  prone  to  stalling. 

CONCLUSIONS 

We  conclude  that  efficient  characterization  of  the  environment,  i.e., 
through  the  use  of  (modified)  -empirical  orthogonal  functions,  plus  care¬ 
ful  sourcc/array  geometry,  can  result  in  highly  accurate  estimates  of  the 
3-D  sound-speed  environment.  In  particular,  we  saw  that  4  vertical  arrays 
spanning  the  upper  1000  ill  of  water  and  placed  ill  the  interior  of  the  region 
of  interest  with  shots  distributed  every  25  km  along  the  perimeter  resulted 
in  maximum  errors  less  than  0.2  m/sec  for  our  250  km  per  side  square  re- 
z’on  and  foi  the  frequency  20  Hz.  However,  the  algorithm  and  variations 
on  it  developed  for  the  inversion  can  stall.  We  arc  presently  working  to  find 
a  remedy  for  this  difficulty. 
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3.  Initial  estimates  for  EOF  coefficient  /?»(!/)  «  a  function  oi ’range :  and 
cross-range.  The  coefficients  around  the  perimeter  (where  the  sources 
are  located)  and  at  the  arrays  are  known;  otherwise,  /J,  =  constant. 


ARRAY  NO.  1 


2.  Plot  of  the  dominant  EOF  coefficient  A(y)  as  a  function  of  range  and 
cross-range.  The  scale  has  been  normalised  so  thatnegalive  values 
range  from  -1  to  0,  positive  values  from  0  to  +1. 


5,  Final  estimates  for  EOF  coefficient  «  »  funelien  of  range  and 

cross-range.  Compare  to  Fig.  2. 
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Abstract  -  Seismic  forward  modelling  is  one  of 
the  foremost  tools  for  investigating  wave 
propagation  in  complex  geological  structures. 
Moreover,  due  to  the  complexity,  both 
lithological  and  stratigraphical ,  that  can  be 
found  in  such  structures,  the  use  of  a 
numerical  method  with  great  accuracy  and 
flexibility  is  needed  for  correct  results.  In 
this  respect,  the  Spectral  Element  Method 
(SPEM)  which  combines  the  accuracy  of  spectral 
techniques  and  the  flexibility  of  finite 
element  methods  is  well  suited.  The  method  has 
been  applied  to  solve  the  acoustic  wave 
equation.  Accuracy  and  convergence  proper  Lies 
of  Chebyshev  SPEM  are  discussed  in  the  present 
work. 


I.  INTRODUCTION 

The  most  widespread  of  the  discrete  numerical 
methods  for  modelling  seismic  wave  propagation 
are  the  finite  difference  (FDM)  [*.l],[6j,  the 
Fourier  or  pseudo  spectral  (FSM)  L''* J » C'f J » » 
and  the  finite  element  (FEM)  methods  [9], [10]. 
Even  though  based  on  different  mathematical 
approaches,  all  three  methods  rely  on  the  space 
discretization  of  the  geological  structure  to 
be  modelled.  In  particular,  the  pseudo 
spectral  method  can  be  seen  as  a  limiting  cose 
of  tlie  finite  difference  methods  of  increasing 
order  and  accuracy  [3j.  The  main  advantage  of 
the  FSM  is  its  great  accuracy,  allowing  for  a 
lower  number  of  grid  points  per  minimum 
wavelength  propagating  in  the  model;  a  saving 
up  to  several  orders  of  magnitude  in  computer 
memory  and  time  can  be  realized.  On  the  other 
hand,  the  FEM  is  well  known  for  its  flexibility 
in  describing  problems  with  complex  geometries; 
irregular  surfaces  between  different  media  can 
be  defined  with  great  accuracy.  A  method  which 
combines  FSM  accuracy  with  FEM  flexibility  is 
dcsidorable  for  seismic  wave  modelling.  A 

high-order  finite  element  spectral  method 
[12], [13],  seems  a  good  candidate  for  this. 

In  the  present  work,  we  shortly  present  the 
Chebyshev  spectral  clement  method  and  then  we 
discuss  the  implementation  and  the  numerical 
results  obtained  for  the  one  dimensional 
acoustic  wave  equation.  The  accuracy  and 
convergence  properties  of  SPEM  are  investigated 
by  comparison  with  standard  finite  element 
method  and  with  an  analytical  solution. 
Estimations  ore  carried  out  by  computing  a 
frequency  error  index  function,  that  relates 
numerical  and  analytical  results  in  the 
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frequency  domain,  for  interpolanls  of 
increasing  order. 


I  I .  CHEBYSHEV  SPECTRAL  ELEMENT  METHOD 

The  Fourier  spectral  technique  is  a  particular 
case  of  the  more  general  spectral  methods  (SPM) 
[5],  and  both  spectral  and  finite  element 

methods  can  be  seen  as  particular  cases  of  the 
class  of  discrete  numerical  techniques  for 

solving  differential  equations  known  as  the 
method  of  weighted  residuals  (MHR ) .  Hi  III  the 
MHR,  the  solution  is  obtained  by  minimizing  the 
residual  i.e.,  the  error  in  the  differential 
equation  produced  by  using  a  truncated 
expansion  instead  of  the  exact  solution,  with 
respect  to  a  suitable  norm.  To  this  end,  a  set 
of  trial  functions  and  a  set  of  weight 

functions  must  be  defined.  The  trial  functions 
arc  used  as  the  basis  functions  for  the 

truncated  series  expansion  of  the  solution;  the 
weight  functions  are  used  to  ensure  that  the 
differential  equation  is  satisfied  as  closely 
as  possible  by  the  truncated  series  expansion. 
The  choice  of  trial  functions  is  different  for 
the  two  methods.  In  the  case  of  the  spectral 
methods,  the  trial  functions  are  infinitely 
differentiable  global  functions,  while  for  the 
finite  element  methods,  the  domain  is  divided 
into  small  elements,  and  a  trial  function  is 
specified  in  each  element.  In  the  latter  case, 
the  trial  functions  ore  with  local  support,  and 
so  well  suited  for  handling  complex  geometries. 
Following  the  Galcrkm  approach,  the  weight 
functions  are  the  same  os  tile  trial  functions 
and  are,  therefore,  smooth  functions  which 
individually  satisfy  the  boundary  conditions. 

The  Chebyshev  SPEM  that  we  present  ill  this 
part  of  the  paper  is  based  on  the  idea  of 
decomposing  the  spatial  domain,  where  the 
physical  problem  must  be  solved,  into 

subdomains,  as  in  FEM,  and  then  on  each 

subdomain  expressing  the  solution  of  the 
problem  we  are  looking  for  by  a  truncated 
expansion  of  orthogonal  polynomials,  as  in  SPM. 
More  specifically,  in  the  case  of  one 

dimensional  problems,  we  decompose  the  original 
spatial  domain  Ll  into  non  overlapping  elements 
Llc  ,  where  o  =  X,  ...  ,  nc  ,  and  ne  is  the  total 
number  of  elements.  As  approximating  functions 
oil  each  element  Qc  ,  we  chose  functions 
belonging  to  Pj;  space  i.e.,  polynomials  of 
degree  i.  Nc  in  x.n  Then  the  global  approximating 
function  is  build  up  as  a  sum  of  the  elemental 
approximating  functions  and,  therefore,  is  a 
continuous  function  which  is  a  piecewise 

polynomial  defined  on  the  decomposition  Ll  of 
the  original  domain  Ll.  The  continuity  of  the 
derivative  at  the  element  interfaces  is  not 
satisfied  for  fixed  Nc,  but  only  ns  a 
consequence  of  the  convergence  process  I.e., 
when  all  Nc  tend  lo  infinity. 

He  now  discuss  the  construction  of  such 
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approximating  functions  using  Chebyshev 
orthogonal  polynomials.  A  function  f(x), 

defined  on  the  interval  [ -i,  1],  can  be 
approximated  by  a  truncated  expansion  of 
Chebysliev  polynomials  as  follows: 

~  N 

f(x)  ~  INf(x)  =  f(x)  =  £  °kTk(x)  '  (!) 

k^-0 

where  Tk  are  the  Chebyshev  polynomials  defined 
as 

Tk(  cos  0 )  =  cos  k 0  (2) 

or,  equivalently,  with  the  recurrence  relation 


Tk+i(x)  =  2xTk(x)  -  Tk_1(x) 


Vk£l 


and  T0(x)  =  1  ,  Tjl(x)  =  x.  Using  the  or thogonal i ty 
property  of  Tk  and  the  GaussLobatto  quadrature 
formula,  the  expansion  coefficients  ck  are 
easily  computed.  It  follows  that  the 

interpclant  of  f  can  be  written  as 

N 

lNf(x)  =  £f(*j)<Pj(x)  *  ('«) 

j=0 

where  if  j(x)  e  are  Lagrangian  interpolants 

satisfying  the  relation  <pj(xk)  =  i5jk  within  the 
interval  [-1,  1]  and  identically  zero  outside. 
The  Lagrangian  interpolants  are  given  by 


n 

<Pj(x)  =  lE^tTk(Xj)Tk(X)  ’ 

K=0 

with  c-  for  St'0’ 

with  cj-{2  for  j  =  0. 


in  an  elastic  rod.  The  initial  boundary  value 
problem  for  a  rod  of  length  L  and  with  fixed 
boundaries  con  be  stated  as  follows: 

_given  Uq  and  Uq,  find  a  continous  function 
u:Qx[0,Tj-l!  such  that  it  satisfies  the 
equation 


i  a2u  o2u  _  0 


on  £2  x  (0,T) 


with  u(0,t)  =  u(L,  t)=  0  Vte(O.T)  , 

and  u(x,0)  =  u0(x)  ,  u(x,  0)  =  u0(x)  Vx  e  Q  , 

wire  re  tire  dot  in  ii  indicates  partial 
differentiation  with  respect  to  time  and  where 
u(x,t)  is  the  axial  displacement,  c2  « !•//>  is  the 
characteristic  velocity  (velocity  of  sound),  E 
_i_s  Young's  modulus,  ,>  is  the  rod  density,  and 
£2  =  [0,L]  . 

If  we  look  for  sufficiently  regular  solutions 
u,  an  equivalent,  variational  formulation  of 
equation  (J.0)  is  to  find  u(x,t)  solution  of 


-u(x,t)dx  + 


Oh(x)  du(x,  l) 


for  all  functions  w(x)  which  vanish  on  the 
boundaries  and  which,  together  with  their  first 
derivatives,  are  square  integrable  over  £1.  In 
order  to  obtain  the  speotral-olemonl 
approximation  of  the  equation  (9),  we  decompose 
£2  into  non-overlapping  elements  £2„  ,  and  on  the 


with  c-  =  I *or  J  94  0,N 

with  Cj  |2  f()r  j  =  0 ,  N  , 

and  where  Xj  are  the  Chebyshev  Gauss-I.obatto 
quadrature  points 

Xj  =  cos(~~j  for  j  ~  0 . ,  N  .  (7) 

In  order  to  apply  these  interpolants  to  the 

spatial  decomposition  £2,  we  define  the  mapping 
f(°)(x):x  e  £2C  —  e  [  —X.  1],  between  the  points 
xe[ae,ac+j]  of  the  element  £2C  and  the  local 
element  coordinate  system,  by 

£(c)  s  F(o)(x)  =  -£-(x  -  a0)  -  1  .  (8) 

“e 

with  Ac  =  ae+l  ~  ao  •  The  Chebyshev 

Gauss-Lobatto  interpolants  in  the  £2C  element 
ore  then  written  as 

”e 

<pfk(e))  =  -jp-  y  -F4~Tk(^G,)Tk^(°))  ,  (9) 

k=o 

where  are  the  Gauss-Loba l to  points  in  the 
local  coordinate  system. 

For  the  spatial  discretization  of  a 
two-dimensional  problem,  the  Cartesian  products 
of  the  Chebyshev  -  i.oba  t  to  points  are  used  on 
each  rectangular  element  £2e  and  the  Lagrangian 
interpolants  arc  represented  using  lensor 
products  of  Chebyshev  polynomials. 


III.  ONE  DIMENSIONAL  HAVE  EQUATION 

To  illustrate  SPEli  in  practice,  we  use  as  model 
problem  the  one-dimensional  wave  equal  ion  which 
describe  the  propagation  of  longitudinal  waves 


decomposition  £2 
f i n i tc-d i mens i ona I 
functions  u(x,t): 


define  the  following 
aces  for  the  tTial 


U  c-  C°(£2  x  [0,TJ)  I  uc  e  PN(j;  u(0,  l)  =  u(L,  l)  =  o|. 


and  for  the  weight  functions  w(x): 
VN  =  jw  e  C°(£2)  |  we  e  PNo;  w(0)  =  w(L)  =  t 


where  uc  and^ we  denote  the  restriction  to  £2e 
of  u  and  w,  respectively,  and  N  denotes 
{Nj  ...  ,NC},  Using  previous  definitions  (9)  for 
the  interpolants  on  £2C,  and  according  to  the 
Galerkin  approach,  in^  the  local  coordinate 
system,  functions  ue  and  wc  lake  the 
following  form: 


«e«(C)'  t)=  Yj  ~')e)(t) 


wc(^(0))  =  £  ~w .  (13) 

j— 0 

where  u^n)(l)  =  uc(x^R),  t)  and  -  w(.(x(j<!|)  arc  the 
grid  values  of  the  unknown  approximate  solution 
and  of  the  weight  functions,  respectively. 
Using  these  approximating  function  spaces  mid 
the  mapping  f(c)(xj  to  solve  equation  (9),  by 
s  tra  i  gli  t  f  omard  compulation,  it  can  be  shown 
that  the  one  dimensional  wave  pronognlion 
problem  becomes  as  follows: 

given  ug0  and  U|j(,,  find  u  r  such  that  for 
all  h(Vn  the  following  equations  are 
satisfied: 
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e 

-^-«e)N  +  a(”e'  «e)N^J  =  0  ' 

e=l 


U'O 


wi  tli  ue(x,  0)  =  u0e(x)  ,  ue(x,  0)  =  u0c(x)  Ve  , 

where  a(  ■  ,  ■  )N  and  (  m  ,  ■  )N  are  symmetric, 
bilinear  forms  given  by 

(”e>  -^-«e)N  =  E  E  miej  ”ie)«je)(t)  •  (15) 


i=0j=0 

a(He.  «e)N  =  E  E  k<U  »(i0)*'je)(t')  • 

i=0j=0 

and  and  are,  respectii 

elemental  mass  and  stiffness  matricci 

Ne 

41  -  -p-—  aij  E  Wp<4e))Tq(4e)>  "pq  '  (17) 

c  (^e)  p,q=0 

Ne 

4j  = - T  aij  E  aPqTP^  ^q({  j  )  Kpq-  »  (18) 

^e(Ne)  p,q=o 

Hi  til  a  j  j  =  l/(CjCj)  .  Here 

'  c 

f o  for  p  +  q  odd  (I9) 


[Tipq  —  =1  TpTqdx 


1  .  + - 1 - -  for  p  f  q  even  , 


1  -  (P  +  qp  1  -  (p  -  q)' 


a(we,  ue)N  =  E  E  Krs  «r«s(l)  ’  (20) 

r=ls=l 

with  M(e)  =  (lj(e))T  m^e)  B^°),  =  (n^c))T  B^°), 

where  (b(°))t  is  the  transpose  matrix  of  B(e). 
Applying  the  relations  (23-26)  to  the 
var:iational  equation  CIA)  and  requiring  that 
it  be  satisfied  for  all  Hr,  the  spectral 
element,  approximation  of  our  original  equation 
finally  leads  us  to  solve 

d2us(t)  ~ 

E  Mrs  i  2  +  E  Krs  «s(D  =  0  •  (25) 


s=l 


dt 


(16) 

ne 

ne 

With 

M  =  V  H^e) 

11 

E  *(e)  > 

(26) 

the 

e=i 

Qsl 

where 

M  =  [Mrs] 

and 

K  =  [Mrs] 

are. 

respectively,  the 

mass  and 

stiffness 

matrices 

obtained  after  a  global  nodal  renumbering  and 
assembly  of  the  elemental  matrices^  The 
Dirichlet  boundary  conditions  u(0,t) u(L,t)  =  0 
are  imposed  by  matrix  condensation  i.e.,  by 
eliminating  the  rows  and  columns  corresponding 
to  the  two  boundary  points  from  the  system,  in 
the  case  of  Neumann  boundary  conditions,  they 
would  have  been  taken  into  account  naturally 
by  the  variational  principle.  Therefore,  we 
have  obtained  on  algebraic  representation  of 
the  original  problem  which  can  be  now  stated 
as  follows: 

given  the  vectors  U0  and  U0,  find  U  such 
that  it  satisfies  the  equations 


and 


M  U  +  K  U  =  0 


(27) 


f+1  dTP 
I"  ~dx_ 

=  { 


dT, 


-dx 


dx 

for  p  +  q  odd 
"IT*^  I  (P-q)/2 1  ~  J|(P+q)/2|]  for  P 


(20) 


q  even 


where 


for  11  =  0 
for  ns  1 


(21) 


Let  us  define  the  connectivity  matrix  b(c)  [,11] 
as  the  matrix  that  topologically  connects  the 
approximate  solution  values  u^c),  in  the  local 
coordinate  and  numbering  system,  to  the  us 
values,  in  the  global  coordinate  and  numbering 
system,  such  that 


uC*)=  l 


B(P) 

“js 


S=1 


(22) 


with  U(0)  =  U„  ,U(0)  =  U0  , 

where  the  unknown  vector  U ^contains  the  values 
of  the  discrete  solution  u  at  all  Chebyshev 
points  x(p)  ,  for  j  =  0,  ...  ,  Nc  and  for  all 

e  =  £>,...  ,  ne  except  for  x^-)  =  0  and  xjj'o)  =  L  . 
The  matrices  M  and  K  are  positive-definite, 
symmetric,  and  band-limited,  the  bandwidth 
being  determined  by  the  largest  Nc.  They  can 
be  easily  computed  for  each  chosen  order  of  the 
interpolants. 

To  solve  the  system  of  linear,  second  order, 
ordinary  differential  equations  with  constant 
coefficients  just  derived,  we  must  integrate 
over  the  time  interval  [0,  T].  This  is  done  by 
discretizing  the  time  variable  as  tn » nAt, 

0SnSHT  ,  where  At  =  T/NT  ,  and  Ny  is  the 
total  number  of  time  steps.  At  time  tn  ,  the 
solution  will  be  Un  =  U(tn).  From  the  different 
time  integration  schemes  which  are  available, 
we  used  the  Ncwmark  central  difference  scheme 
which  is  on  implicit  two-step  scheme, 
conditionally  stable  and  second  order  accurate. 


Hhere  nff  is  the  total  number  _of  nodes  of  the 
decomposition  of  the  domain  il,  and  b(°)  is  a 
Boolean  matrix.  Substituting  expression  (22) 
into  (15-16)  loads  to 


”  1  «e)N=  £  E  Mrs  «r"s(l>  ’ 


(w 


c2 


r-«ls=l 


(23) 


IV.  ANALYSIS  AND  DISCUSSION  OF  SPF.H 

In  order  to  investigate  the  accuracy  of  the 
method,  comparisons  were  done  between  the 
analytical  and  numerical  solutions  0/  the  one 
dimensional  problem  expressed  by  equation  CIO). 
The  general  solution  of  the  problem  is  given 
by 
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U(x,  l)  =  ■—  [u0(x  +  cl)  +  u„(x  -  cl)] 

r*X+C  t 


2c 


dllg(S) 

at 


ds 


x-c  l 


(28) 


Hltere  u0  and  du0/dl  arc  the  odd  21.  periodic 
extensions  of  u0  end  u0  to  the  entire  real 
axis  [2],[lA]. 

Discrete  numerical  methods  for  solving  a  I’DE 
introduce  errors  in  the  sought  solution  but 
they  get  progressively  less  as  the  mesh  size 
becomes  filler.  Numerical  modelling  for  nave 
propagation  actually  behaves  as  a  Ion  pass 
filter  in  the  sense  that  Ion  frequencies 
accurately  propagate  through  the  mesh  uhcreas 
high  frequencies  are  undesirably  modified 
[10].  The  most  evident  numerical  effects  tin 
tlte  high-frequency  band)  are  numerical 
attenuation,  numerical  anisotropy,  dispersion 
ill  numerical  phase  and  group  velocity,  and 
numerical  polarization.  Due  to  this  fact, 
frequency  analysis  is  a  very  sui.table  approach 
for  the  investigation  of  numerical  modelling 
results.  It  makes  it  easier  to  determine  the 
spectral  band  in  which  the  equation  is  solved 
correctly;  -that-  is  to  find  the  minimum 
wavelength  -for  which  a  given  numerical  method 
is  accurate.  Following  this  approach,  wo 
introduce  the  "frequency  error— index",  a 
complex  function  defined  as 


H(<u)  =  .li'LumM  =  |  „(w)  |  c  >>!>('»)  ,  (29) 

”an("’) 

where  dan(oi)  and  Unuml®)  ar0‘  respectively, 
the  Fourier  transforms  of  the  analytical  and 
numerical  solutions  that  ho  want  to  compare. 
The  frequency  error-index  makes  the 
interpretation  of  the  rosul ts  effective  since 
it  is  not  affected  by  the  spectrum  of  the 
chosen  initial  impulse  but  depends  only  on  the 
numerical  model.  By  considering  both  the  real 
and  imaginary  part  of  the  frequency 
error-index,  the  decay  of  accuracy  due  not  only 
to  amplitude  variations  Cwhcn  |II(<»)|  1.  )  but 

also  to  velocity  dispersion  (when 

ij>  =  arctgf  ,w^ll--j.)  y  o  )  can  bo  investigated. 

V  Re{II(tu)J  J 

Moreover,  in  order  to  get  an  idea  of  the  rate 
of  accuracy  decay  in  time  for  each  polynomial 
order,  ho  can  use  the  frequency  error-index 
•function.  It  is  clearly  important  that,  for 
large  scale  modelling  in  particular,  not  only 
efficiency  (the  number  of  grid-points  per 
wavelength)  but  also  accuracy  of  a  numerical 
method  be  stable  in  lime  (after  a  certain 
reference  distance  of  propagation). 

Ho  discuss  now  the  numerical  experiments 
performed  and  the  results  obtained.  I.el  ns 
denote  the  number  of  grid- points  per  wavelength 
by  G.  The  following  relations  holds 

1/G=»Ax/).,  0  <1/0  5- 5  .  As  initial  condition 

for  the  displacements,  this  function  was  chosen 
such  that 


U(l(x)  =  A  cos{2nwx)  cxp[B(x  -  Xq)2]  .  (30) 

Analytical  and  numerical  solutions  were 
compared  at  travel  distances  in  which  the 
analytical  solution  r consumes  the  original  form 
(because  of  the  periodicity  of  the  solution 
(28) ) .  Results  of  simulations  by  FEH  with 


polynomial  orders  N  -  J,  2,  3,  A,  and  Sl’EH  uilli 
orders  N  -  A,  8,  ,12,  IS,  20,  30,  A0,  60  have 
been  collected.  No  orders  less  than  N-A  were 
chosen  for  SPE11  because  of  the  fact  that  the 
Chcbyohev  collocation-points  for  Ion  polynomial 
order  are  very  close  to  Iho  equ i spaced  points, 
so  Thai  no  difference  between  ihe  solutions 
obtained  iiitli  the  two  methods  can  be  expected 
in  practice.  During  tile  experiments.  the 
number  or  nodes  was  held  constant  (n„  -  120),  and 
time  steps  were  chosen  for  each  polynomial 
order  such  as  to  ensure  numerical  stability. 

The  first  set  of  experiments  consisted  in 
•simulating  the  propagation  for  2880  grid  points 
of  a  broad  band  impulse  through  the  elastic 
homogeneous  rod,  both  hi  Hi  Flilt  and  but 

with  different  polynomial  orders.  By  using  a 
broad  band  impulse,  uc  shall  see  llial  il  is 
possible  lo  identify,  for  each  order  of 
approximation,  a  low  frequency  band  ulicre  the 
analytical  and  the  numerical  solutions  agree. 
The  maximum  extreme  of  this  interval  gives  the 
minimum  G  for  Hliicli  Die  solution  is  good.  The 
Gmu1(N)  corresponding  to  the  maximum  of  this 
band  defines  a  wavelength  ),m  s  „(N)  Gmin(N)Ax 
which  is  the  minimum  uavclenglh  Dial  the  model 
can  propagate  without  appreciable  errors. 

In  a  second  sot  of  experiments,  we  used  an 
impulse  with  a  spectral  band  appropriately 
bounded  in  high  frequency  in  order  lo  prove 
that,,  in  this  case,  l lie  propagation  errors  are 
ncgl igiblc. 

As  an  example,  figures  1  and  2  show  the 
frequency  error-index  in  botli  amplitude  arid 
phase,  respectively,  for  SPF.M  with  polynomial 
ordei  N-15  and  for  a  propagation  of  960 
grid-points.  The  loH-freqiieney  band  of  the 
model,  where  analytical  and  numerical  spectra 
arc  in  good  agreement,  is  well  defined  belli  by 
Die  amplitude  and  phase  of  the  frequency 
error-index.  The  phase,  however,  shows  very 
high  instability  just  after  Die  value  of 
Gmin~'<-  From  this  curve  it  can  he  inferred 
that  in  the  low-f roqucncy  bond  (that  is  for 
w<  l/(Gmin  Ax)  )  no  phase  shift  exists.  Similar 
results  wore  obtained  in  the  other  cases. Thus 
no  numerical  dispersion  is  observed  for  waves 
which  have  a  frequency  in  the  correct  range. 


1/G 


Fig.  1.  Amplitude  of  tlic  frequency  error  index 
for  STEM  id  tit  pnlynoRint  order  15  n(  n  dint  mice 
of  propagation  of  960  cjr fd=polnlrs. 


Figure  3  contains  a  sketch  of  the  values  of 
Gmj„(N)  for  the  trials.  For  SIM-H,  since  the 
inter  nodal  length  is  variable  inside  each 
element,  two  different  estimates  ol  f,  have  been 
taken  into  account  by  using  Die  mean  value  ("dx 
mean")  and  maximum  value  of  dx  ("dx  max").  As 
the  polynomial  order  increases,  the  values  of 
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Fig.  2.  Phono  of  the  frequency  error-index  for 
SPEM  with  polynomial  order  15  at  a  distance  of 
propagation  of  960  grid-points. 


N 


Flo.  3.  Values  for  the  nfnlnun  niinbor  of 
iirtd-points  per  iinvelongth  CC)  versus  the 
polynomial  order  (II)  for  FEM  and  SPEM.  at  a 
distance  of  propagation  of  960  grid-points. 
Estimations  of  G  Here  done,  taking  into  account 
the  mean  value  of  dx  (dx  Bonn)  nnd  the  nnxinuB 
of  dx  (dx  box)  respectively. 

Gmjjt(N)  for  both  estimates  show  a  trend  that 
looks  asymptotic.  Very  Ioh  values  of  Gmjn  (  < 
5  )  are  reached  for  orders  greater  than  8;  for 
N-60  a  value  of  Gm  j  n(60)  =  3 . 4  was  found.  The 
second  type  of  estimate  is  interesting  because* 
for  a  wave  propagating  in  a  discrete  Chobyshev 
mesh,  the  sampling  is  minimum  in  the  middle  of 
the  element  nhero  the  inter-nodal  length  is 
maximum.  It  should  be  noted  that  according  to 
the  "dx  mean"  estimate,  the  asymptotic  value 
is  Gss3,  but  this  corresponds  to  Ga?  according 


to  the  "dx  max"  estimate.  That  is,  the 
theoretical  limit  of  the  spectral  methods, 
Gs;2,  is  reached  locallly  with  SPEM,  which 
corresponds  globally  to  G«3  for  the  Chebysliev 
mesh. 

Figures  4  shows  the  amplitude  of  the  frequency 
error-index  for  the  propagation  of  a  pulse 
whose  spectrum  is  inside  the  model  frequency 
band  (defined  by  o>  <  1  /  (G(N)Ax)  =  «N  )  for  order 
N-15  (SPEH);  for  this  order,  Gmjn(lS)w4.  For  a 
propagation  of  960  grid-points,  the  computed 
spectrum  has  in  practice  negligible  errors,  and 
the  cut-off  frequency  is  reached  abruptly  with 
almost  no  errors  in  the  high  part  of  the  model 
spectrum  band.  The  nave-forms  at  the  same 
travel  distance  are  shown  in  figures  5  and  6 
using  a  broad-band  impulse  for  a  3-order  FEM 
and  a  15-order  SPEH,  and  in  figure  7  using  the 
band  limited  impulse,  respectively.  in  the 
lost  case,  the  errors  are  of  the  order  of 
10“'*.  From  a  comparison,  it  is  evident  that 
Sl’EM  is  globally  better  performing  and  almost 
non-dispersi ve,  as  expected. 

As  a  fJnal  point,  G  values  wore  collected  at 
different  lime  steps  and  for  different 
polynomial  orders.  In  figure  8,  curves  are 
drawn  representing  the  variation  of  G  with 
travel  distance  for  polynomial  orders  1,  2,  3 
(FEM1,  4  (FEM  and  SPEM),  and  15,  30  (SPEM). 

For  low  order  FEM  the  curves  show  a  quite  high 
rate  of  increase,  thus  a  large  number  of  grid 
points  per  wavelength  must  be  chooson  for  long 


Fig.  5.  Propagation  of  brood-hand  impulse  for 
FEM  with  polynomial  order  3  ol  a  distance  of 
960  grid  points.  Have  forms  of  the  analytical 
and  nuaerical  solutions  and  relative  error  are 
represented.  The  maximum  error  Is  0.58. 


1/G 


Fig.  A.  Amplitude  of  the  frequency  crror*lndox 
for  the  propagation  of  o  low-f requenny  impulse 
for  SPEM  with  polvnomiol  order  15  at  n  distance 
of  960  grid-points. 


Fig.  6.  As  in  figure  Sr  but  for  SPEM  with 
polynomial  order  15.  The  maximum  error  is 
0.23. 


555 


almost  no  dispersion; 

*  tlie  order  of  the  Interpol  an  Is  con  l>e  changed 
very  easily. 
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numerical  simulations.  For  higher  order  SPEM, 
things  are  very  different;  the  curves  arc 
slowly  increasing,  but  they  sIioh  very  stable 
trends,  even  asymptotic.  For  N-15,  values  of 
G(15)  from  3.7  to  A  may  be  detected;  the 
maximum  value  -for  longer  travel  distances  does 
not  seem  to  exceed  A. 2. 


V.  CONCLUSIONS 

In  tli  is  work  the  Chebyshov  spectral  element 
method  has  been  presented.  The  SPEM  solution 
of  the  one  dimensional  Have  equation  has  been 
illustrated  to  demonstrate  the  feasibility  of 
the  method  for  wove  equation  problems.  SPEM 
accuracy  ond  convergence  properties  have  been 
investigated  numerically  by  computing  the 
frequency  error-index  function  for  a  large  set 
of  numerical  experiments.  As  a  conclusion,  for 
the  high-order  Chcbyshcv  spectral  element 
method  applied  to  the  acoustic  wave  equation, 
the  main  results  can  be  summarized  ns  follows: 

■  low  values  of  G,  the  number  of  grid  points 
per  wavelength,  can  be  achieved  (close  to 
the  theoretical  minimum); 

*  great  accuracy  for  the  propagation  of  waves 
whose  spectrum  lies  below  the  wavelength 
corresponding  to  the  correct 

ob  to i nod; 

*  high-order  schemes  are  very  stable  In  lime 
with  respect  to  0  and  accuracy;  they  show 
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Abstract  -  We  consider  CW  radiation  by  a  point  source  in  the 
presence  of  a  two-scale  randomly-layered  medium  (a  slab  of  finite 
thickness  or  a  random  half  space).  The  source  can  be  exterior  to 
or  buried  within  the  random  layering.  Expressions  arc  obtained 
for  the  first  moment  and  two-point  correlation  function  of  the 
acoustic  pressure. 

Introduction. 

Abyssal  plains  comprise  much  of  the  world’s  ocean  bottom 
and  consist  of  a  sediment  layer  (nominally  one  kilometer  thick) 
lying  upon  a  rock  basement.  The  sediment  layer  is  itself  of  hetero¬ 
geneous  composition  and  possesses  acoustic  constitutive  parame¬ 
ters  (density  and  sound  speed)  that  vary  on  two  length  scales  (1). 
On  the  one  hand,  the  formative  deposition  processes  have  created 
a  material,  layered  with  clay,  silt,  pelagic  remains  and  the  like, 
whose -constitutive  parameters  fluctuate  rapidly  with  depth  (on 
the  scale  of  centimeters).  On  the  other  hand,  compactification 
due  to  overbearing  has  imparted  a  slow  scale  or  macroscopic  vari¬ 
ation  to  the  mean  value  of  these  parameters;  mean  sediment  sound 
speed,  for  example,  increases  with  depth  at  a  rate  of  roughly  one 
sec-1  (2],  and  thus  undergoes  an  0(1)  change  on  the  scale  of  a 
kilometer.  In  the  transverse  directions,  the  acoustic  parameters 
of  the  sediment  layer  arc  believed  to  remain  constant  to  a  degree 
that  makes  one-dimensional  modeling  a  reasonable  idealization. 
The  propagation  model,  therefore,  that  proves  useful  in  the  study 
of  acoustic  propagation  within  the  ocean  sediments  is  that  of  a 
transversely  homogeneous  ^lightly  dissipative;  slab  whose  acous¬ 
tic  constitutive  parameters  have  a  rapid  fluctuation  structure  su¬ 
perposed  upon  a  slow  mean  variation  in  the  depth  direction. 

A  small  parameter  <  (0  <  (  «  I)  is  used  to  characterize 
the  scales.  The  correlation  length  of  the  fine  scale  constitutive 
parameter  fluctuations  is  assumed  In  be  0(c2)  while  the  macro¬ 
scopic  mean  variations  are  assumed  to  be  Oil).  The  wavelength 
of  the  CW  source  radiation  is  assumed  to  have  an  intermediate 
0(<)  spatial  extent.  This  interpolating  wavelength  regime  is  the 
most  interesting.  The  wavelength  spans  many  correlation  lengths 
and  a  useful  limiting  probabilistic  description  of  the  field  quanti¬ 
ties  of  intoicst  is  possible.  Yet,  wavelength  is  small  relative  to  the 
macroscale  and  high  frequency  (WKB)  approximations  can  be  ex¬ 
ploited.  For  the  ocean  sediment  environment,  with  a  macroscale 
of  one  kilometer  and  a  correlation  length  of  ten  centimeters,  <2 
would  equal  lO"*  and  the  corresponding  wavelength  would  there¬ 
fore  be  ten  meters  (roughly  150  Hz.). 

Results  presented  here  comprise  a  small  portion  of  a  compre¬ 
hensive  theory,  developed  in  collaboration  with  Mark  Aseh  and 
Marie  Postd.  This  theory,  which  encompasses  pulse  as  well  as 
CW  cxdtation  and  inverse  as  well  as  direct  problems,  is  summa¬ 
rized  in  (3). 


~~PSL  +  Vp  =  <«(x)f(j t)S{z  -  z,)£ 

c,  m 

+  V-ii  =  0 

where  e  =  (eijCi.ej)  is  a  constant  unit  vector.  The  bulk  modulus 
K  and  density  p  vary  with  depth  as  follows: 

( V.  *>o 

A'"1  =  j  K-\S)[  1  +- o(r,2/£2)],  -L<z<Q 

l  A'i1,  a  <  —L  (O) 

f  Po,  a  >  0 

P=  <  Pi(-)[1  +  rj(z,z/t2)),  -L  <  z  <  0 
l  Pz,  z<-L 


whore  ij  and  v  are  zero  mean  stochastic  processes.  Fourier  trans¬ 
formation  of  the  transverse  spatial  coordinates  leads  to  the  fol¬ 
lowing  system  of  stochastic  ordinary  differential  equations. 


dp 

dz 

du3 

dz 


-^£3  +  d(z  -  r,)e3 

~(A'-1  -P_,kj)p+  -*,)&•& 


(3) 


where  tk3  is  the  r  component  of  (transformed)  partidc  velocity,  k 
is  the  scaled  transverse  slowness  and  k7  =  k  k.  Continuity  of 
pressure  and  normal  partidc  velocity  at  interfaces  z  =■  -L  and 
r-0  and  outgoing  radiation  conditions  as  z  —  Ax.  complete  the 
problem  spedfication. 


Some  Results. 


Using  the  asymptotic  theory  derived  in  [3],  we  can  character- 
ize  the  first  and  second  moments  of  the  (reflected  and  transmitted) 
pressure  For  brevity,  wc  here  give  results  for  the  simplest  con¬ 
figuration,  for  the  pressure  reflected  from  a  lossless  random  half 
space  (i  e  £  -  nc)  having  a  constant  deterministic  background 
and  only  random  sound  speed  fluctuations.  For  this  case,  the 
coherent  reflected  pressure  is: 


E[pnji(x,y,0,t)) 


where 


fgC|  -!-  ffCy  -  z,e3 

■is coll  [  R 

[pug'^egcr^-r3!-'^-!' 

LPiPj^K^-raj-t/s  +  I 


(4a) 


rJ  e:  x2  -+  jr.  tfsr  +  jJ,  Cj  ~  i  =  0, 1.  (4b) 


The  Problem. 

Consider  a  randomly  layered  slab  occupying  —I,  <  ;  <  0. 
with  a  CW  point  acoustic  source  at  height  above  tue  origin. 
Assuming  an  timcdcpcmlcnce.  the  (scaled  and  dimension¬ 

less)  acoustic  equations  become: 


Thus  the  coherent  reflected  pressure  is  determined  by  reflection 
from  an  effective  medium,  characterized  by  pt  and  cj.  When 
the  problem  is  further  simplified  by  assuming  tbal  the  medium  is 
matched  (i.e  e,  =  r,)  and  the  source  is  placed  on  the  Interface 
r  =  0,  the  reflected  pressure  intensity  becomes: 

£%r/i(x.y,CU)]2}  -v  jf  djtsVl  -S3  (5/1-^+  jj] 

f5a) 
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where  the  localization  length  Pis  given  by 


/  =  2 C]  [ws  j  L  (5b) 

Note  that  when  radial  distance  from  the  origin  is  much  greater 
than  a  localization  length,  i.e.  when  —  >>  1,  the  reflected  inten¬ 
sity  becomes  approximately  equal  to: 

£{|Pre/l(*.tf.  0»0IS}  ~  ^STC^r3 

Thus,  the  theory  predicts  that  "  -  ••>»-*^ntial  amount  of  acoustic 
cncigy  is  reflected  from  the  randomly  layered  space-. 
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Abstract 

Wc  arc  interested  in  active  identification  of  the  multipath  underwater 
(u.w)  propagation,  ic  in  the  estimation  of  path  parameters  (delay;, 
amplitudes  and  phases).  This  eomplctcsthc  prediction  given  by  the 
wave  propagation  equation.  The  classical  method  for  identifying  the 
u.w  channel  response  is  presented,  and  some  examples  of  u.w 
multipath  channels  arc  given.  The  problem  of  path  parameter  estimation 
becomes  more  difficult  when  the  paths  arc  very  close.  We  have 
proposed  some  high  resolution  methods  -  or  joint  estimation  methods  - 
which  enable  to  solve  close  paths,  estimate  their  parameters  and  follow 
their  time  variations.  Some  results  applied  to  u.w  data  are  finally  given. 


I  -  MULTIPATH  PROPAGATION  IN  U.W  ACOUSTICS 


It  is  now  well  admitted  the  u.w  channel  can  be  modelled  as  a  linear 
filter  J  between  an  emitter  E  and  a  receiver  R,  moreover  the  additive 
noise. 


A 

E 


,b(t) 

x(t)  1  r(t)=  J(s(t))  +  b(t) 


% 


(1) 


R 


Fig  1 :  The  u.w  channel  model 


This  filter  takes  account  of  the  energetic  aspect  (absorption, 
diffraction...)  but  also  of  temporal  and  frequential  distorsions,  and 
particularly  multipath  effects. 

According  to  the  propagation  and  geophysical  conditions  (E,.R, 
bottom...),  to  the  carrier  frequency  Vo,  and  also  the  time  scale  of 
interest,  this  filter  can  be  modelled  either  random,  or  deterministic,  or 
time  varying  [1]  .  Anayway  the  description  of  7,  and  its  time  dr 
stochastic  variations,  is  a  main  complement  to  the  prediction  given  by 
the  solution  of  sound  propagation  equation  in  u.w  acoustics  (ray  or 
mode  theory,  or  hyperbolic  equation...)  which  only  gives  an 
approximate  and  static  solution. 

As  the  emitted  and  received  signals  arc  always  band  pass  around  Vo, 
we  use  the  complex  amplitudes  relative  to  Vo,  denoted  c(.t)  for  emission, 
y(t)  for  reception,  n(t)  for  noise,  and  H(t)  the  corresponding  channel 
band  pass  impulse  response  (i.r).  The  multipath  propagation  is 
traduced  by 


P 

y(0=  X  «k.e*^k  c(t-tk)  +  n(t) 
k  =  1 


(2) 


P 

H(t)  =  X  akc’^k  5(t-xjc) 
k  =  1 


(3) 


where  the  parameters  ak,  <fk,  Xk  arc  assumed  here  constant,  but  they 
can  be  random,  time  varying...ak  traduces  the  energetic  level 
transmitted  over  the  delay  xk,  the  phasis  q>k  includes  the  phasis  relative 

to  the  path  k  plus  a  delay  term  ( 2  rcv0Xk)  plus  an  eventual 
demodulation  phasis. 


II  -  ESTlMATIONOF.THE.IR__EXPERIMENTAL  EXAMPLES 

The  problem  of  interest  in  this  paper  is  the  estimation  of  the  u.w 
channel.  Let  us  note  we  perform  here  active  identification ,  and  not 
passive  time  delay  estimation  (see  for  ex  [2]).  It  has  been  shown  [3] 
the  minimum  output  error  solution  for  the  channel  identification  is  to 
emit  large  WT product  (W  bandwith,  T  duration)  signals,  and  to  cross 
correlate  the  channel  output  with  a  copy  of  enrssion  In  baseband 
notation  this  leads  to 
P 

ryc(t)=  X  «k  c^k  rc(t-xk)  +  b'(0  (4) 

k  =  1 

where  rc  is  c(t)  auto  correlation  function  and  b’(t)  =  Iyn. 


Two  examples  arc  given  below,  coming  from  2  sea  experiments.  The 
first  (fig.2a)  lias  been  obtained  in  the  following  conditions :  shallow 

water ;  E/R  distance  =  4  km;  v0  -  500  Hz..  The  2nd  example  is  deep 

water,  and  more  stable  because  v0  -  60  Hi ,  dE/R  =  140  km. 

The  mulupalh  structure  is  evident  on  both  figures  with  different  typical 
time  variations  of  parameters. 


Fig.  2  :  Examples  of  u.w  responses  H(x) 


From  many  sea  experiments  [1]  one  can  consider  the  positions  x  y.  are 
always  stable  enough ;  me  amplitudes  «k  arc  often  rapidly  varying  (as 
soon  as  v0  >  100  Hz) ,  the  phases  arc  not  seen  here,  they  arc 
always  slowly  varying,  and  very  often  the  path  phases  differences 
<>k.  are  very  stable. 

For  a  precise  estimation  of  paramcleis  the  problem  is  no  longer  to 
estimate  H(t),  but  the  set  of  parameters  (c<k,(i)k,Xk)  of  the  model  (3). 

Ill  -  PARAMETER  ESTIMATION  OF  THE  MODEL  (3) 


HT-1.  One  nath  case  :  In  this  ease  (p  =  1),  and  if  n(t)  is  white, 
gaussian,  with  psd  y0>  ^e  above  mentioned  cross  correlation  (CCOR) 
leads  to  the  Maximum  Likelihood  (M.L)  estimates  of  x,a,<j>,  denoted 
by  f  ,  $  v  ■  X  is  the  delay  for  which  this  CCOR  is  maximum, 
<£  and  $  arc  the  modulus  and  phasis  of  the  maximum  of  CCOR.  It  is 
well  known  these  estimates  are  asymptotically  unbiaiscd  and  their 
variance  is  bounded  by  Cramer  Rao  bound  (the  performance  is  directly 
connected  to  SNR  and  c(l)  effective  signal  bandwith  -  see  [3]). 

As  soon  as  p  &  2,  the  calculus  of  die  structure  of  joint  ML  estimate  of 
the  parameter  set  become'  complex,  and  the  performance  calculus  too, 
particularly  when  the  paths  arc  very  close  (closer  than  1/W),  ie  when 
they  arc  no  longer  distinguished  by  the  CCOR  processing.  (Let  us  note 
the  eases  of  2  and  3  joint  paths  have  been  treated  [4)).  So  in  the 
examples  of  fig  2,  some  of  die  paths  are  well  separated,  whereas  some 
other  arc  undistinguishablc. 

111-2.  Close  paths  estimation  .  Dillcrcnt  solutions  have  been  proposed 
in  order  to  solve  and  estimate  close  paths  after  the  CCOR  step  .  this 
first  step  is  important  because  SNR  is  improved  and  some  paths  arc 
already  solved.  A  first  kind  of  methods  (.see  [5J  and  references) 
consists  in  traasposing  the  high  resolution  (.HR)  methods  well  known 
in  spatial  or  frcqucncial  filtering  (Music  methods.,.).  Wc  have  used  the 
Tufts  Kumarcsan  method  for  the  ease  of  fig  2b  [5j.  Without  detailing 
this  method,  let  us  say  i)  it  needs  a  deconvolution  step,  ii)  the 

estimation  of  the  amplitudes  akci$k  is  uncoupled  of  xk 
estimation, which  is  not  optimal. 
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In  any  case  the  number  p  of  paths  must  be  first  estimated. 

Let  us  see  now  a  second  kind  of  method  which  directly  joint  estimates 
the  set  of  parameters  of  the  model  (3). 


IV.  1  The  method  :  By  time  sampling  the  equation  (4),  the  following 
mauix/vcctor  equation  is  obtained 


r=MG,Ic)a+h  (5) 

where  M(.,.)  is  the  mode!  matrix  (where  1.  is  unknown,  but  £c  is 

known)  and  a  is  the  unknown  complex  amplitude  vector  of  ct^ciOj, 
The  minimization  of 

J  4  III- Mall2  (6) 

versus  the  whole  x  and  a  parameters  is  the  optimal  lcast  square 
solution  (or  ML  solution  if  b.  is  gaussian)  In  this  ease  too,  the 
number  p  must  be  first  estimated  by  a  detection  criterion  for  example ; 
practically  one  can-also  test  several  values  of  p.  These  optimal 
estimates  are  (4) :  ~ 

£  =  Argmin||  P  y  ||2  )  W 

&  =  ArgminJ  j  where  P  =  I-M(MlM'r)Ml 


The  minimization  of  J  is  performed  by  a  gradient  descent  algorithm 
judiciously  initialized  [4], 

IV  2  Sequential  estimation  :  The  above  minimization  of  J  is  applied  to 
each  received  data  £ ,  le  each  CCOR  ryc(t).  In  our  u  w  case,  as 
shown  in  fig  2,  one  always  disposes  of  several  successive  ryc(t).  We 

have  recently  proposed  [4]  to  improve  the  procedure  by  taking  account 
of  successive  intcrcorrclaiions.  The  above  non  linear  estimation  method 
enables  to  easy  introduce  this  as  a  priori  information  This  i«  equivalent 
of  adding  a  constraint  equation  on  some  parameter  &  in  (6) 
("regularization").  So  now  one  tries  to  minimize  for  each  record  Tym 

hi  =  ilrn  -  M  (!„,  iy  a  n  1 1 2 + hllfln-fln  - 1  f  (8) 


In  the  u.w  case,  as  the  delay  positions  \  arc  stable  enough  from  one 
record  to  another,  we  use  only  i  as  constraint  parameter  £  in  (8). 

IV  3  Results  :  In  the  fig  2b,  there  arc  3  "main  paths"  but  there  are 
perhaps  some  unsolvc  paths  inside  them  and  the  ray  tracing  predicts  2 
close  paths  inside  the  second  "path".  First  a  zoom  is  made  of  this 
second  "path"  (fig  3a).  One  tncs  to  identify  a  model  like  (5)  in  it. 


delay  delay 


delay  dme 


Fig  3 :  Joint  estimation  of  a  couple  of  i  jx  and  i> 

Tlie  results  are  given  in  fig  3b .  p.  =  0  corresponds  to  the  minimization 

^ in  *"'8  3c  .  p  =  0.05  corresponds  to  the  minimization  of 
Jn  (8).  Now  two  paths  arc  well  exhibited  and  identified,  and  their  time 
vanauons  arc  followed.  Their  modulus  and  phasis  are  given  in  fig  3d. 


Tlte  principle  and  some  results  of  the  estimation  of  the  u.w  channel  i.r 
have  been  given  particularly  for  the  multipath  ease,  the  estimation  of 
ttciays,  amplitudes  and  phases  has  been  studied.  The  CCOR  step 
improves  SNR  and  gives  a  first  path  separation.  The  improvement 
given  by  the  second  step  (minimization  of  J  and,  better,  Jn)  enables  to 
solve  and  characterize  close  paths.  The  method  performs  even  when 
the  number  of  tnplc  parameters  is  not  small  (for  ex..  6  paths). 

This  estimation  is  important  in  two  kinds  of  objectives : 

1)  the  knowledge  of  die  u.w  propagation  -  and  there  is  now  a  large 
interest  m  u,  for  ex.  in  the  international  u.w.  Acoustic  Tomography 
Project  [6]:),  which  is  based  on  the  precise  time  delays  estimation. 

ii)  die  elaboration  of  efficient  detection  or  communication  u.w 
systems  :  it  is  important  to  know  the  structure  and  variations  of 
multipath  to  compensate  them. 


This  work  has  been  partly  supported  by  French  DCN,  and  also  an 
Ifremer  contract. 
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Abstract  -  This  paper  describes  the  application  of 
computational  fluid  dynamics  to  a  hypersonic  pro¬ 
pulsion  system,  and  serves  as  an  introduction  for 
this  session.  An  overview  of  the  problems  associa¬ 
ted  with  a  propulsion  system  of  this  type  is  pre¬ 
sented,  highlighting  the  special  role  that  CFD 
plays  in  the  design. 

I.  INTRODUCTION 

CFD  has  demonstrated  some  rather  significant 
and  spectacular  achievements  for  aeronautical  vehi¬ 
cles  and  their  flow  fields  over  the  last  15  years. 
More  recently  some  of  these  gains  have  been  brought 
to  bear  on  propulsion  systems  for  aircraft;  namely 
in  the  complex,  wall  bounded  internal  flows  with 
energy  addition  inside  of  engines.  An  extensive 
activity  has  been  pursued  in  attempting  to  validate 
numerical  methods  using  data  obtained  from  compo¬ 
nent  (inlet,  ducts,  nozzles,  combustors)  testing. 
The  computer  codes  developed  have  incorporated 
extensive  physical  and  chemical  modeling  or  clo¬ 
sures,  as  well  as  utilizing  multi-dimensions  and 
sophisticated  grid  generation  and  adaptation  meth¬ 
ods.  Due  to  the  extremely  complex  nature  of  inter¬ 
nal  flow  of  engines,  including  rotating  machinery, 
the  validation  and  calibration  of  propulsion  codes 
has  proceeded  slowly  but  steadily.  With  the  resur¬ 
gence  of  interest  in  a  hypersonic  air-breathing 
aircraft,  i.e.,  the  National  Aerospace  Plane,  CFD 
efforts  have  been  focused  strongly  on  its  proposed 
engine  cycle.  That  cycle  as  envisioned  currently 
relies  on  a  supersonic  combustion  ramjet  (Mach  6 
to  15)  used  in  conjunction  with  an  accelerator  up 
to  Mach  6  and  a  rocket  engine  from  approximately 
Mach  15  to  orbital  speed.  The  challenge  to  the 
scientific  community  is  to  develop  accurate  numer¬ 
ical  simulations  for  this  type  of  aircraft  and 
propulsion  system.  Since  scramjets  have  not  been 
demonstrated  on  any  propulsion  system,  the  cycle 
must  yet  be  proven  feasible.  In  the  absence  of.  any 
flight  data  and  the  meager  prospect  of  obtaining 
any  data  above  flight  Mach  numbers  of  8  in  the  near 
future,  CFD  becomes  the  tool  of  necessity  for 
design  of  the  engine  and  vehicle.  It  is  worthwhile 
to  point  out,  that  the  highly  blended  propulsion 
system  makes  it  impossible  to  consider  the  engine 
without  considering  the  influence  of  the  airframe. 


'Deputy  Chief. 


In  this  session,  we  shall  concentrate  on  the  hyper¬ 
sonic  propulsion  system  and  our  progress  is  devel¬ 
oping  reliable  CFD  codes  for  analysis  and  design  of 
the  propulsion  components.  In  particular,  we  shall 
look  at  the  speed  range  corresponding  to  scram jet 
operation. 

II.  AIR  CAPTURE 

It  should  be  noted  at  the  outset  that  the  air 
reaching  the  inlet  face  has  experienced  a  rather 
trying  time  from  the  moment  it  traverses  the  shock 
wave  at  the  aircraft  nose.  Depending  on  flight 
Mach  number,  the  air  may  be  dissociated  and  ionized 
as  it  moves  along  the  underside  of  the  aircraft. 
This  air  may  undergo  catalytic  effects  at  the 
vehicle  wall  as  well.  Chemical  and  thermal  non¬ 
equilibrium  effects  need  to  be  modeled  as  well  as 
catalicity.  At  the  inlet  plane,  a  substantial 
boundary  layer  has  been  developed  on  the  ramp  side 
of  the  inlet.  It  may  be  laminar  or  turbulent,  or 
possibly  transitional  in  nature.  Shock  waves  from 
the  cowl  leading  edge  and  the  inlet  sidewalls 
introduce  additional  complexities,  such  as  shock- 
boundary  layer  interaction,  which  need  to  be 
modeled  in  the  CFD  codes.  An  example  of  such 
interactions  is  shown  in  a  videotape.  The  compu¬ 
tations,  which  are  the  result  of  the  work  of  Benson 
and  Reddy,  at  NASA  Lewis  Research  Center  (LeRC) 
illustrates  a  further  trial  for  the  captured  air¬ 
flow.  The  particle  tracing  shows  that  the  inter¬ 
section  of  the  cowl  and  ramp  shocks  with  the 
sidewall  boundary  layers  causes  a  movement  of  the 
lower  energy  wall  flow  towards  a  narrow  region. 
Cross-sectional  inspection  of  the  computed  flow 
field  reveals  a  vortex-like  feature.  At  the 
throat,  this  flow  behavior  extends  over  a  suffi¬ 
cient  portion  so  as  to  cause  concern  regarding 
performance  and  stability  of  the  inlet.  Other 
rectangular  inlets,  such  as  the  sidewall  compres¬ 
sion  type,  also  experience  similar  effects.  In 
this  session  we  shall  hear  further  discussion  on 
inlets.  Additional  information  is  provided  by  this 
author  in  AGARD  proceedings.  Comparison  of  the 
computer  inlet  flow  field  and  experimental  data 
have  shown  good  general  aerodynamic  agreement. 
However,  in  the  regions  where  strong  viscous 
effects  are  present,  the  agreement  is  marginal. 

Both  transition  and  turbulence  modeling  improve¬ 
ments  are  required.  Compressibility  effects  on 
turbulence  modeling  is  currently  being  pursued  as 
well  as  second  moment  closure  by  Shih  and  his 
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cohorts  at  the  ICOMP  Center  for  Modeling  of  Turbu¬ 
lence  and  Transition, at  LeRC.  Conparisons  of  heat 
transfer  data  on  the  inlet  walls  with  computed 
resultsshowisignificant  differences  that  need  to 
be  reconciled  if  CFD  is  going  to  affect  scramjet 
thermal  heating  design. 

III.  MIXING  AND  BURNING 

Mixing  and, combustion  of  hydrogen  in  super¬ 
sonic  flow  (Mach  1.5  to  7)  is  the  critical  issue  to 
be  solved  for  the  success  of  scramjets.  A  seminal 
contribution  to  supersonic  mixing  was  put  forward 
by  this  author  regarding  the  generation  of  stream- 
wise  vorticity  for  mixing  enhancement.  Current 
generic  engine  combustors  rely  on  the  concept  of 
vorticity  generation.  The  method  of  generation 
differs  only  in  detail  from  that  of  this  author, 
but  not  in  principle.  It  employs  swept  leading 
edges  at  angle  of  attack  to  the  supersonic  stream 
to  promote  vorticity.  Shock  vortex  interaction  was 
also  proposed  as  a  means  of  mixing  enhancement,  but 
it  is  less  influential  than  vorticity  generation. 
The  basic  issue  revolves  about  the  fact  that  jet 
penetration  into. supersonic  flows  is  limited  to 
about  10  jet  diameters;  an  amount  that  is  insuffi¬ 
cient  for  a  combustion  chamber.  Struts  protruding 
into  thj  stream  produce  the  anticipated  and  predic¬ 
table  drag,  must  be  cooled,  and  must  be  retracted 
over  a  portion  of  the  flight  range.  Some  current 
research  centers  on  the  vorticity  generation  con¬ 
cept  mentioned  above  using  swept  wall  injectors 
with  fuel  injection  from  the  back  face.  CFD  devel¬ 
opment  of  three-dimensional  viscous  computer  codes 
with  finite  rate  chemistry  are  used  to  compute  the 
mixing  and  reaction  for  these  devices.  Shown  in  a 
video  is  also  an  unswept  configuration  for  compar¬ 
ison.  The  computations  performed  by  Moon  at  LeRC 
illustrate  the  extent  of  the  reacting  zone  for  the 
two  configurations.  It  should  be  noted  that  the 
CFD  developed  for  the  combustor  does  not  truly  rep¬ 
resent  the  turbulence-chemistry  interaction.  The 
chemistry  is  modeled  using  a  number  of  chemical 
steps  (12)  and  a  number  of  species  (9) .  Mean  val¬ 
ues  of  temperature  and  pressure  are  used  to  deter¬ 
mine  the  reaction  rates.  Current  research  is 
devoted  toward  formulating  a  probability  density 
function  model  for  the  chemical  reactions.  Such  a 
scheme  would  rely  on, local  instantaneous  values  of 
temperature  and  pressure  for  the  chemical  reaction 
calculations.  Again,  we  shall  hear  in  this  ses¬ 
sion,  some  further  discussion  on  the  mixing  and 
combustion  issue. 


IY.  EXHAUSTING  THE  AIR 

The  nozzle,  like  the  inlet,  blends  into  the 
aerodynamic  lines  of  the  vehicle.  Here,  the  under¬ 
side  of  the  aft  portion  of  the  airplane  forms  a 
one-sided  nozzle  surface.  On  the  opposite  wall,  a 
short  cowl  allows  the  flow  to  form  a  free  shear 
layer  with  the  external  flow  field.  Hence,  the 
nozzle  dynamics  and  the  shear  layer  physics  and 
chemistry  are  radically  different  than  those  within 
our  experience.  Vehicle  speed  affects  the  effec¬ 
tive  back  pressure  on  the  nozzle  and  causes  it  to 
be  over-  or  under-expanded.  Shock-shear  layer 
structure  is  dramatically  affected,  and  can  vary 
from  shock  impingement  on  the  vehicle  to  no  effect. 
The  composition  of  the  species  entering  the  nozzle 
and:  the  exit  conditions  influence  the  completeness 
of  chemical  reaction  in  the  plume.  A  typical  com¬ 
putation  by  Lai  at  LeRC  using  a  Reynolds  averaged, 
three-dimensional  Navier-Stokes  codes  is  shown  in 
the  video.  This  computation  relies  on  a  Baldwin- 
Lomax  turbulence  model.  One  can  see  the  develop¬ 
ment  of  sidewall  shear  layers  at  the  nozzle  exit  as 
well  as  the  corresponding  features  on  the  cowl  sur¬ 
face  and  shear  layer.  The  nature  of  the  exhaust 
plume  is  highly  affected  by  three  dimensionality. 
Only  limited  data  exist  for  flow  field  comparison 
at  the  present  time.  There  is  no  doubt,  however, 
that  significant  closure  issues  remain  to  be 
addressed. 

V.  CONCLUDING  REMARKS 

On  an  overall  basis,  one  can  observe  that  a 
significant  amount  of  progress  has  been  made  on  the 
application  of  CFD  for  high-speed  airbreathing  pro¬ 
pulsion  systems.  Excellent  qualitative  agreement 
is  the  usual  picture,  with  significant  discrepan¬ 
cies  only  in  those  near  wall  regions  dominated  by 
strong  viscous  flows.  Nonequilibrium  air  effects 
and  finite  rate  chemistry  are  extensively  modeled 
and  computed.  However,  proper  turbulence  chemis¬ 
try  interaction  requires  a  significant  amount  of 
attention.  Improvements  in  turbulence  and  tran¬ 
sition  models  are  also  critically  needed.  I  look 
forward  to  hearing  the  presentations  in  this  ses¬ 
sion  on  these  important  issues;  I  hope  you  share  my 
enthusiasm. 
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Abstract 

A  comparative  numerical  study  of  performance 
parameters  of  a  similar  and  an  opposite  sweep  side- 
wall  compression  inlet  is  made.  A  three-dimensional 
Navier-Stokes  code  is  used  to  calculate  the  flow 
through  these:  inlets.  Results  of  these  calculations 
are  used  to  compare  the  two  designs  for  their  perfor¬ 
mance  and  flow  quality.  Effects  of  boundary-layer 
ingestion  on  the  performance  and  overall  flow  fea¬ 
tures  are  also  investigated. 

Introduction 

For  over  two  decades,  NASA  Langley  Research 
Center  has  been  conducting  research  in  developing 
a  viable  air-breathing  propulsion  system  for  hyper¬ 
sonic  flight  application.  In  this  flight  regime,  a  super¬ 
sonic  combustion  ramjet  (scramjet)  engine  bwomes 
attractive.  The  inlet  of  the  engine  module  com¬ 
presses  the  flow  with  the  swept,  wedge  shaped  side- 
walls.  The  sweep  of  these  sidewalls,  in  combination 
with  the  aft  placement  of  the  cowl  on  the  under¬ 
side  of  the  engine,  allows  for  efficient  spillage  and 
for  good  inlet  starting  characteristics  over  a  range  of 
operating  Mach  numbers  with  fixed  geometry  [1] — 
[2].  In  order  to  systematically  investigate  the  ef¬ 
fects  of  sweep  on  the  performance  of  a  scramjet  in¬ 
let,  a  numerical  study  is  conducted  on  two  equivalent 
scramjet  inlets.  These  inlets  have  been  designed  in 
such  a  way  that  both  have  the  same  wetted  area  [3] 
but  in  one  inlet  design,  all  of  the  compression  sur¬ 
faces  are  swept  backward  (Fig.  l  a);  whereas,  in 
the  other  design,  alternate  surfaces  are  swept  back¬ 
ward  and  forward  (Fig.  1-b).  A  three-dimensional 
Navier-Stokes  code,  SCRAMIN  [2],  is  used:  to  an¬ 
alyze  the  inlet  configurations.  The  code  solves  the 
Reynolds-averaged  Navier-Stokes  equations  in  con 
servation  form  using  the  MacCormack  method. 

Results  and  Discussion 

The  numerical  simulation  of  the  flow  through  the 
two  inlet  configurations  described  earlier  is  made  for 
the  following.freestream  conditions 

Mo,  =  4.5,  T«,  =  200 °K,  =  3376.86  N/M2 

The  calculations  were  made  for  uniform  flow  enter¬ 
ing  the  inlet  configurations  and  with  a  10%  (of  inlet 
height)  and  a  20%  thick  entering  boundary  layer  to 
determine  the  effect  of  boundary-layer  ingestion  on 
the  performance  of  the  similar  and  opposite  sweep 
inlet.  Due  to  space  limitation,  only  representative 
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results  are  shown  here;  the  detailed  results  are  avail¬ 
able  in  Ref.  [3]. 

Figure  2  shows-the  pressure  plots  in  three  Ion 
gitudinal  planes  for  the  two  configurations  with  uni 
form  flow  entering  the  inlet.  It  shows  the  shock  and 
expansion  waves  and  their  interactions.  This  fig¬ 
ure  shows  an  advantage  of  the  opposite  sweep  over 
the- similar  sweep.  The  sidewall  shocks  in  the  op¬ 
posite  sweep  inlet  do  not  intersect  with  the  sidewall 
boundary  layer  in  a  given  swept,  constant-area  cross- 
section.  Therefore,  any  blockage  created  by  the 
shock-induced  separation  of  the  boundary  layer  is  not 
as  damaging  to  the  inlet  performance  as  in  the  case  of 
sirnilar  sweep  inlet  where  the  shock/boundary  layer 
interaction  and  associated  separation  takes  place  in 
a  swept,  constant-area  cross-section. 

Figure  3  shows  plots  of  Mach  number,  stagna¬ 
tion  pressure,  and  static  pressure  in  a  cross  plane  near 
the  throat  for  the  two  configurations  with  20%  thick 
boundary  layer  entering  the  inlets.  It.  shows  approx 
imately  half  of  the  cross  section  is  now  filled  with 
the  viscous,  nonuniform  flow  because  the  20%  thick 
entering  boundary  layer  near  the  top  wall  is  being 
squeezed  into  the  throat  region  which  is  four  times 
smaller  in  width  than  the  entering  cross-section. 

Using  the  flowfield  results,  calculations  were  also 
nr  rde  for  inlet  performance  quantities  such  as  the 
average  throat  Mach  number,  total  pressure  rcco .  - 
ery,  axial  thrust,  and  mass  capture.  The  calculations 
showed  that  there  was  little  difference  in  the  average 
throat  Mach  number  and  total  pressure  recovery  of 
the  two  inlets.  However,  the  mass  capture  signifi¬ 
cantly  increased  for  the  opposite  sweep  inlet.  Thus, 
the  detailed  flowfield  results  suggest  that  the  overall 
impact  of  the  opposite  sweep  is  quite  favorable  on 
the  inlet  performance. 
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Figure  2:  Static  pressure  contours  at  three  height  locations  with  uniform  entering  flow. 


Similar  sweep 


Opposite  sweep 


Figure  3.  Plots  of  inlet  performance  parameters  near  throat  with  20%  tlm  h  entering  hoiuniarv  ia\  cr. 
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Abstract  This  paper  describes  the  numerical 
techniques  to  solve  the  supersonic  chemically 
reacting  flows.  The  higer -order  upwind  scheme  based 
on  a  generalized  approximate  Roe's  Riemann  solver  is 
used,  and  a  fully  implicit  time  integration  method 
is  used  to  accelerate  convergence  rates.  As  the 
numerical  examples,  the  hypersonic  flow  around  space 
vehicle,  and  the  supersonic  combustion  in  SCRAM  jet 
engine  are  presented. 

I.  INTRODUCTION 

The  basic  research  and  development  is  driven 
forward  in  the  NAL  for  the  space  plane  which  are 
capable  to  go  into  the  space  and  return  with  ease. 
The  most  important  subjects  in  this  development 
would  be,  the  precise  evaluation  of  aerodynamic  and 
aerothermodynamic  characteristics  in  hypersonic 

region  where  the  real  gas  effect  is  dominant,  and 
the  development  of  the  supersonic  combustion  RAM 
(SCRAM)  jet  engine.  No  ground-based  experimental 
facilities  can  fully  duplicate  the  conditions  that 
these  vehicles  will  encounter  in  the  upper 
atmosphere,  hence  the  numerical  simulation  is 

expected  to  be  one  of  the  most  promising  method  in 
the  study  of  hypersonic  chemically  reacting  flows. 
In  this  study,  chemical  nonequilibrium  flows  are 
solved  by  the  use  of  higher -order  upwind  scheme. 
This  scheme [11  is  based  on  a  generalized  Roe's 
approximated  Riemann  solver,  and  arbitrary 

nonequilibrium  effects  are  treated  in  a  unified 
formulation.  A  fully  implicit  time  integration 

method  is  used  to  accelerate  convergence.  As 
numerical  examples,  chemically  reacting  hypersonic 
flows  around  the  Space  Shuttle,  and  the  supersonic 
combustion  in  the  SCRAM  jet  engine  are  solved. 

II.  BASIC  EQUATIONS 

The  basic  equations  of  compressive  chemically 
reacting  flow  are  written  in  the  weak  conservation 
form: 

#?,/«  <  <?Fk i  (q) /<?XV  =  S,, 

where  q,  is  a  conservative  quantities  per  unit  mass, 

and  s,  is  its  corresponding  source  terra. 

q  =  \o  ,  r>u,  pv,  ow,E,  r>Y,,  p'i,,---,  pY„]T, 

where  E  is  the  total  enrgy,  E  -  e  +  l/2pV’,  and  the 


internal  energy  e  is  given  by  e  =  p  £Y,r  S  Cp,dT  + 
AHF,1  -  P.  Y„,  (a  =  1,-**n),  are  the  mass  fraction 
of  a-speicies,  and  the  Arrhenius  type  chemical 
reaction  models  are  used  for  the  source  terms  of 
speices  conservation  equations. 

III.  NUMERICAL  SC1EME 

In  recent  years,  upstream  difference  schemes 
have  yielded  a  great  success  in  flow  computation. 
Most  of  these  schemes  make  use  of  the  exact  or 
approximated  solution  of  the  Riemann  problem  as  a 
building  block.  Among  them,  Roe's  approximated 
Riemann  solver  is  one  of  the  most  promising  method, 
and  in  this  paper,  a  generalized  Roe's  approximate 
Riemann  solver  for  nonequilibrium  flows  is  used. 
Chakravarthy  Osher  postprocessing  TVD  scheme  is  used 
to  make  the  higher -order  scheme.  It  is  more 
efficient  than  MUSCL  scheme  for  a  noneguilibriura 
flow  problem,  because  the  latter  method  needs  Newton 
iterations  at  each  cell  interface  to  calculate  the 
value  of  temperature  from  conservative  variables  m 
the  case  of  chemically  reacting  flows. 

Generally  nonequilibrium  flow  is  very  stiff 
problem,  so  that  it  is  desirable  to  treat  every  term 
implicitly.  In  this  paper  each  convective  block 
operator  is  diagonalized  so  that  the  block  matrix 
operation  is  reduced  to  the  scalar  one.  Further,  in 
order  to  enhance  robustness,  near  by  shock  waves 
only  chemical  source  terms  are  implicitly  treated 
and  the  rest  explicitly.  This  patched  method[2]  is 
easily  constructed  by  replacing  tri  diagonal  scalr 
operators  by  a  unit  matrix. 

IV.  EXAMPLES  OF  NUMERICAL  COMPUTATIONS 

A.  Hypersonic  flow  of  real  gas 

Since  the  space  plane  flies  more  than  ten 
times  as  fast  as  the  sonic  speed,  the  extremely 
strong  shock  wave  appears  ahead.  The  strong 
compression  behind  the  strong  shock  wave  causes  the 
high  temperature  more  than  ten  thousand  degree  near 
the  plane.  Thus  the  nitrogen  and  oxigen  in  the 
atmosphere  dissociate,  consequently  the  usual 
assumption  of  perfect  gas  no  longer  holds  good  and 
it  becomes  necessary  to  include  the  effect  for  the 
real  gas.  In  this  example  the  elemental  reactions 
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for  7  components  of  N,,  0,,  N,  0,  NO,  NO*,  e  are 
considered  as  the  dissociation  in  order  to  include 
this  real  gas  effect.  In  the  case  of  the  space 
plane,  when  the  shock  wave  strikes  the  wing,  the 
plane  suffers  the  very  severe  aerodynamic  heating. 
Therefore  the  prediction  for  the  situation  of  shock 
wave  is  very  important  and  the  correct  evaluation 
for  the  real  gas  effect  is  necessary.  In  Fig.l  are 
shown  the  numerical  solution  for  the  hypersonic  flow 
of  Mach  number  15.7  around  the  Space  Shuttle  with 
the  real  gas  effect  included.  The  distribution  for 
the  mole  fraction  of  the  atomic  oxigen  produced  by 
the  dissociation  is  displayed  in  the  figure.  The 
atomic  oxigen  near  the  nose  of  the  plane  is 
transported  with  fluid  to  gather  to  the  center  parts 
on  both  the  upper  and  lower  surfaces  separately. 
Further  on  the  upper  surface  it  is  transproted  with 
the  separated  fluid  to  spread  over  the  plane  again. 

B.  Chemically  reacting  flow  in  a  combustor 

As  the  computation  of  chemically  reacting  flow 
has  been  possible  with  the  progress  of  computers, 
the  computational  condition  of  this  example  is 
almost  adapted  to  the  actual  experimental  one  for 
the  SCRAM  jet  engine.  The  foundation  of  physical 
phenomenon  in  the  SCRAM  engine  is  that  the  hydrogen 
blows  up  into  the  high  temperature  gas  and  burns. 
For  the  combustion  it  is  necessary  to  introduce  the 
reacting  model.  In  the  Westbrook  reacing  model  9 
chemical  species  of  N,,  H,,  0,,  OH,  1I20,  H,  0,  H,0, 
and  HO,  are  considered  and  17  elementary  reaction 
steps  are  contained.  The  chemically  reacting  flows 


Mach  Number15.7 
Angle  of  AUack=42.0‘ 


MOLE  FRACTION  OF  OXYGEN  ATOM 


in  the  combustor  where  the  hydrogen  blows  up  have 
been  numerically  solved  using  the  TVD  scheme  for  the 
governing  equation  system  above  stated.  An  example 
is  shown  in  Fig. 2  ,  where  iso-Mach  contours  are 
shown.  Thus  by  the  CFD  it  is  possible  to  see  the 
floi.  details  such  as  the  Mach  disk  formed  by  the 
blow,  which  is  difficult  to  measure  by  experiments. 
Since  the  problem  of  turbulence  in  reacting  flows 
remains  almost  unsolved,  however,  the  reacting  ratio 
does  not  show  a  good  agreement  between  the  numerical 
solution  and  the  experiments.  The  reason  is  that 
the  reacting  ratio  greatly  depends  on  the  mixing  of 
hydrogen  and  oxigen,  which  the  turbulent  diffusion 
governs.  The  problem  of  turbulence  in  reacting  flows 
would  be  a  important  researching  theme  in  the 
future. 


V.  CONCLUDING  REMARKS 

By  the  development  of  CFD  till  now,  it  has  been 
possible  to  obtain  the  numerical  solutions  which 
hold  good  to  some  extent  for  a  large  variety  of 
problems.  The  problems  for  not  only  chemical 
reaction  but  also  radiation  and  electro  magnetic 
fluid  dynamics  can  be  numerically  solved  without 
difficulty  if  costing  much  time.  It  may  fairly  be 
said  that  the  final  problem  still  remained  is  the 
turbulence  that  is  a  remarkable  characteristics  of 
the  non-linear  fluid  motions. 
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Abstract 

Stationary  states  at  high  temperatures  and  pressures  in  Iso-Octane  (2- 
2-4  Trimethylpentane)  were  achieved  behind  a  compression  shock 
wave  reflected  from  the  shock-tube  end  wall.  The  end  states  cover  a 
broad  region  including  vapor,  liquid,  and  mixture  phases. 
Measurements  of  shock  velocity,  pressure,  and  temperature  were 
performed  together  with  extensive  photographic  observation  of  the 
final  states  through  a  sapphire  window  mounted  at  the  end  of  the 
shock-tube  observation  chamber.  In  general,  phase  changes 
resulting  from  the  shock  compression  of  a  retrograde  substance  are 
predicted  reasonably  well  with  the  equilibrium  Rankine-Hugomot 
model.  Photographic  observations  of  the  end  states  show  a  rich 
variety  of  two-phase  vortex  rings,  depending  on  initial  conditions 
and  shock  strength. 

Introduction 

Adiabatic,  pressure  driven,  finite  amplitude  waves  resulting  in  phase 
changes  -  from  vapor  to  liquid  or  liquid  to  vapor  -  have  been 
observed  in  retrograde  fluids.  Unlike  thermally  driven  phase 
transitions  in  regular  fluids  such  as  water,  these  waves  result  from  a 
jump  in  pressure.  Recent  work  on  the  subject  includes  complete  and 
partial  liquefaction  shocks  [1],  rarefaction  shock  from  a  critical  state 
[2],  shock  splitting  [3],  and  mixture  evaporation  rarefaction  shock 
[4],  In  this  work  rapid  phase  change  phenomena  in  the  general 
vicinity  of  the  critical  point  arc  investigated.  Thermodynamic,  vapor- 
liquid  critical  point  as  described  by  modern  power  laws  [5J  is  a 


Figure  1.  x-t  diagram  of  the  shock-tube  flow.  The  closed  end  of  the 
test  section  is  at  right.  Arabic  numerals  designate  test  fluid  states. 
I=incidcnt  shock,  R=rcflcctcd  shock,  CS=Contact  surface,  D= Driver 
gas  initial  state.  Not  to  scale. 


singular  point  of  infinite  isothermal  compressibility  and  constant 
volume  specific  heat  (hence,  in  principle,  zero  soundspeed.)  A 
recent  study  of  nonequilibrium,  near-critical  states  in  shock  tube 
experiments  revealed  a  minimum  in  the  soundspeed  (about  10  mis) 
and  disappearance  of  two  distinct  phases  at  a  pressure  ca.  25%  above 
the  critical  value  [6]. 

Theory  ^  Results 

The  x-t  diagram  of  the  reflected  shock  system  is  shown  in  Figure  1. 
Figure  2  shows  a  detailed  reflected  shock  adiabat  on  a  P-v  surface. 
The  adiabat  crosses  the  phase  boundary  but  the  process  is  so  fast  that 
the  condensation  is  delayed  until  the  limit  of  supersaturation,  Wilson 
line,  is  reached  whereupon  a  spontaneous  collapse  of  the  metastable 
state  occurs.  If  the  shock  strength  is  such  that  the  end  state  lies 
below  point  2  (triple  point)  two  distinct  discontinuities  arc  observed: 
a  forerunner,  "dry"  shock  and  a  condensation  discontinuity  [3].  In 
our  experiments  the  shock  Mach  numbers  arc  high  enough  that  the 
end  states  lie  above  the  triple  point  and  a  single  liquefaction  shock 
front  exists. 


Figure  2.  Pressure-volume  diagram  of  the  reflected  shock. 
EA=cqui!ibrium  adiabat  (liquefaction  shock);  DA=dry  adiabat  (non¬ 
equilibrium,  mctastablc,  supersaturated  vapor);  R=Rayleigh  line; 

ct=saturated  vapor  boundary;  W=\Vilson  line  (line  of  critical 
supersaturation);  2=triple  point  (see  [3]  for  details.) 

In  the  calculations  Rankine-Hugoniot  equation  is  used  together  with  a 
virial-typc,  corresponding  states  equation  of  state  which  is  modified 
to  represent  the  near-critical  region  more  accurately.  Figure  3 
shows  experimental  data  for  a  reflected  shock  system  which  passes 
through  the  theoretic!  critical  point.  The  agreement  with  the 
calculations  is  quite  good.  Nonetheless,  there  is  a  systematic 
deviation  in  temperatures  measured  by  very  thin  ( 5x10  15  in 
diameter),  fast  response  thermocouples.  They  arc  lower  than 
calculated  values  by  ca.  5  to  10eC  depending  on  the  shock  strength. 
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Jn  addition  to  the  measurement  of  temperature  and  pressure, 
photographic  observations  are  made  for  different  incident  shock 
Mach  numbers.  Four-different  initial  conditions  are  chosen -with 
resulting  reflected- shock  adiabats  shown  in  Figure  4.  Particular 


Figure  3.  Pressure  and  temperature  behind  reflected  shock.  T0-13u 
°C,  Po-0.445  bars,  a  -  vapor  pressure  line,  c.p.=  critical  point. 

emphasis  was  given  to  the  end  states  where  the  shock  adiabat  crosses 
saturated  vapor  and  liquid  boundaries.  Designation  of  these  regions 
are  as  shown  in  Figure  4  and  a  description  of  the  nature  of  the 
associated  phase  change  phenomena  is  given  in  Table  1.  Except 
from  the  region  on  the  saturated  vapor  boundary  far  from  the  critical 
point  (Figure  5  a),  two-phase  vortex  rings  are  consistently  observed 
both  on  saturated  vapor  and  liquid  boundaries.  The  vortex  rings  are 
thought  to  be  a  direct  result  of  steep  pressure  and  density  gradients 
across  the  shock  wave  acting  upon  the  nuclcation  clusters.  In 
regions  SL1  or  SL2  (Figure  5  b&c,  respectively),  a  group  of  large, 
turbulent  vortex  rings  amongst  thousands  of  tiny,  small-scale,  newly 
born  vortex  rings  have  been  observed.  Vortex  rings  which  are 
formed  become  turbulent  within  a  few  tens  of  microseconds  and 
turbulent  vortex  rings  grow  linearly  with  time  (Figure  6.)  Vortical 
structures  near  the  critical  point  (Figure  5  d&e)  arc  even  more 
turbulent  and  diffuse.  It  is  important  to  note  that  the  critical  point  we 
are  referring  to  is  the  one  calculated  by  the  equation  of  state.  The 
proximity  of  the  observed  states  to  the  actual  ,  non-equilibrium 
critical  point  is  open  to  discussion. 

Unique  and  fascinating  structures  are  observed  in  region  SV3  (Figure 
5  f.)  These  are  circular,  two-phase  structures  with  apparent  rays 
radially  emanating  from  the  center.  As  the  end  states  approach  the 
critical  point,  i.c.  regions  SV4  and  SV5  (Figure  5  g&h, 
respectively),  these  ray  structures  still  can  be  seen. 

The  structure  of  the  liquefaction  shock  front  can  be  divided  into  two 
parts.  A  frozen  divcuiiunuitv  dumtnated  by  the  vivcuMly  and  thermal 
conductivity,  typically  a  few  mean  free  paths  wide,  followed  by  a 
considerably  longer  relaxation  zone  where  nuclcation  and  droplet 


growth  rake  place.  The  compression  rate  across  the  frozen  part  of  the 
shock  is  so  high  that  the  nudeation  process  lags.  There  are  mainly 
three  relaxation  processes,  inertial  re'axation  (there  is  a  velocity  slip 
between  droplets  and  suddenly  decelerated  vapor),  droplet 
temperature  relaxation,  and  vapor  thermal  relaxation.  To  give  a 


Shock  Adiibat 

States  behind  the 
reflected  shock 

Description  of  phase  change 

A 

Liquid  Saturation 
Boundary:  SLI 

Vapor  Saturation 
Boundary  :  SVl 

Welldeftnd  two -phase  vortex  rings 
in  liquid  or  dense  gas 
Condensation  in  a  nonr-ai  fashion 
in  vapor 

B 

Liquid  Saturason 
Boundary;  SL2 

Vapor  Saturation 
Boundary:  SV2 

Well  defind  two  -  phase  vortex  rings 
in  liquid  or  dense  gas 
Condensation  in  a  normal  fashion 
in  vapor 

C 

Near  Critical 

Report  :  NC 

Vapor  Saruadon 
Boundary ;  SV3 

Feathery,  more  diffuse  and  turbulent 
two  •  phase  vortex  rings 

Interesting  ray  structure  in 
condensation  in  vapor 

D 

Vapor  Saturation 
Boundary:  SV5 

Vapor  Saturation 
Boundary:  SV4 

Ray  structure,  two  •  phase  vortex 
rings  in  vapor 

Ray  structure,  two  ■  phase  vortex 
rings  in  vapor 

Table  1.  Summary  of  phase  changes  on  the  vapor  and  liquid 
saturation  boundaries. 

numerical  example,  an  incident  shock  ( Mo=2.46 )  produces  a  two- 
phase  mixture  equality  x-0.33)  after  reflection  from  the  end  wall. 
The  width  of  the  frozen  discontinuity  is  computed  to  be 
approximately  0.05  pm  (ca.  5  mean  free  paths)  with  a  resulting 
supersaturation  of  5=2.3. 

Approximate  calculations  showed  droplet  temperature  relaxation  (ca: 
4x1  O'15  sec.)  to  be  much  faster  than  inertial  relaxation  which  is  itself 
approximately  one  order  of  magnitude  faster  than  vapor  thermal 
relaxation  (  7xlO~10  and  1x1  O'9  sec.,  respectively.)  Numerical 
integration  of  the  equations  of  motion  coupled  with  a  suitable 
nuclcation  and  droplet  growth  model  will  yield  more  accurate 
description  of  the  liquefaction  shock  structure. 


Figure  4.  Four  reflected  shock  adiabats  A.8.C,  and  D  along  which 
i?unc  vva^“  increasing  shock  Mach  numbers.  SLI , 
SL2,  5V  /,  51 2,  SV3,  SV4,  SV5,  and  NC  designate  regions  where 
extensive  photographic  observations  arc  made  (see  also  Table  1  ) 
Drawing  is  not  in  scale. 
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Conclusion 

Photographic  observations  show  a  variety  of  new  and  rich 
phenomena  associated  with  rapid  phase  changes  across  the 
liquefaction  shock  front.  Two-phase  vortex  rings  are  formed  by  the 
pressure  gradient  across  the  shock  front  acting  upon  the  nucleation 
sites  which  are  denser  than  the  surrounding  gas.  Vortex  rings 
quickly  become  turbulent  upon  formation  and  grow  linearly 
thereafter.  Measured  downstream  pressures  agree  well  with 
equilibrium  calculations,  whereas  temperature  measurements  are 
lower  than  computed  values.  The  results  are  mainly  qualitative  and 
current  efforts  focus  on  quantitative  description  of  the  vortex 
formation  and  liquefaction  shock  structure. 


Figure  6.  Average  vortex  ring  diameter  versus  time.  Vortex  rings  arc 
produced  in  Region  NC.  To=I30°C,  P 0-0.445  bars. 
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Figure  5.  Photographs  taken  during  the  rapid  phase  change 
experiments  through  a  sapphire  window  mounted  at  the  end  wall  of 
the  shock-tube.  See  Figure  5  and  Table  1  for  region  designations,  a) 
Region  517,  Mo=2.46;  b)  Region  SL1,  Mn=2.94;  c)  Region  SL2, 
i l/o=2.S5;  d)  Region  VC,  M0=2.S2 ;  c)  Region  NC,  Mo=2.S7 ;  0 
Region  517,  Mo=2.30 ;  g)  Region  SV4,  Mn=2.33;  h)  Region  Sl'5, 
M0=2.7S. 
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Abstract  —  We  examine  steady  transonic  flows  of  Bethe-rZel’dovich— 
Thompson  (BZT)  fluids.  An  extension  of  the  transonic  small  disturbance 
equation>valid  in  the  neighborhood  of  one  of  the  zeros  of  the  fundamental 
derivative,  is  presented.  Numerical  solutions  reveal  that  the  natural 
dynamics  of  these  fluids  may  result  in  a  significant  increase  in  the  critical 
Mach  number.  We  also  report  transonic  flows  involving  both  expansion 
and  compression  shocks  in  the  same  flowfleld. 

I.  INTRODUCTION 

Transonic  flows  arc  inherently  nonlinear  and  are  typically 
accompanied  by  shock  formation  in  the  hyperbolic  portions  of  the  flow. 
Because  of  the  strong  adverse  pressure  gradients  associated  with 
compression  shocks,  shock— induced  separation  is  a  major  concern  in  the 
design  of  transonic  turbomachinery.  Such  separation:  is  a  major  loss  and 
vibration  mechanism.  The  process  of  shock  formation  is.due  to  the 
intrinsic  nonlinearity  of  the  fluid.  As  a  result,  it  has  been  assumed  that 
all  flows  behave  generally  the  same  as  predicted  by  the  perfect  gas  theory 
and  most  work  has  addressed  blade  design  to  minimize.these  effects. 

The  appropriate  measure  of  the  intrinsic  nonlinearity  of  the  fluid 
is  the  thermodynamic  parameter 


r 


V3  d2P 

2a2  dV 2  s’ 


(1) 


where  V,  p  and  a  are  the  fluid  specific  volume,  pressure  and  entropy.  The 
quantity 


a  5  V[_fv|s)1/2,  <2> 

is  the  thermodynamic  sound  speed.  Here  we  follow  Thompson  (1]  in 
referring  to  (1)  as  the  fundamental  derivative  of  gasdynamics.  Inspection 
of  (1)  indicates  that  T  is  a  measure  of  the  curvature  of  the  isentropes. 

Recent  studies  have  shown  that  the  gasdynamics  of  fluids  having 
relatively  large  specific  heats  may  be  qualitatively  different  than  that  of 
lighter  substances  such  as  air  and  water.  The  mam  objective  of  the 
present  study  is  to  examine  the  behavior  of  these  fluids  in:the  transonic 
regime.  In  particular,  it  will  be  shown  that  use  of  these  fluids  results  in 
significant  increases  in  the  critical  Mach  number,  thereby  decreasing  the 
range  flow  speeds  at  which  the  undesirable  transonic  flow  effects  arc 
observed. 

The  fluids  of  interest  here  are  those  for  which  T  <  0  for  a  finite 
range  of  pressures  and  temperatures.  Ihe  conditions  undcr  which  T  c.  0 
where  first  given  by  II.  A.  Bcthe  [2]  and  Ya.  B.  Zel'dovich  [3],  who 
demonstrated  that  fluids  having  relatively  large  specific  heats  will  have  a 
region  of  negative  F  in  the  fluid's  dense  gas  regime.  The  general  region 
where  T  <  0  is  depicted  in  Figure  1  where  the  isentropes  of  normal  decant 
have  been  computed  and  plotted  on  a  p— V  diagram.  The  regions  of 
downward  curvature  correspond  to  F  <,  0.  Further  examples  of  common  i,. 
encountered  fluids  having  F  <  0  have  been  provided  by  Thompson  and 
co-workers  [5],  (6],  and  Cramer  (Tj.  Because  of  the  contribution  of  the 
early  workers  in  this  area,  we  refer  to  fluids  possessing  a  region  of  F  c,  u 
in  the  single— phase  regime  as  Bcthe— Zct  dov.ch— Thompson  vBZIj  fluids. 

The  significance  of  BZT  fluids  is  that  the  well-known 
compression  shocks  of  the  perfect  gas  theory  violate  the  entropy  inequality 
and  disintegrate  into  centered  fans  if  T  <0.  Expansion  shocks,  normally 
forbidden  m  the  perfect  gas  theory,  not  only  form  from  smooth  waves  but 
are  seen  to  satisfy  the  entropy  inequality  in  flows  having  F  <  0 
everywhere.  It  therefore  appears  that  the  natural  dynamics  of  BZI  fluids 
may  lead  to  a  reduction  or  even  elimination  of  shock-induced  separation. 


Figure  1.  Computed  isentropes  for  n-decane.  Gas  model  is  the 
1IBMS  [4]  equation  of  state. 


Thus,  there  is  likely  to  be  advantages  in  the  use  of  BZT  fluids  even  in 
supercritical  flows.  For  further  details  of  the  remarkable  dynamics  of  BZT 
fluids,  we  refer  the  reader  to  the  surveys  found  in  References  [I],  [8j-{9j- 

R  TI1E  TRANSONIC  SMALL  DISTURBANCE  EQUATION 

We  consider  small  two-dimensional  disturbances  to  a  near-sonic 
flow  of  a  BZT.  The  usual  assumptions  of  the  transonic  small  disturbance 
theory  will  be  supplemented  by  the  condition  that  the  thermodynamic 
state  of  the  freestream  is  in  the  vicinity  of  one  of  the  zeros  of  the 
fundamental  derivative.  Such  zeros  form  the  boundary  between  the 
positive  and  negative  F  regions  and  are  recognized  as  the  inflection  points 
of  the  isentropes  in  Figure  1.  With  this  freestream  state  the  small 
perturbations  caused  the  thin  blade  can  take  the  flow  from  regions  of 
pvsilivc  to  negative  T  and  vice  versa.  In  this  sense,  the  flow  will  be 
qualitatively  similar  to  those  involving  larger  amplitudes.  Furthermore, 

.he  most  complex  and  interesting  features  occur  when  the  nonlinearity  is 
mixed.  When  these  assumptions  arc  incorporated,  Cramer  [8]  has  shown 
.hat  the  extension  of  the  classical  transonic  small  disturbance  equation  is 

[m2-1  +2r  <5  -A02]<5  =$  ,  (3) 

[  ©  arx  rxJ  rxx  *yy*  '  ' 

with  the  usual  boundary  conditions  at  the  blade  and  at  Infinity.  Here  $ 

Is  a  nondime nslonal  velocity  potential,  x  Is  the  scaled  distance  In  the 
freestream  direction  and  >  Is  the  sealed  distance  norma*  to  the  freestream. 
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The  Mach  number  and  fundamental  derivative  m  the  freestream  are 

denoted  by  M  and  F  ,  respectively.  The  parameter 
00  0) 

a=^I£|s*  w 

where  p  =  V  *  is  the  fluid  density,  is  a  second  nonlinearity  parameter. 
This  is  usually  evaluated  at  the  state  corresponding  to  the  sero  in  the 
local  value  of  F,  without  loss  of  accuracy  to  the  overall  approximation. 
Near  the  large  density  sero  of  F,  typical  values  of  A  are  estimated  to  be 
1.5-2.5.  This  second  nonlinearity  parameter  is  negative  near  the  low 
density  sero  of  F. 

IH.  RESULTS 


the  Mach  numbers  indicates  that  the  flow  remains  entirely  subsonic  That 
is,  the  use  of  a  BZT  fluid  in  the  neighborhood  of  one  of  its  zeros  have 
driven  the  critical  Mach  number  to  values  above  0.9.  Physically,  the 
increase  is  due  to  the  fact  that  tne  expansions  over  the  top  of  the  blade 
has  shifted  the  flow  into  the  T  <  0  regime  before  the  sonic  state  is 
reached.  As  pointed  out  in  References  [1],  [8],  and  [10]  acceleration 
through  the  sonic  condition  is  then  difficult,  if  not  impossible.  In  order  to 
save  space,  we  refer  the  reader  to  ‘.hese  previous  studies  for  a  detailed 
account. 

The  increase  in  the  critical  Mach  number  is  by  no  means  an 
isolated  case.  Further  detailed  studies  suggest  that  blade  configurations 
giving  rise  to  a  critical  Mach  number  of  0.69  in  air  may  correspond  to  a 
critical  Mach  number  over  0.98  in  many  of  the  BZT  fluids  described  in 
Reference  [6]  or  [7]. 


Numerical  solutions  to  (3)  have  been  generated  through  use  of  an 
extension  of  the  Murman-Cole  scheme.  The  boundary  conditions  were 
those  of  a  circular  airfoil.  The  results  of  these  calculations  are  depicted  m 
Figures  2—i.  In  order  to  check  the  scheme,  calculations  for  a  classical 
(A=0)  case  were  carried  oat.  Here  F^  =  0.4,  Ma  =  0.9  and  the 

half— thickness  of  the  circular  arc  airfoil  was  taken  to  be  0.06  of  the  chord 
The  flow  is  from  left  to  right.  Scaled  values  of  the  pressure  coefficient  are 
plotted  in  Figure  2.  Here  it  is  seen  that  the  given  Mach  number  is 
considerably  above  the  critical  value  with  the  shock  well  back  on  the 
wing. 


M 


Figure  2.  Scaled  pressure  coefficient  cp  over  a  circular  arc  airfoil. 

~  0-4,  A  =  0,  =  0.9  and  the  thickness  is  0.06  of 

the  chord. 


n 


Figure  3. 


Scaled  pressure  coefficient 

All  conditions  are  identical  to 
that  A  =  1.0. 


over  a  circular  arc  airfoil, 
those  of  Figure  2  except 


To  determine  the  influence  of  the  new  term  in  (3}  we  then 
examined  the  same  case  with  A  =  1.  Because  A  >  0  the  undisturbed 
state  is  near  one  of  the  high  pressure  zeros  of  T,  this  point  corresponds  to 
the  high  pressure  inflection  points  on  the  isentropes  of  Figure  J.  The 
results  of  these  calculations  are  found  in  Figure  3.  Here  it  is  seen  that  the 
large  compression  shock  has  entirely  vanished..  A  detailed  examination  of 


As  a  final  example,  we  have  retained  the  same  upstream 
thermodynamic  state  as  used  in  Figures  2—3,  but  have  raised  the  Mach 
number  to  0.93,  approximately.  In  this  case,  the  flow  is  able  to  achieve 
sonic  conditions  before  the  T  =  0  point  is  reached.  The  result  is  plotted 
in  Figure  4.  In  this  supercritical  flow,  two  shocks  appear.  The  first 
(leftmost)  is  an  expansion  shock  which  is  followed  by  a  compression  shock. 
This  is  in  marked  contrast  to  classical  theory  where  no  more  than  one 
shock  can  occur. 


n 

Figure  4.  Scaled  pressure  coefficient  c  over  the  circular  ar  airfoil  of 

P 

Figures  2  and  3.  F^  =  0.4,  A  =  1.0  and  Mm  =  0.93. 


IV.  SUMMARY 

The  preceding  has  introduced  a  modified  form  of  the  transonic 
small  disturbance  equation  valid  when  the  freestream  is  in  the  vicinity  on 
one  of  the  seres  of  the  fundamental  derivative  of  a  BZT  fluid.  The 
numerical  results  demonstrate  that  the  natural  dynamic*  of  BZT  fluids 
can  give  rise  to  significant  increases  in  the  critical  Mach  number  as  well  as 
qualitative  differences  in  the  details  of  supercritical  flows. 

The  author  would  like  to  thank  G.  M.  Tarkcnton  for  providing 
the  plots  of  Section  3,  and  Dr.  H.  A.  McGee  and  students  for  providing 
the  code  for  the  generation  of  Figure  1.  This  work  was  supported  by  the 
National  Science  Foundation  under  grant  #CTS-6313198. 
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Abstract.  A  ncv.  high- resolution  spectral  model  has  been  developed  for  the 
production  of  medium  range  forecasts  at  ECMWF.  Considerable  efficiency 
gains  were  required  to  make  this  model  opeiationally  piacth-ole,  rhese 
were  realized  principally  by  the  introduction  of  a  reduced  compuiauonal 
grid  and  a  semi  Lagrangian  integration  scheme. 


Current  plans  for  the  operational  ECMWF  spectral  model 
(Simmons  et  al.,1589)  include  a  doubling  of  the  horizontal  resolution  from 
T106  (a  triangular  truncation  at  wavenumber  106)  to  T213,  with  a 
corresponding  Increase  in  the  number  of  vertical  levels  from  19  to  31. 

Two  new  ingredients  of  the  numerical  integration  procedure  arc 
essentialrin  order  to  produce  timely  operational  forecasts  with  this  high- 
resolution  model,  given  the  constraints  of  the  present  computer  system. 

The  first  is  the  use  of  a  reduced  Gaussian  grid  (Hortal  and 
Simmons, 1991)  for  the  computation  of  nonlinear  terms;  in  this  grid,  the 
number  of  points  per  latitude  row  is  decreased  towards  the  poles  so  that  the 
cast-west  gridlength  remains  approximately  constant.  The  compulation  per 
timestep  is  thereby  reduced  by  around  25%,  with  very  little  impact  on  the 
resulting  forecast. 

The  second  ingredient  is  the  introduction  of  a  scmi-Lagrangian 
scmi-implicit  time-integration  scheme,  which  overcomes  the  stability 
criterion  of  the  conventional  Eulcrian  treatment  of  advcction  (spectral  in 
the  horizontal,  finite  difference  in  the  vertical).  The  scmi-Lagrangian 
formulation  is  basically  similar  to  the  fully  three  dt  aensional  interpolating 
version  of  Ritchie  (1991),  there  are  however  additional  comphcauons 
resulting  from  the  use  of  a  hybrid  vertical  coordinate  rather  than  the  sigma- 
coordinate  of  Ritcliic’s  model.  On  the  other  hand,  the  vertical  discretization 
by  finite  differences  and  the  purely  algebraic  climinatic-i  between  vanablcs 
in  the  solution  of  the  semi-implicit  equations  both  lead  to  some 
5001||>U  L  CJG  Da y  3  T21313I 


Fig  1.  t-day  forecast  of  500hPa  height  field,  T213  31-lcvcl  Eulcnan 
model,  3-minute  timestep. 


simplifications  compared  with  Ritchie's  scheme  (/tnile-elemem  verucal 
disercuzauon  and  partly  analyuc  elira.,iauon).  The  opportunity  was  also 
tax.cn  to  reduce  the  number  oi  transforms  between  spnenual  harmonic  space 
and  the  model  gnd  (Tcmpcrton,1991y.  At  rcsoluuon  T213,  the  Legendre 
transforms  account  for  only  about  10%  of  the  CPU  time  of  the  new  model. 

Tests  have  shown  that  the  Eulerian  version  of  the  T213  31-lcvcl 
model  requires  a  3-minute  timestep  to  maintain  stability,  while  the  scmi- 
Lagrangian  version  remains  stable  and  accurate  with  a  20-minute  umestep. 
In  addiuon  lo  the  gains  already  obtained  from  the  use  of  the  reduced  gnd, 
the  scmi-Lagrangian  scheme  yields  a  further  factor  of  about  5  in  the 
efficiency  of  me  model.  To  demonstrate  that  the  scmi-Lagrangian  version 
of  the  1213  31-lcvcl  model  gives  essentially  the  same  forecasts  as  its 
Eulcnan  counterpart,  Figs.  1  and  2  show  the  corresponding  3-day  forecasts 
of  the  500  hPa  height  field  starting  from  the  operational  ECMWF  analysis 
at  12Zon  15th  April  1990. 
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INTEGRATION  OF  A  GLOBAL  MULTILEVEL  MODEL  USING  A  VECTOR  SEMI-LAGRANGIAN  SCHEME  WITH  A  MULTIGRID  SOLVER 
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Greenbeltj  Iffi  20771 

Abstract 

A  three-dimensional  semi-Lagrangian  semi-implicit 
two-time-level  finite-difference  integration 
scheme  for  the  primitive  equations  of  atmospheric 
motion  on  the  sphere  is  presented.  A  trajectory- 
centered  discretization  of  the  governing  equations 
is  used,  the  momentum  equation  being  discretized 
in  vector  form  before  being  resolved  into 
components.  For  the  horizontal  differencing 
a  C-grid  is  used,  while  a  Lorenz-grid  in 
^-coordinates  is  used  in  the  vertical.  The 
discretized  equations,  which  involve  a  coupling 
between  all  levels,  are  decoupled  by  means  of  a 
linear  transformation,  resulting  in  a  set  of  K 
(-  number  of  levels)  two-dimensional  elliptic 
equations  to  be  solved.  With  an  appropriate 
formulation  of  the  discretized  governing  equa¬ 
tions,  these  elliptic  equations  have  a  form 
identical  to  that  encountered  in  an  earlier 
shallow  water  model  (Bates  et  al.,  1990).  The 
two-dimensional  multi-grid  solver  used  in  the 
shallow  water  case  can  thus  be  used  to  provide 
an  efficient  solution  for  the  multilevel  case. 

A  linear  stability  analysis  of  the  scheme  on  an 
f-plane  in  the  absence  of  a  mean  flow  shows  that 
the  scheme  is  unconditionally  stable. 

Numerical  integrations  are  performed  using  an 
adiabatic  version  of  the  model,  both  with  and 
without  orography  and  divergence  damping.  The 
results  of  these  integrations  with  varying  time 
steps  and  with  both  idealized  and  observed 
initial  conditions  will  be  presented. 
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A  GLASS  OP  MONOTONE  INTERPOLATION  SCHEMES1 

PIOTR  K.  SMOLARKIEWICZ  and  GEORG  A.  GRELL 

National  Center  for  Atmospheric  Research2 
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ABSTRACT 

The  practice  of  computational  fluid  dynamics  often 
requires  accurate  as  well  as  nonoscillatory  interpolation 
procedures.  Such  procedures,  often  referred  to  as  shape¬ 
preserving  interpolation,  may  be  employed  to  design 
monotone  advection  transport  algorithms.  This  paper 
poses  an.inverse  problem.  A  variety  of  monotone  advection 
schemes  with  attractive  properties  has  been  developed  over 
the  last  two  decades  abstracting  from  any  arguments  that 
invoke  explicit  interpolation  procedure.  Our  goal  is  to 
provide  a  formalism  allowing  the  exploitation  of  these 
advection  algorithms  as  shape  preserving  interpolators. 
The  central  theoretical  issue  concerns  a  formal  equivalence 
of  the  advection  and  interpolation  operators  on  discrete 
meshes.  Through  elementary  arguments  exploiting  either 
the  Stokes  theorem  or  the  untruncatcd  Taylor  formula  at 
0-th  order  of  expansion,  one  may  show  that  the  solution 
to  an  interpolation  problem  can.be  expressed  as  a  formal 
integral  of  the  advection  equation.  As  a  consequence, 
the  interpolating  operate"-  on  a  discrete  mesh  may  be 
represented  by  an  advection  scheme,  in  which  the  local 
Courant  number  vector  is  replaced  by  the  normalized 
displacement  between  a  grid  point  and  a  point  of  interest 
to  the  interpolation  procedure.  The  accuracy  of  the 
resulting  interpolation  scheme  is  that  of  the  advection 
scheme  employed. 


Among  a  variety  of  available  advection  schemes, 
the  dissipative  (forward-in-time)  algorithms  are  the  .most 
suitable  for  practical  applications.  Since  the  effective 
velocity  field  is  constant  for  every  point  of  interest 
to  the  interpolation  procedure,  these  advection  schemes 
retain  their  formal  accuracy  of  the  constant  coeffcients 
limit.  Constancy  of  the  effective  velocity  in  an  arbitrary- 
dimensional  problem  allows  for  a  straightforward  alternate- 
direction  implementation  of  one-dimensional  advection 
schemes  without  introducing  errors  characteristic  of -the 
time-split  advection  procedures  in  variable  flows. 

Insofar  as  the  linear  dissipative  advection  schemes  are 
concerned,  there  is  no  particular  gain  from  such  an  excercise 
as  the  resulting  interpolators  may  be  alternatively  derived 
with  the  help  of  more  traditional  arguments  invoking  either 
the  truncated  Taylor  formula  or  Lagrangian  polynomial 
fitting.  -However,  when  the  preservation  of  monotonicity 
and/or  sign  of  the  interpolated  variable  is  essential,  then  the 
approach  adopted  becomes  useful.  For  instance,  a  variety 
of  monotone  (and  sign-preserving)  interpolation  schemes 
of  different  overall  accuracy  and  complexity  levels  may  be 
generated  using  Flux-Corrected-Transport  (FCT)  versions 
of  high-order-accurate  dissipative  schemes.  The  utility  of 
such  monotone  interpolators  is  illustrated  with  examples 
of  applications  to  selected  problems  of  atmospheric  fluid 
dynamics. 


1  An  article  of  the  same  title  has  been  submitted  to  J.  Comp.  Phys.,  the  preprints  arc  available  from 
the  authors  upon  request. 

2  The  National  Center  for  Atmospheric  Research  is  sponsored  by  the  National  Science  Foundation. 
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Terrain-following  vs.  a  blocking  system  for  the  representation  of 
mountains  in  atmospheric  models 
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Abstract,  issues  of  the  numerical  representation  of  mountains  in 
atmospheric  models  are  reviewed.  An  example  is  given -illustrating  the 
origin  of  the  most  frequently  considered  type  of  errors  resulting  from 
terrain-following  coordinates.  Finally,  a  forecast  obtained  with  the 
model  using  a  so-called  step-mountain  coordinate  is  compared  with  that 
obtained  when  the  same  model  is  run  with  a  standard  terrain-following 
(sigma)  coordinate. 

I.  INTRODUCTION 

Since  Its  introduction  by  Phillips  in  late  fifties  the 
terrain-following  vertical  coordinate  has  been  by  far  the 
most.predomtnant  in  atmospheric  model  mg.  While  a  number 
of  Its  problems  were  recognized  relatively  early,  the 
simplicity  it  offered  for  the  representation  of  mountains 
seemed  to  be  more  than  a  sufficient  compensation  for  the 
problems.  Furthermore,  for  longer  than  a  decade,  various 
methods  were  being  devised  to  minimize  the  errors.  These 
techniques  were  addressing  the  finite-difference  metnods 
almost  exclusively  used  at  that  time. 

In  the  early  eighties,  however,  it  became  increasingly 
doubtful  that  the  errors  associated  with  terrain-following 
coordinates  could  indeed  be  adequately  minimized.  It  was 
shown  that  the  accuracy  of  the  calculation  of  the  pressure 
gradient  force  over  steep  mountain  slopes  is  likely  to 
deteriorate  rather  than  Improve  with  an  Increase  in 
vertlcalresolutlon.  On  the  other  hand,  a  different 
technique  using  step-like  representation  of  mountains  with 
approximately  horizontal  coordinate  surfaces  was  proposed 
and  appeared  to  be  an  attractive  alternative.  For  a 
comprehensive  review  of  these  various  techniques  proposed 
up  to  the  mid-elghtles  as  well  as  a  description  of  the 
step-mountain  system  the  reader  Is  referred  to  Mesinasr 
and  Jan  |  id  (1985). 

Efforts  aimed  at  reducing  or  eliminating  the  pressure 
gradient  force  errors  continued  (e.g.,  Zheng  and  Liou  1986, 
Carroll  et  al.  1987),  At  the  same  time,  new  examples  of 
potentially  large  errors  were  reported  with  regard  to  the 
terrain-  following  coordinate  scheme  In  spite  of  a 
sophlslcated  design  (Mesinger  and  Janj id  1987).  A 
comprehensive  step-mountain  ("eta")  coordinate  model  was 
developed  and  in  extensive  tests  has  been  shown  to  be 
competitive  with  an  operational  state-of-the-art  terrain 
following  coordinate  model.  While  evidence  was  presented 
Indicating  that  the  numerics  of  the  model  were  primarily 
responsible  for  the  improved  results  (Mesinger  et  al.  1990;, 
no  assessment  was  made  of  the  extent  to  which  the 
improvement  came  from  the  vertical  coordinate  as  opposed 
to  other  numerical  features  of  the  model. 

A  recentstudy  by  Janjid  (1989)  shows  that  In  spectral 
models,  now  dominant  In  global  weather  and  climate 


emulations,  pressure  gradient  force  errors  might  be  still 
greater  than  In  finite-difference  models.  Only  the 
terrain-following  formulation  appears  to  be  practical  for 
spectral  models  at  present  however. 


II.  AN  ASYMPTOTIC  LIMIT  OF  THE  ERROR 

An  example  which  lends  Itself  to  analytic  treatment  and 
is  useful  for  assessing  errors  of  various  schemes  is  that  of 
a  resting  hydrostatic  atmosphere  In  which  the  pressure 
gradient  force  must  be  zero.  6lven  a  numerical  scheme,  an 
assumed  temperature  profile,  and  the  mountain  slope,  the 
pressure  gradient  force  can  typically  be  calculated  In  a 
straightforward  way  which  hopefully  Indicates  the 
magnitude  of  the  error. 

A  recent  calculation  of  this  type  for  three  schemes  and 
three  temperature  profiles  has  been  reported  by  Mesinger 
and  Janjid  (1987).  Of  the  three  schemes,  the  latest  Is  the 
"©-conserving"  scheme  of  Arakawa  and  Suarez  (1983) 
expanded  to  include  horizontal  differencing.  Rather  large 
errors  were  obtained,  at  some  of  the  levels  and 
temperature  profiles,  for  all  three  of  the  schemes.  In 
particular,  a  convergence  problem  was  Identified  in  all 
three  of  the  schemes  in  the  sense  that  no  tendency  was 
visible  for  the  general  magnitude  of  the  error  to  decrease 
with  Increasing  vertical  resolution. 

The  three  schemes  considered  are  identical  for  the  case 
of  an  isentropic  atmosphere  where  the  potential 
temperature  ©  =  0  =  const.  Considering  the  cast  of  zero 
pressure  at  the  top  of  the  model  atmosphere  (pT  =  0)  the 
asymptotic  value  of  the  error  as  thicknesses  of  the  layers 
Ao  tend  to  zero  is 


R0rAxPs*  Ps*  1 

-(AxVk*  — - —  Axp$  ok, 

PqX  '•V'  DcX  -> 
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P$* 


Here  A*  and  y  are  the  centered  two-point  difference  and 
averaging  operators,  respectively,  applied  along  the 
direction  or  the  x  axis;  <f>  is  geopotential;  k  is  the  vertical 
index,  increasing  downward,  Identifying  quantities  defined 
for  the  sigma  layers;  R  is  the  gas  constant;  Po  is  the 
reference  pressure  used  to  define  the  potential 
temperature;  k  is  R/cp,  where  cp  is  the  specific  heat  at 
constant  pressure,  and  p5  is  the  surface  pressure 
Furthermore,  denoting  the  par  ual  derivative  and  Its 
centered  two-point  difference  analog  by  3X  and  Sx, 
respectively,  note  that  in  the  limit  as  Ax  also  approaches 
zero 
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Thus,  in  that  limit,  there  will  be  no  pressure  gradient  force 
error.  However,  for  finite  Ax,  the  right  hand  side  of  tl) 
will  be  different  from  zero,  m  spite  of  the  exact  finite- 
difference  hydrostatic  equation  of  the  three  schemes  in  the 
considered:isentropic  atmosphere  case. 

Attempting  to  reduce  the  problem  by  increasing  the 
horizontal  resolution  actually,  tends  to  worsen  the 
situation  since  the  accompanying  incorporation  of  more 
realistic  mountains  simply  introduces  more  sloping  terrain. 
Thus,  representation  of  mountains  seems  to  be  an  issue  of  a 
steadily  increasing  pi  lority  to  atmospheric  modelers. 

ill.  A  FORECAST  EXAMPLE 

It  is  not  obvious  to  what  extent  pressure  gradient  force 
errors  of  a  specific  idealized  example  are  relevant  in 
actual  atmospheric  simulations.  In  addition,  other 
problems  are  associated  with  terrain  following 
coordinates.  A  potentially  serious  problem  is  that  of 
horizontal  advectlon  with  sloping  coordlnate  surfaces  such 
that  the  vertical  velocity  relative  to  these  surfaces  is 
required  to  compensate  for  their  slope. 

A  study  of  model  performance  in  actual  weather 
situations  thus  seems  to  be  the  ultimate  answer.  It  is  our 
intention  toxomplete  such  a  study,  an  example  will  be 
shown  here.  A  comprehensive  (eta)  prediction  model  was 
employed  which  can  be  used  either  with  a  terrain-following 
or  with  the  step-mountain  coordinate,  the  code  and  the 
schemes  being  the  same.  The  case  to  be  shown  was  the 
first  case  we  looked  at  from  the  point  of  view  of 
sensitivity  to  the  vertical  coordinate  after  an  extended 
period  of  model  development.  It  involves  a  major  cold  air 
outbreak  along  the  eastern  slopes  of  the  Rockies. 

The  U.S.  National  Meteorological  Center  surface  analysis 
for  1200  UTC  2  February  1989  is  shown  in  the  upper  panel 
of  Fig.  l.  The  36-h  sea  level  pressure  forecast  valid  at  the 
same  time  and  obtained  with  the  model  using  the  terrain- 
following  ("sigma")  formulation  is  shown  in  the  middle 
panel.  Finally,  the  36-h  forecast  valid  at  the  same  time 
obtained  using  the  step-mountain  (eta)  coordinate  is  shown 
in  the  lower  panel. 

One  feature  favoring  the  eta  result  is  the  reduced 
noisiness  of  the  eta  integration  with  21  centers  printed  as 
compared  to  27  centers  of  the  sigma  map  Note  that  these 
maps  are  printed  without  the  usual  smoothing  prior  to 
output  so  that  unrealistic  centers  are  obtained  as  the 
result  of  model  noise.  Another  feature  is  the  more 
accurate  simulation  of  the  southward  extention  of  the  cold 
air  east  of'P.oches.  For  example,  note  that  the  sea  level 
pressure  over  North  Dakota  in  the  eta  integration  is  about 
4  mb  higher  than  it  is  in  the  sigma  integration.  Still  higher 
sea  level  pressures  are  seen  in  the  analyzed  map.  We 
intend  to  analyze  such  differences  further  and  to  report  on 
our  results  more  extensively  at  a  later  occasion 
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NUMERICAL  METHODS  FOR  A  UNIFIED  rORECAST/CLIMAI E  MODEL 


Abstract  Finite  difference  methods  which  combine  the 
efficiency  required  for  forecast  models  with  the 
conservation  properties  required  for  long-term  climate 
integrations  are  described.  Methods  of  using 
non-oscillatory  advection  schemes  within  this 
framework  are  discussed. 

I.  INTRODUCTION 

Numerical  methods  for  forecast  models  are  usually 
selected  on  the  basis  of  efficiency  and  accuracy. 
Finite  difference  methods  within  this  category  are  the 
semi-implicit  and  split-explicit  methods,  with  further 
Improvements  available  from  using  semi-Lagranglan 
advection.  In  climate  change  experiments  global 
conservation  properties  must  be  enforced,  and  measures 
taken  to  ensure  satisfactory  long-term  behaviour. 
Correct  treatment  of  the  energetics  is  one  necessary 
requirement. 

This  paper  extends  the  split-explicit  scheme  of  Gadd 
(197$)  to  meet  the  climate  modelling  requirement.  In 
order  to  enforce  conservation  and  balance  the  energy 
conversion  terms  it  is  necessary  to  advect  all  the 
fields  with  a  three-dimensional  velocity  field 
consistent  with  the  continuity  equation.  In  the 
original  split-explicit  method  this  was  not  satisfied 
because  the  vertical  advection  is  carried  out  in  the 
short  timesteps  and  the  horizontal  advection  in  the 
long  timestep.  The  requirements  can  be  satisfied  by 
Instead  Including  the  advection  of  a  basic  state 
potential  temperature  in  the  short  timestep,  and  all 
the  rest  of  the  advection  in  a  long  timestep,  using  as 
the  advecting  velocity  the  average  mass-weighted 
velocity  from  the  short  timesteps.  This  makes  the 
structure  of  a  scheme  similar  to  a  standard 
semi-implicit  scheme.  In  particular,  the  basic  state 
potential  temperature  must  be  chosen  according  to  the 
criteria  established  in  Simmons,  Hoskins  and  Bur'-idge 
(1978). 

Practical  implementation  of  the  scheme  In  a  global 
model  requires  choices  of  numerical  filtering  and 
smoothing  methods  consistent  with  the  requirements. 
Fourier  filtering  In  high  latitudes  is  applied  to 
mass-weighted  velocity  fields,  and  to  mass-weighted 
potential  temperature  and  moisture  increments,  so  that 
conservation  properties  are  retained  and  the  fields 
are  not  distorted.  Numerical  noise  is  removed  with 
conservative  high  order  filters.  The  order  used 
depends  on  the  resolution  of  the  model. 

There  has  been  much  recent  Interest  in  the  use  of 
advection  schemes  which  prevent  the  development  of 
spurious  oscillations,  e.g.  Williamson  and  Rasch 
(1988).  The  most  suitable  way  of  constructing  such 
schemes  within  the  split-explicit  framework  is  that 
introduced  by  Roe  (1983),  where  advective  Increments 
calculated  on  the  boundaries  of  contr  1  volumes  are 
distributed  upwind  or  downwind  according  to  a  suitable 
limiting  criterion.  The  Implementation  of  one  of  these 
is  described. 

II.  A  CONSERVATIVE  SPLIT  EXPICIT  SCHEME 

For  the  purposes  of  this  paper,  the  scheme  is  written 
In  Cartesian  coordinates.  The  extension  to  spherical 
geometry  is  straightforward.  The  equations  required  to 
treat  moisture  are  omitted,  as  are  additional  small 
terns  included  in  the  model  to  allow  more  accurate 
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treatment  of  planetary  scale  flows.  However,  the 
details  depend  critically  on  the  vertical  coordinate, 
and  are  therefore  written  out  for  the  hybrid 
coordinate  actually  used  in  the  model.  The  coordinate 
is  a  mixture  of  pressure  and  normalised  pressure  as 
described  by  Simmons  and  Burridge  (1981). 

Start  with  data  at  time  t  for  velocity  components  u 
and  v,  surface  pressure  p,  and  potential  temperature 
0.  Then  a  series  of  short  timesteps  St  is  taken, 
solving  first 


+  St  if(v 
2 


t+5t+  Vfc) 


■{  5  <t>  +  7“T7  5  [  nk*i 
Ax  1  X  (k+1)  x 1  2 


at  each  level  k,  with  a  similar  equation  for  v.  f  is 
the  Coriolis  parameter,  Cp  the  specific  heat  of  air  at 


constant  pressure, 


where  R  is  the  gas 


constant,  <j>  is  the  geopotential,  and  n  is  the  Exner 

_ .  , _  r ..  ..  „  _ _ r _  _ _  t .. 


function  (p/pQ) 


a  reference  pressure. 


standard  finite  difference  averaging  notation  is  used. 
The  hydrostatic  equation  is  approximated  by 
K  ~  ~  Z^’'cr>0  01  -  H  )  + 

k  P  n  m»  1/2  m- 1/2 


R°J  "k-, 


^k-l/Z^-l/z” 
(»C+-l  )6p 


II  p  ) 
k»l/z'  k*l/2 


The  special  form  of  the  last  term  is  chosen  to  ensure 
angular  momentum  conservation. 

The  second  half  of  the  forward-backward  step  solves 

l+Sl  t  St  rTor  .1+61 
P.  =  P.  +  L  ,  11 


0L4<51=  o'- 


r  ,  3p, t+5i  ,t 

>L  (r— ).  .  JO  -o  )  + 

—  k>i/2  nk*  i  nk 


i  Dp, 1+51  ,  ,1 

(n_),  (o-o  ) 

rr  k-i/z  nk  nk-i  J 
on 

where  O^o)  is  a  basic  stale  profile  of  0  calculated 

Trom  an  isothermal  basic  state  with  temperature  300°K 
and  surface  pi  cssui e  100000  pa.  as  used  in  standard 
semi  - Impl lei l  models  The  theory  behind  the  choice  is 
exactly  that  In  Simmons,  Hoskins,  and  Burridge  (1978). 

Typically,  three  .lioi  t  steps  are  pcrlormed, 
follwod  by  a  long  advection  timestep.  The  length  of 
Ibis  step  is  wiitten  as  At,  Tile  Heun  two-step 
advection  scheme  is  used.  A  second  order  version  is 
wrltl.cn  out,  but  a  fourth  order  version  is  actually 
used  for  some  or  the  applications  of  the  model.  The 
same  order  or  accuracy  must  be  used  in  both  steps  or 
the  Heun  scheme.  The  key  to  conservation  is  that  the 
advection  must  ho  with  the  mass-weighted  velocity 
field  averaged  over  the  three  adjustment  steps.  Del  lrie 
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_ xy  _ xy 

<W  =  (W  VAC0S  *> 

Ek»l/2=  ^>*.72 
dr) 

as  saved  from  the  short  timesteps.  The  finite 
difference  equations  for  the  first  advection  step  are 
then 


:>V#=  AnV1  -  At  [  U  8  o'+  V  3.0.'  1  - 

i,  t,  “"1,1,  _ —  L  kXk  k  V  k  J 


“V  I  E  (e'  -e')  *  E  (e'-o'  )| 

2L  k*l/2  k»:  k  k-J/2  k  k-1  J 

Similar  equations,  with  the  different  spatial 
averaging  appropriate  for  the  position  of  the 
variables  on  the  B  grid,  are  used  to  advect  the  other 
variables.  The  second  step  is  written 
t+8Vt+St=  t+8V  . 
k  k  k  k 


iAt[(Ap^+At/ApSy.VG1't+  U.TO'#  ] 
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This  form  is  chosen  to  ensure  conservation  under  time 
differencing. 

III.  OSCILLATION  FREE  ADVECTION  SCHEMES 


The  most  natural  way  of  incorporating  oscillation 
free-  adve  r.ion  schemes  into  this  structure,  while 
retaining  conservation  is  that  of  Roe  (1983).  the 
standard  advection  scheme  set  out  above  can  be 
considered  as  two  stages.  First  calculate  advective 
increments  of  the  form 

_y 


at  grid  box  boundaries.  The  second  step  is  to  apply 
these  increments  to  adjacent  grid  points.  This  is  done 
in  the  standard  scheme  by  applying  half  the  increment 
to  the  point  on  either  side  of  the  boundary. 

Upwind  schemes  can  be  generated  by 
applying  the  whole  increment  to  the  point  downwind  of 
the  boundary.  Accurate  oscillation  free  schemes  are 
obtained  by  using  a  more  accurate  redistribution 
algorithm,  several  of  which  are  set  out  in  Roe’s 

paper.  The  resulting  schemes  are  algebraically 
equivalent  to  those  obtained  by  starting  from  the 

conservation  law  form  of  the  equations  and  applying  a 
flux  limiter.  However,  the  use  of  short  timesteps  for 
the  continuity  equation  and  long  timesteps  for  the 
advection  makes  it  harder  to  set  out  the  schemes  In 
that  form. 

The  schemes  can  then  be  applied  to  a  three 

dimensional  model  on  the  sphere  by  combining  three 
one-dimensional  schemes.  Thus  the  redistribution  is 
calculated  separately  for  each  coordinate  direction. 
Fourier  filtering  destroys  the  oscillation-free 
property.  At  high  latitudes,  the  east  west  sweep  must 
be  repeated  several  times  to  avoid  compromising  the 
model  timestep. 
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ABSTRACT 

Computational  dispersion  properties  of  different 
vertical  grids,  namely  for  regular,  Lorenz,  Charncy- 
Phillips,  and  a  new  class  of  time-staggered  grids  have  been 
studied  using  a  linear  baroclinic  hydrostatic  atmospheric 
model  and  intcrcomparcd  in  terms  of  frequency,  phase  and 
group  velocity  characteristics.  It  is  shown  that  the  widely 
used  Lorenz  grid,  and  also  the  Chamcy -Phillips  grid  as 
well  as  the  new  time-staggered  versions  of  these  grids 
have  dispersion  properties  corresponding  to  a  regular  grid 
with  twice  the  vertical  resolution.  They  arc 
computationally  efficient  due  to  enhanced  effective 
vertical  resolution.  The  scale  ranges  for  which  group 
velocities  have  the  wrong  sign  arc  pointed  out.  The 
influence  of  higher  (4th)  order  vertical  approximation 
has  been  investigated  and  found  to  be  relatively 
insignificant.  The  practical  applicability  of  time- 
staggered  vertical  grids  has  been  tested  and  proven 
effective  within  full  time-space  staggered  grids  for  an 
experimental:  PE  baroclinic  model. 

I.  INTRODUCTION 

The  most  widely  used  vertical  grid  is  the  Lorenz 
(1960)  type  staggered  (or  L-grid)  which  carries  horizontal 
velocities  and  temperatures  at  the  same  levels,  and-  vertical 
velocities  at  the  intermediate  levels.  The  advantage  of  the 
Lorenz  grid  is  in  its  easy  maintenance  of  conservation 
laws.  The  Ghamcy  Phillips  (1953)  type  staggered  grid,  or 
CP-grid  carries  vertical  velocities  and  temperatures  at  the 
same  levels  and  horizontal  velocities  at  the  intermediate 
levels.  The  advantage  of  this,  grid  is  its  easy  maintenance 
of  integral  constraints  for  a  quasi-gcostrophic  flow. 

New  time-staggered  versions  of  these  vertically 
staggered  grids,  namely  the  time  staggered  L  grid  or  the 
LTS  grid,  and  time  staggered  CP  grid  or  the  CPTS  grid  are 
introduced.  AH  uaggered  grids  arc  computationally 
efficient  due  *  -enhanced  effective  vertical  resolution 
compared  to  that  of  a  regular  (unstaggered)  grid.  Their 
dispersion  properties  arc  intcrcomparcd  both  with  each 
other  and  against  that  of  an  analytical  case  in  a  manner 
similar  to  that  used  by  Mcsingcr  and  Arakawa  (1976)  and 
Fox-Rabinovitz  (1991)  for  horizontal  grids. 

II.  THE  DIFFERENTIAL  CASE 


v=B  ;  HGVC  =  ^-  =  2B"'  c2  K  r"2  >  0 ; 
9k 


VGVC =~=  -  2B’1  c2  k2  r"3  <  0 ;  (3  ) 

dr 

where  3  =  (f 2  +  2c2  k2  r'2)'/2 

These  characteristics  arc  used  for  comparisons  of  different 
grid  dispersion  properties.  Note  that  the  most  important 
characteristic  is  the  appropriate  sign  of  group  velocity 
components,  namely  HGVC  should  be  positive  and  VGVC 
negative  for  all  resolved  scales. 


III.  VERTICALLY  AND  TIME- VERTICALLY  STAGGERED 
GRIDS 


The  same  dispersion  characteristics  arc  obtained  for 
the  system  (1)  approximated  with  a  central  difference 
scheme  (CDS.)  for  different  vertically  and  timer  vertically 
staggered  grids,  and  compared  with  each  other,  and 
against  the  differential  case  (3).  For  simplicity  a  regular, 
or  Arakawa  A  grid  is  used  for  horizontal  approximations. 
The  vertical  grids  considered  arc  presented  in  Figs.  1-5. 

We  considered  first  what  may  be  achieved  by 
introducing  4th  order  CDS  m  the  vertical  instead  of  the  2nd 
order  CDS  .  The  sign  of  both  VGVC  and  HGVC  arc  wrong  for 
both  schemes  in  certain  scale  ranges,  although  for  the  4th 
order  CDS  they  arc  slightly  smaller.  Namely,  for  the  2nd 
order  CDS  the  aforementioned  signs  arc  wrong  for  scales 
smaller  than  L  <  4a£,  whereas  for  the  4th  order  CDS  the 
signs  are  wrong  for  scales  L  <  ~3.5  At;  which  is  quite 
comparable  to  the  2nd  orders  result.  Therefore,  the 
dispersion  properties  cannot  be  significantly  improved  by 
using  the  higher  (4th)  order  approximation  in  the  vertical 
with  a  regular  (unstaggered)  grid.  The  most  significant 
feature  of  all  vertically  and  timc-vcrtically  staggered  grids 
considered  is  that  they  have  definitely  better  dispersion 
characteristics  than  that  of  a  regular  (unstaggered) 
vertical  grid.  Both  HGVC  and  VGVC  have  an  appropriate 
sign  for  air  resolvable  scales  L  <  2A£  due  to  the  higher 
effective  vertical  resolution.  In  general  all  staggered 
grids  have  dispersion  properties  which  correspond  to  or 
arc  very  close  to  those  of  a  regular  grid  with  twice  the 
vertical  resolution. 


Let  us  consider  a  linear  baioclinic  PE  hydrostatic 
atmospheric  model  in  £  =  .£np  coordinate  system. 

3u  9$  f  „  9v  9(i 

+  _t_fv  =  0  ,  —  +  -^-^  =  0, 

9t  9x  9t  9y 

(1) 


92<j) 

9tDC 


+  c2£2  =  0 


^■33  =  0 

9x  9x  0£  ’ 


where  u,v,£2  =  — arc  velocity  components, 
dt 

gcopotcntial,  f  constant  Coriolis  parameter, 
has  the  form; 


C2  =  const.,  <S> 
The  solution 


F  =  F  .cxp[i(kx  +  my  +  r£-vt)],  (2) 

where  k,  m,  r  arc  wave  numbers,  v  frequency.  The 
dispersion  relationship  and  horizontal  and  vertical  group 
velocity  components  (HGVC  and  VGVC)  arc  as  follows 
(for  k  =  m): 


Note  that  semi-implicit  or  economical  explicit 
schemes  may  be  complemented  with  tiir,c-vcrtica!ly 
staggered  grids  and  the  dispersion  properties  for  the  case 
arc  identical  with  those  for  a  regular  grid  with  doubled 
resolution.  The  examples  of  VGVCs  for  different  vertical 
grids  arc  presented  in  Fig.  6. 

Note  also  that  the  upper  and  lower  levels  for  timc- 
vcrtically  staggered  grids  may  be  the  same  for  the  adjacent 
time  steps  which  is  convenient  for  orography 
incorporation  and  upper  boundary  condition. 

IV.  EXPERIMENTS  WITH  TIME-VERTICALLY  STAGGERED 
GRIDS 

The  timc-vcrtically  staggered  grids  have  been 
combined  with  timc-horizontally  staggered  grids  within  a 
full  4-D  staggered  grid  approach.  The  experimental  PE 
baruelmic  model  with  the  grid  is  tested  anj  found  to  be 
computationally  efficient.  The  results  of  regional  and 
storm  forecasts  arc  encouraging. 
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Fig.  5.  The  timc-vcrtically  staggered  L  grid,  or  LTS  grid. 


AC 

Fig.  T.  A  regular  (unstaggered)  vertical  grid.  F  stands 
for  model  variables. 


Fig.  3.  The  vertically  staggered  Lorenz  grid  (1960),  or 
L  grid. 
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Fig.  4.  The  timc-vcrtically  staggered  CP  grid,  or  CPTS  grid. 


Fig.  6.  Vertical  group  velocity  components  for  the 

differentia!  ease  (a):  a  regular  vertical  grid  with  the 
2nd  order  CDS  (b);  vertically  staggered  L  and  CP 
grids  (c);  and  timc-vcrtically  staggered  LTS  and  CPTS 
grids  (d). 
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I.  INTRODUCTION 

One  aspect  of  weather  and/or- climate  prediction  which  limits  our 
capabilities  is  associated  with  computational  errors  arising  from  the 
numerical  representation  of  the  relevant  differential  equations  describing 
the  prediction  system.  Of  the  representational  methods  currently  favored, 
global  Junction  expansion  (spectral),  finite  differencing  in  space  or  finite 
element  funedons,  each  has  its  own  limitations,  but  the  interrelationship 
amongst  them  has  not  been  carefully  discussed.  Issues  such  as  aliasing 
errors  and  computing  speed  compete  when  a  representational  choice  is  to 
be  made.  Whereas  the  spectral  method  is  preferred  for  global  ealeu 
lations,  it  is  not  suitable  for  regional  calculations  with  complex  boundary 
conditions. 

It  is  the  intent  of  this  report  to  present  a  procedure  which,  when  applied 
in  thc  spatial  domain.could  yield  results  which  are  equivalent  to  those 
derived  from  the  spectral  domain.  If  the  equivalence  can  be  demonstrated 
in  application  to  general  models,  the  choice  of  numerical  representation 
would  be  one  of  preference  or  convenience  rather  than  one  associated 
with  forecast  quality.  We  shall  lean  heavily  on  linear  theory  to  present 
our  case. 

II.  PROCEDURE 

We  choose  for  our  analysis  the  model  developed  by  Kalney,  ct.  al. 
(1977).  This  model  is  representative  of  die  models  in  current  use  as 
prediction  systems  and  is  furthermore  available  in  4th  order  difference 
form  at  GSFC/GLA,  if  and  when  we  need  a  comprehensive  model  to  test 
our  results.  Since  the  model  is  global,  it  would  also  be  possible  to 
compare  a  spectral  version  with  die  existing  finite  difference  form.  To 
understand  the  structure  of  the  prediction  equations,  we  hrieari/.c  the 
model  without  forcing  about  a  state  of  rest. 

The  resulting  system  yields  to  a  separation  in  vanablcs  such  that  die 
horizontal  dependence  may  be  solved  for  independendy  of  the  vertical 
dependence,  the  separation  constants  are  denved  from  the  solution  to  the 
equations  in  the  vertical  dimension  and  arc  denoted  as  equivalent  depths 
with  corresponding  eigenvectors  which  have  been  carefully  studied  by 
Baer  and  Ji  (1989).  If  Fourier  senes  arc  substituted  for  die  longitudinal 
dependence,  the  shallow  water  equations,  dependent  only  on  latitude, 
result  and  have  analytic  solutions.  Tnesc  solutions  are  known  as  Hough 
functions  and  depend  on  the  equivalent  depth  and  die  planetary  wave 
number.  There  arc  an  unlimited  number  of  these  functions  which  satisfy 
the  equations,  and  a  finite  set  would  reflect  modal  truncation. 

To  understand  how  a  fin.tc-diffcrcncc  or  finite  element  representation 
of  the  shallow  water  equations  relates  to  the  spcaral  \Houghy  solutions, 
we  have  evaluated  the  latitudinally  dependent  equations  on  an  equally 
spaced  grid  of  points  in  latitude,  and  using  both  the  4th  order  differencing 
scheme  and  a  second  order  finite-element  scheme  applied  to  the  general 
model,  we  have  developed  two  discrete  systems,  each  of  which  yield  a 
set  of  eigenvectors  and  eigenvalues,  their  number  and  character  depending 
on  the  number  of  grid  points  selected.  Since  the  true  solutions  arc  known 
(Hough  functions),  these  eigenvectors  can  be  compareJ  ro  the  Hough 
solutions  and  identified  as  true  solutions  (those  which  compare/  oi  as 
false  solutions  (those  which  do  not  compare  and  consequently  represent 
computational  errors).  If  a  one-to-one  comparison  exists  and  only  the 
truecigcnmodcs  arc  used  to  solve  the  linear  system  on  the  grid,  then  the 
results  of  the  discrete  representation  would  yield  the  exact  solutions. 


Should  one  consider  a  different  model,  or  even  the  same  one  which 
was  nut  valid  globally,  die  exact  solutions  would  not  be  apparent.  Thus 
an  alternate  procedure  is  needed  to  distinguish  the  true  modes  from  the 
false  ones.  We  have  done  dns  by  introducing  the  shooting  method. 
Simply  described,  this  method  utilises  die  eigenvalue  foi  a  given 
numerical  cigcnsoluliun  ol  the  discrete  equations,  starts  at  one  boundary 
and  integrates  the  equation  point  by  point  to  die  other  boundary.  If  the 
other  boundary  condition  is  thereby  met,  the  eigenvalue  and  its  associated 
vector  satisfy  the  equation.  11  the  boundary  condition  is  not  met,  an 
adjustment  to  die  eigenvalue  is  made  and  the  process  is  repealed.  If  the 
solution  converges  to  the  boundary  condition  with  minor  adjustments  of 
die  eigenvalue,  the  numencul  solution  is  probably  true.  If  it  diverges,  the 
solution  is  false,  i.e.,  no  such  vector  satisfies  the  original  equation.  We 
compared  the  true  and  false  solutions  so  identified  to  the  Hough  modes, 
which  are  by  definition  the  true  modes.  By  this  procedure,  we  can 
identify  the  equivalence  of  a  discrete  model  to  a  spectral  model. 

Finally,  we  have  projected  observational  data  fields  onto  a  set  of 
Hough  functions  and  on  die  corresponding  sets  of  eigenvectors  derived 
from  the  discrete  systems.  Since  the  projections  arc  done  independently, 
some  measure  of  amplitude  loss  which  comes  from  discarding  false 
modes  is.madc  apparent  and  is  available  to  assess  the  applicability  of  the 
procedure. 

III.  EXPERIMENTS 

Tile  model  equations  discussed  above,  essentially  the  shallow  water 
equations,  were  transformed  to  discrete  systems  by  assuming  4th  ordci 
differencing  over  an  equally  spaced  latitudinal  grid  arid  vtv  second  order 
finite  element  representation  on  the  same  gnd.  In  both  cases,  die  gnds 
used  were  5"  latitude  and  2.5"  latitude.  The  corresponding  longitude 
representation  was  for  a  continuous  Fourier  senes  and  a  fourth  order 
differencing  with  the  appropriate  gn,l  increment  ro  allow  for  a  maximum 
of  20  planetary  waves. 

The  equations  representing  each  differencing  scheme  were  solved  as 
a  matrix  problem  and  yielded  eigenvectors  and  eigenvalues,  their  number 
appropnate  to  the  number  ol  grid  points  used,  for  example,  if  die  gnd 
increment  was  5',  105  vectors  evolved.  These  vector  sets  were  calculated 
for  each  planetary  wave,  IwmhZC,  arid  lot  die  various  equivalentdepths. 
Assuming  nine  vertical  levels,  we  evaluated  for  each  of  the  mne 
equivalent  depdis.  Tile  minimum  number  of  Hough  modes  appropnate 
to  a  given  truncation  vA$>  was  established  by  identifying  that  set  ol 
Hough  modes  which  were  included  amongst  the  cigenvcctoi  set  of  the 
discrete  system,  no  more  or  no  less. 

The  shooting  method  was  applied  to  each  set  of  eigenvectors  of  the 
discrete  representation  for  each  choice  of  parameters  and  for  each 
numencal  technique.  Thus  a  set  of  true  arid  false  modes  was  determined 
for  each  experiment  and  was  available  for  comparison  with  die  associated 
Hough  mode  solutions. 

Finally,  several  data  fields  were  projected  onto  the  eigenvectors 
denved  from  the  vanous  experiments,  as  well  as  onto  the  corresponding 
Hough  modes,  and  die  relative  amplitude  ol  the  data  m  lire  tree  modes 
as  contrasted  to  tile  false  modes  was  assessed. 
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IV.  RESULTS 


V.  CONCLUSIONS 


The  experiments  outlined  above  have  resulted  in  die  following 
observations. 

(a)  Sensitivity  to  truncation  in  longitude  results  in  vanations 
observed  only  on  the  shortest  planetary  scales,  which  represent  a  2AX. 
increment.  This  confirms  many  previous  observations. 

(b)  The  distnbuuon  of  modes  between  Rossby  and  gravity  evolving 
from  the  solutions  to  the  discrete  (truncated)  systems  conforms  to  the 
expectations  for  the  true  (Hough)  solutions;  i.e.,  iwo-dwds  of  the 
soluuons  arc  gravitational  and  one-third  arc  Rossby.  However,  some  ol 
the  Rossby  modes  calculated  arc  false  because  they  propagate  to  die  cast. 
Almost  half  of  the  Rossby  modes  calculated  lor  the  4th  order  system  lall 
into  this  category,  whereas  considerably  fewer  have  this  property  lor  the 
finite-element  system. 

(c)  The  shooting  mcdiod  works  well  and  as  expected.  The  modes 
which  arc  defined  as  true  by  the  shooting  method  are  also  Hough  modes 
whereas  the  false  modes  are  not  found  amongst  the  Hough  mode 
solutions. 

(d)  A  direct  relationship  has  been  found  between  the  finite- 
difference  increment  selected  and  spectral  truncation.  Based  on  item  fcj 
above,  this  correspondence  can  be  calculated  from  cidicr  the  number  ol 
true  modes  found  by  shooting  or  the  number  of  relevant  Hough  modes 
determined.  "Hie  results  arc  sensitive  both  to  die  planetary  wave  number 
and  to  the  vertical  mode.  Moreover,  the  response  of  the  Rossby  and 
gravity  modes  differ.  We  have  tested  these  results  for  both  A<>  =  5°  and 
AQ  =  2.5°,  and  the  results  arc  consistent.  Consider  the  experiment  for  A<J> 
=  5°  with  4th  order  differencing.  For  the  external  vertical  mode  and  the 
longest  planetary  wave  (m=l),  almost  one-half  of  the  Rossby  modes  arc 
true  and  45  percent  of  the  gravity  modes  arc  true.  This  translates  roughly 
to  16  Hough  modes  for  each  set  (Rossby,  gravity-cast  and  gravity-west). 
However,  for  tile  longest  planetary  wave  and  the  sixth  internal  mode, 
only  twelve  Rossby  Hough  modes  arc  true  and  only  two  gravity  modes 
arc  true.  For  the  external  mode  at  planetary  wave  twenty,  twelve  Rossby 
modcs-arc  true  but  only  five  gravity  modes  arc  true.  The  implications 
here  arc  clearly  that  spectral  truncation  and  the  corresponding  finite- 
difference  truncation  arc  highly  scale  dependent. 

(c)  The  impact  of  false  modes  on  the  integration  of  a  nonlinear 
system  may  be  assessed  by  considering  their  involvement  in  the  energy 
exchange  process.  We  have  investigated  die  impact  by  projection  of 
several  data  fields  onto  all  the  modes  of  a  discrete  system.  As  an 
example,  consider  the  rotational  kinetic  energy  of  die  external  mode 
expressed  by  die  modes  of  the  4th  order  differencing  system.  If  we 
compute  the  ratio  of  energy  in  die  true  modes  to  the  energy  in  all  modes, 
we  note  that  for  the  Rossby  modes,  this  ratio  decays  from  near  95  percent 
for  the  largest  planetary  wave  to  near  80  percent  at  wave  number  twenty. 
By  contrast  the  ratio  is  near  40  percent  for  the  largest  planetary  wave  for 
gravity  waves,  and  gradually  increases  to  near  50  percent  by  wave 
twenty.  Since  the  energy  in  both  groups  decays  rapidly  with  wave 
number,  and  furthermore  since  the  Rossby  energy  is  an  order  of 
magnitude  larger,  die  total  energy  in  this  vertical  mode  is  described  to 
better  than  90  percent  by  the  true  modes.  This  result  is  similarly  noted 
for  the  larger  internal  vertical  modes. 


The  results  of  our  calculations  indicate  that  a  correspondence  can  be 
made  between  spectral  and  grid  truncation,  and  based  on  our  analysis 
with  a  relatively  simple  model,  it  is  highly  scale  dependent.  Whereas  for 
die  longest  planetary  waves  and  die  external  vertical  mode  the  convcn 
tional  concept  that  one  wave  for  each  two  grid  points  applies,  very  few 
spectral  components  represent  many  grid  points  for  short  planetary  waves 
and  internal  vertical  modes. 

Truncation  decisions  can  be  made  by  considering  die  distribution  of 
observed  variables  in  terms  of  die  appropriate  eigenvectors  of  the  system 
to  be  predicted.  Once  a  decision  on  the  number  of  false  modes  which 
can  be  tolerated  is  made,  the  appropriate  truncation  can  be  chosen  and  a 
grid  or  spectra!  truncation  can  be  selected.  Aliasing  errors  during 
nonlinear  integrations  can  be  reduced  by  filtering  the  initial  data  of  the 
unwanted  false  modes.  Because  those  modes  exist  in  the  prediction 
system,  their  amplitude  will  grow  in  time  due  to  nonlinear  interactions 
To  maintain  control  of  these  unwanted  modes,  they  may  be  filtered 
periodically  during  the  integration  cycle.  This  procedure  is  clearly  not 
needed  in  a  spectral  model. 

Tests  with  a  shallow  water  nonlinear  model  have  been  made  and 
indicate  how  fast  false  modes  grow  with  time  during  integration.  Such 
calculations  provide  a  time  scale  for  filtering  of  the  false  modes  and  also 
give  an  indication  of  how  successfully  a  filtered  model  can  provide 
successful  forecasts. 
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POLYNOMIALS  AS  A  SUBSTITUTE 
FOR  LEGENDRE  FUNCTIONS  III  SPECTRAL  MODELS 
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Abstract  -  A  method  for  expanding  dependent 
variables  in  numerical  models  of  the  global 
atmosphere  is  discussed.  The  method  is  shown  to  be 
compatible  with  spectral  methods  and  a  procedure  for 
converting  spectral  coefficients  to  polynomial 
coefficients  is  demonstrated.  The  polynomial  method 
proves  more  efficient  on  a  scalar  computer  and  has 
potential  to  be  more  efficient  than  traditional 
spectral  algorithms. 


I.  INTRODUCTION 


During  the  development  of  spectral  models  of 
the  atmosphere  in  the  1970s,  most  researchers 
realized  that  a  major  difficulty  with  spectral 
models  is  the  evaluation  of  Legendre  functions. 
Although  swift  and  accurate  methods  exist  for  the 
computation  of  Legendre  functions,  it  was  not 
feasible  to  store  all  the  necessary  values  of  the 
functions  and  to  access  then  frequently  during 
numerical  integration  because  of  the  drag  10 
normally  imparts  on  computer  processing. 

Several  researchers  have,  therefore,  looked 
into  the  possibility  of  expressing  the  Legendre 
functions  in  terns  of  Fourier  expansions  divided  by 

some  power  of  (1-p2)1/2,  i.c.,  cost}  where  p  ■=  sin£>, 
and  is  latitude.  Herilecs  (1973)  suggested  that 
the  Legendre  function  be  expressed  as  Fn(p}/(1- 

h2)°/z,  where  Fn  is  an  expansion  of  sin  k <fi,  where  K 
ranges  from  0  to  n,  m  being  the  zonal  wave  number. 
Orszag  (1974)  suggested  that  the  function  be 

represented  as  Gn(p)/(l-p2)s/2  where  G n(p)  is  also 

an  expansion  of  sin  k£  while  s  can  be  either  l  or  0 
depending  on  whether  m  is  even  or  odd.  Yee  (1980) 
extended  the  argument  so  that  the  Legendre  function 
could  be  expressed  completely  as  a  Fourier  series, 
where  cosine  terns  are  kept  for  even  functions  and 
sine  terns  are  kept  for  odd  functions. 


In  this  study,  we  offer  an  alternative  sore 
compatible  with  Legendre  functions  and  hence  with 
spectral  models.  It  involves  shifting  from 
expansions  in  terns  of  Legendre  functions  to 
expansions  in  polynomials  of  p,  while  keeping  the 
representation  of  the  fields  spectral. 


II.  spectral  expansions 


To  evaluate  a  given  variable.  A,  which  is  a 
function  of  latitude,  d,  and  longitude,  X  ,  from  its 

spectral  coefficients,  A3,  we  execute  the  sum 


H  l=l+N  _  _  in, 

A(«,  A)  “  2  Z  A°P°  W)  clp*  (1) 

m=-M  n=|a|  n  n 


where  P° W)  arc  the  associated  Legendre  functions. 
The  Legendre  functions  themselves  are  defined  as 


«s 


1  -li2!*/2 


n-a  . 

Z  a?'V. 
j«o  3 


The  coefficients  a?'3  need  be  derived  only  once 

and  stored  for  future  use.  Because  P°  is  even  for 

n 

n-m  even  and  odd  when  n-n  is  odd,  only  of  the  order 
of  (N-M)  /4  coefficients  need  be  saved  for  each  m 
under  rhomboidal  truncation,  where  H  represents  the 
largest  meridional  wave  number  of  the  expression. 

There  are  various  ways  to  derive  the  a3'3,  but  there 

is  no  space  here  to=expound  upon  them.  Once  they 
are  known  it  is  possible  to  substitute  into  (1)  to 
derive  the  Fourier  coefficients,  A_W)  of  A(<j,A), 

given  as 


2-m/2 

A_W)  (l-p“)  =  Z 

n=|n| 


n 

z 

j=0 


P  t 


Rearranging  terns  gives 


(1-pVB/2=  i 

r=0 


pi 


a^m|+p,mMr 


(2) 


H 

Z 

n=o 


u  n 
Cn  “ 


where  c3 


p-r^l^ 


|m|+p,m 

r 


Thus,  given  A?  and  the  coefficients  a3'3, 
we  can  determine  the  coefficients  C°  and  evaluate 
the  variable  in  terms  of  powers  of  p.  The  summation 
leading  to  cP  is  a  very  swift  process,  especially  on 

vector  computers  and,  of  course,  the  summation  of 
powers  of  p  in  (2)  is  much  quicker  than  the 
evaluation  of  Legendre  functions. 


III.  INVERSE  TRANSFORMS 


In  the  course  of  most  spectral  model 
processing,  it  is  necessary  to  obtain  the  spectral 
coefficients  from  the  values  of  the  parameters,- 
e.g. ,  for  non-linear  terms  this  is  normally 
performed  at  every  time  step.  The  polynomial 
approach  can  also  furnish  the  same  spectral 
coefficients  but  without  explicitly  calculating  the 
Legendre  functions  and  performing  the  related 
Gaussian  integration.  As  with  the  spectral  method, 
the  function  AW,X )  is  decomposed  by  Fourier 
transform  to  obtain  the  Fourier  coefficients  at  M+l 

latitudes.  Ke  then  divide  AnW)  by  (1-p2)3^2  ** 

cos°£,  provided  <p  i-  ±  sr/2.  Ke  now  solve  the  system 
of  N+l  linear  equations  given  by  (2)  to  obtain  the 

coefficients  (C3),  j«0,  ....  N.  By  invoking  the 
relationship  between  the  known  C®  and  a!?'3 

and  the  unknown  A3,  one  can  easily  solve  for  the 
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spectral  coefficients  recursively  by 


*|n|+N 


n  /aN 


l|n|+H-l 


Cl"  „ 

.  |n|+H-l(n 


n  |n|+N,n 
Alcl+NaM-i 


H-l 


Mn|+ll-k 


°n-k 


11  An,  .  Jnl+r,n 

-  E  |n|+raH-k 

r=H-k+l 


|n|+!t-k,n 

aN-k 


(3) 


for  each  n.  Inverting  an  upper  triangular  natrix 
would  be  the  equivalent  operation  and  nay  prove 
swifter. 

IV.  CONCLUSIONS 


In  experinents  executed  on  a  CDC  Cyber  750  (an 
older,  scalar  nachine) ,  the  expansion  of  tenperature 
fron  spectral  coefficients  with  rhoaboidal 
truncation  of  30  using  the  standard  Legendre 
function  approach  over  60  latitudes  took  1.472s  of 
CF*1  tine  as  opposed  to  .525s  for  the  polynonial 
ni..  nodi  The  inverse  transfora  when  pcrforccd  by 
Le^^ndre  functions  and  Gaussian  integration  took 
33o:.  to  evaluate  the  spectral  coefficients  for 
tenparature,  noisturc,  and  velocity  at  12  levels  but 
only  84s  with  the  polynonial  cethod.  Tests  on 
faster  vector  processing  nachines  have  not  been 
perfomed  to  date,  but  savings  in  tine  nay  be 
expected  there  as  well.  It  Bust  be  reseebered,  as 
well,  that  the  proposed  nethod  here  is  conpletely 
spectral  and  is  therefore  conpletely  conpatiblc  with 
other  spectral  nodels. 


There  are  sone  drawbacks  to  the  nethod, 
however,  which  oust  enter  in  its  evaluation.  First, 
expressing  the  Laplacian  is  auch  sinplcr  with 
Legendre  functions  than  with  polynonials,  but  the 
polynonial  expression  is  still  tenable.  Second,  it 
is  necessary  to  store  the  coefficients  of  the 
powers  of  the  sines  that  generate  the  Legendre 
functions,  but  this,  again,  nay  not  prove  too 
difficult  especially  with  large  nainfrancs.  Third, 
accuracy  near  the  poles  nay  present  a  problcn,  but 
this  affects  Legendre  functions  as  well.  All  in 
all,  the  polynonial  approach  cay  serve  as  a 
beneficial  substitute  for  conventional  spectral 
nethods. 
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A  DUAL-RESOLUTION  SEM-IHPLICIT  METHOD  FOR  ATMOSPHERIC  MODELS 
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I.  Introduction 

There  are  principally  two  types  of  waves  repre¬ 
sented  in  current  operational  atmospheric  models: 
Rossby-waves  and  gravity  waves.  The  former  typically 
propagate  at  speeds  of  about  3 O  n/s  and  the  latter  at 
speeds  up  to  300  n/s.  In  the  early  days  cf  numerical 
weather  prediction  (NWP),  because  of  their  diverged 
wavelengths  and  high  speeds,  gravity  waves  were 
treated  with  respect  but  also  with  awe.  The  cordon 
wisdom  was  to  filter  out  the  shorter  ones  and  treat 
the  longer  ones  gingerly.  Thus,  Robert  (1969)  pro¬ 
posed  a  so-called  semi-implicit  method  in  which  the 
model  terms  responsible  for  the  fast-moving  gravity 
waves  were  treated  by  an  unconditionally  stable  but 
computationally  more  costly  implicit  time-scheme,  and 
the  remaining  terms  were  treated  by  a  much  simpler 
explicit  time-schema.  This  approach  enabled  us  to  use 
larger  tine-steps  without  sacrificing  accuracy  and 
was  considered  to  be  a  computational  milestone  in 
NWP.  Increasing  emphasis  in  recent  years  on  saaller- 
scale  (the  so-called  mesoscale)  dynamics  and  physics 
means  that  vs  must  now  solve  model  equations  at 
higher  resolutions.  However,  the  current  practice  cf 
discretization  in  which  gravity  waves  are  represented 
at  the  saa*  spatial  and  temporal  resolutions  as 
Rossby-waves  also  means  that,  due  to  constraints  in 
computing  resources,  we  can  have  nigh  resolution 
models  only  for  pre-designated  small”  geographical 
areas.  Examples  of  such  localized  models  are  the  USAF 
Global  Weather  central's  "Relocatable  WindowEodel" 
and  the  (?.S.  National  Keteorological  Center's 
"Kested-GriqKodel . " 

We  propose  here  a  new  approach  in  which  different 
resolutions  ars  adopted  for  different  terms  in  the 
model  equations.  For  example,  sirce  gravity  waves 
typically  not  only  propagate  ten  tines  faster  than 
longer  Rossby-waves,  but  also  change  much  faster  as 
functions  cf  space  and  tine,  we  cay,  therefore,  dis¬ 
cretize  the  model  equations  on  a  dual  grid,  both 
spatially  and  temporally,  evaluate  the  terms  respon¬ 
sible  for  the  gravity  waves  on  a  finer  grid,  and 
evaluate  the  remaining  terms  on  a  coarser  grid.  The 
distinction  between  the  local  refineaent  method  and 
this  new  approach,  which  we  shall  tentatively  call 
the  dual  grid  method,  can  be  stated  simply  as 
follows:  In  the  former,  we  start  with  a  coarse  grid 
and  evaluate  at  increasingly  finer  resolutions  for 
decreasingly  smaller  portions  of  the  model  domain.  At 
a  given  level  of  refinement,  all  the  terns  in  the 
model  equations,  however,  arc  evaluated  at  the  core 
resolution.  In  the  latter,  we  evaluate  for  the  entue 
domain  each  term  in  the  node!  equations  at  a  tesSHT 
tion  appropriate  for  the  scales  of  the  fhencaena  -t 
represents. 

While  it  say  not  be  immediately  apparent,  the 
underlying  principles  of  this  netted  ate  akin 
those  of  the  cultigrid  method  { McCormick,  1399j. 
shorter  waves  are  treated  on  a  finer  grid,  and  longer 
ones  on  a  coarser  grid.  In  the  example  above,  *e 
have,  however,  taken  advantage  of  prior  information 
on  the  scales  of  the  modeled  waves. 

II.  A  Shallow  water  Model 

To  validate  the  dual  grid  concept  outlined  in 
Section  I,  we  shall  use  a  simple  but  illustrative 
"shallow"  water  model  in  which  the  wavelength  of  the 
shortest  waves  is  much  longer  than  the  depth  of  the 
fluid  so  that  the  fluid  is  largely  in  hydrostatic 


equilibrium.  The  one-dimensional  equations  governing 
the  velocities  u  and  v  and  the  depth  h  in  a  viscous 
"shallow"  fluid  on  an  f-plane  can  be  written 
(Seitter,  1986) 

(hu) t  -  -  (uhu)x  +  f(hv)  -  g(h2/2)x  +  v(hu)„  (1) 

(hv) t  =  -  (uhv)x  -  f(hu)  +  v(hv)xx  (2) 

(h)t  =  -  (hu)x  <3> 

where  g  is  the  acceleration  of  gravity,  f  is  the 
Coriolis  parameter,  and  v  is  an  eddy  viscosity-  The 
heia’nt-weighted  velocities,  hu  and  hv,  are  analogous 
to  the  pressure-weighted  velocities  jsed  as  prognos¬ 
tic  variables  in  cany  mesoscale  hydrostatic  models 
and  the  continuity  equation,  (3),  is  analogous  to  the 
pressure  tendencv  equation  inra  hydrostatic  model - 
We  nondimensionalize  the  equations  using  the 
undisturbed  height,  H,  as  a  scale.  Thus,  letting 
primes  denote  the  nondimensional  quantities  «e  have 

h  =  H  h' 
u  -  /(gH)  u' 
v  **  /(gH)  v' 

t  -  /(H/g)  t'  (-5) 


X  -  B  x' 

f  =  /(g/ll)  £' 
v  «  n/(  gll>  K'. 

Then  the  non-dimensional  equations 
primes) 

are  {droning 

(hu)t  «■  -  (uhu)x  +  f(hv)  -  (h2/2)x 

+  K(hu)xx  (5) 

(hv)t  -  -  (uhv)x  -  f (hu)  +  K(hv)xx 

(6) 

(hz/2)t  =  -  (h-H)(hu)x  -  B(hu)x. 

(7) 

Note  that  K  may  now  be  regarded  as  an  inverse 
Reynolds  mister  and  that  we  have  separated  the 
height -weighted  divergence  term  in  (7)  into  perturbed 
and  undisturbed  parts.  Following  .the  choices  of 
Seitter,  we  let  K  =  0.0078,  f  =  10  s_,  and  H  “  8 
kn  (approximately  the  density  scale  heioht).  This 
yields  an  external  gravity  wave  speed  of  /(gH)  *  280 
o/s. 

III.  The  Dual  Grid  Method 

The  two  key  issues  in  implementing  the  dual 
resolution  method  ate:  taj  tbs  identification  of  the 
model  forcing  terms  which  contribute  to  shorter 
gravity  waves  and  thus  warrant  higher  resolutions, 
!b)  the  design  of  an  mtergtid  information  transfer 
procedure  between  the  finer  grid  d(6x,6tj  and  the 
coarser  grid  D(£x,stl,  where  6  and  6  denote 
increments  m  grids  d  and  D,  respectively-  *fce 
identification  problem  is  not  always  easy.  In  ;<•! 
case,  however,  it  is  known  that  the  ,s>aian«  between 
the  pressure  gradient  and  the  linear  divergence  terms 
are  largely  responsible  for  the  gravity  waves. 
Although  "the  role'of  the  viscous  terms  is  to  sipilate 
damping,  we  also  discretize  them  at  a  higher 
resolution  on  the  grounds  that  they  represent  smaller 
scale  phenomena  and  that  in  «sre  realistic  models,  E 
is  a  function  of  the  flow  field  itself.  For  interarid 
transfers,  *e  simply  use  discrete  Fourier  ss&.-t hlr.g 
and  interpolation.' 
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Thus  given  initial  conditions  on  d,  we 

(1)  smooth  values  of  dependent  variables  on  d  to 
get  smoothed  values  on  D; 

(2)  compute  longwave  tendencies  R( A)  on  D; 

{3)  interpolate  R (A)  to  get  R(S)  on-d; 

(4)  compute  gravity  wave  tendencies  g(S)  on  d; 

(5)  time-integrate  on  d,  using  R( 5)  from  (3)  and 
g(S)  from  (4)  above; 

(6)  repeat  steps  (4)  and  (5)  for  (At/St)  times; 

(7)  repeat  steps  (1)  through  (6). 

The  main  point  here  is  that  time  integration  is 
done  on  the  finer  grid  at  time  intervals  St,  but  with 
the  longwave  tendencies  computed  only  on  the  D  grid. 
Another  way  of  looking  at  it  is  that  while  longwave 
tendencies  are  computed  less  frequently  on  a  coarser 
grid,  they  are  interpolated  onto  the  finer  grid  and 
then  fed  into  the  total  tendencies  at  the  smaller  St 
interval  through  step  (5).  It  should  be  noted  that 
step  (1)  ensures  finer  grid/coarser  grid  interactions 
and  that  this  selective  adaptation  of  grid  resolu¬ 
tions  according  to  the  characteristic  scales  of  the 
modeled  phenomena  should  be  done  both  spatially  and 
temporally.  Although  our  multi-resolution  approach, 
in  which  the  sizes  of  the  time-steps  are  tailored  to 
wavelengths  and  wave-speeds,  enables  us  to  use  the 
computationally  much  simpler  explicit  time-scheme, 
for  the  studies  reported  here  we  have  incorporated 
Robert's  semi-implicit  time  scheme  for  pedagogical 
purposes. 

IV  Preliminary  Results 

The  procedure  given  in  Section  III  has  been 
tested  with  the  shallow  water  model.  For  comparison 
purposes,  model  equations  were  solved  in  two  dif¬ 
ferent  ways.  In  one,  we  simply  used  a  centered- 
difference,  explicit  time  scheme  with  a  weak  time 
filter  (filtering  coefficient  a  °  0.02)  to  couple 
even/odd  time  steps  in  the  conventional  manner.  In 
the  other,  we  solved  a  set  of  equations  derived  from 
(5),  (6)  and  (7)  using  the  dual-grid  semi-implicit 
method.  Periodic  boundary  conditions  were  used  for  a 
38,400  km  domain  which  contains  240  finer  mesh  points 
(6x  -  160  km),  but  contains  15,  30,  60,  and  240  mesh 
points,  respectively,  for  various  coarser  grids. 
Time-step  5t  was  set  at  60  seconds,  with  the  coarser 
grid  At  =  2St.  A  small  St  was  used  deliberately; 
although  a  300  second  St  has  been  used  in  some  test 
cases  for  time-integrations  up  to  5  days. 

Initially  the  fluid  was  assumed  to  be  at  rest.  A 
sudden  disturbance  one-tenth  the  size  of  the  domain 
was  then  imposed  on  h  at  the  center  of  the  domain,  as 
shown  schematically  by  the  upper  solid  curve  in  Fig. 
1.  (Only  half  of  the  domain  is  shown.)  The  other 
curves  in  Fig.  1  show  the  height  distributions  of  the 
free  surface  at  model  times  4,  8,  16,  and  24  hours. 
(We  have  displaced  the  curves  vertically  for  clarity 
in  the  display. )  We  see  that  the  free  surface  waves 
propagate  both  up  and  down  stream  with  diminishing 
amplitudes  during  the  first  24  hours  in  the  model,  in 
fact,  the  primary  waves  shown  for  hour-24  are 
retrograde  waves  originating  at  the  center  of  the 
domain.  In  24  hours,  they  have  propagated  slightly 
more  than  half  of  the  domain.  Fig.  2  shows  the  energy 
spectra  of  the  height  fields  for  the  longest  25  waves 
at  t  =  0,  and,  at  24  hours  as  given  by  the  two 
methods  of  solution.  Initially,  the  energy  spectrum 
is  relatively  smooth,  with  a  single  peak  at  wave 
numbers  15  and  16.  At  24  hours,  a  bimodal  distribu¬ 
tion  has  developed  in  both  model  solutions, 
apparently  due  to  the  rapid  removal  of  energy  at  the 
initial  spectral  peak.  Furthermore,  even  in  the  cases 
shown  (dual  grid  solution  with  Ax  =  165x),  where  the 
solutions  diverge  the  most  and  where  the  energy 
spectra  seem  to  be  off-set  by  one  or  two  wavenumbers, 
on  the  whole  the  two  solutions  possess  remarkably 
similar  spectral  characteristics. 


Fig.  1  Time-evolution  of  surface  waves 
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The  instantaneous  energy  growth  rate  oe  is  now  defined  as 
E-'dE/dt. 

An  equation  for  the  perturbation  potential  enstrophy  H  is 
obtained  by  multiplying  (1)  by  q  and  proceeding  as  for  the  en¬ 
ergy  equation.  The  potential  enstrophy  growth  rate  an  is  de¬ 
fined  as  H~ldHjdt.  For  an  arbitrary;perturbation  '<  there  is  no 
reason  to  expect  <te  and  an  to  be  equal. 


Abstract  A  variational  principle  is  used  to  find  those  per¬ 
turbation  structures  which  have  the  fastest  divergence  from  a 
basic  state  in  linearized  shear  flows,  and  for  finding  the  initial 
rate  of  divergence.  The  technique  requires  the  existence  of  a 
positive  definite  quantity  (e  g  ,  energy  or  potential  enstrophy) 
whose  growth  rate  can  be  expressed  as  a  function  of  the  in¬ 
stantaneous  perturbation  structure.  The  problem  reduces  to 
a  fourth-order  nonlinear  ordinary  differential  equation  for  the 
structure  function,  which  can  be  solved  using  various  iterative 
numerical  techniques.  Green’s  model  of  baroclinic  instability  (1) 
is  presented  as  an  illustration  of  the  method. 

1  Introduction 

A  large  class  of  waves  in  shear  flows  have  instantaneous-growth 
rates  significantly  larger  khan  normal  mode  growth  rates  [2].  A 
consequence  of  this  is  that  error  growth  in  numerical  forecast 
models  can  be  faster  than  predicted  by  calculations  of  the  first 
Lyapunov  exponent  (or  growth  rate  of  the  most  unstable  normal 
mode).  Questions  which  then  arise  are.  is  there  a  bound  on  the 
instability  of  these  non  modal  disturbances?  If  so,  what  is  it 
and  what  is  the  structure  which  attains  this  bound? 

In  order  to  define  admeasure  of  instability,  we  seek  a  norm 
such  that  the  perturbation  growth  rate  in  that  norm  can  be 
expressed  entirely  as  a- function  of  the  perturbation  structure 
and  the.  basic  state  flow.  The  perturbation  structure  can  then 
be  varied  in  order  to  maximize  the  growth  rate. 

2  Green’s  model 


3  Constraints 

Consider  first  the  inviscid  case  (he.,  r  —  0).  Where  Qu  y?  0,  we 
can  multiply  (1)  by  q,  average  horizontally,  divide  across  by  Qu, 
and  integrate  vertically  to  obtain 

^  =  -£vqdz  =  0,  (8) 

where  the  wave  action  (or  pseudomomentum)  A  is  defined  (for¬ 
mally)  by 

A  =  0.5  /  ( q2IQv)dz .  (9) 

Jo 

Where  Qy  vanishes  the  definition  of  A  in  (9)  can  be  modified 
straightforwardly.  Eq.  (8)  implies  that  A  is  a  constant.  We  set 
A  —  0  since  this  is  the  omy  value  for-which  A  is  independent  of 
the  perturbation  amplitude,  which  is  arbitrary. 

When  surface  friction  is  included,  the  appropriate  constraint 
becomes  aA  —  ax,  where  ax  is  the  growth  rate  in; some  norm 
(e.g.,  the  energy  or  potential  enstrophy  norm),  and  the  wave- 
action  growth  rate  aA  is  defined  as  A~ldA/dt. 

4  The  variational  principle 

The  problem  now  is  to  maximize  an  (or  an)  subject  to:  the  con¬ 
straints  derived  above.  In  the  inviscid  case,  we  render  stationary 
the  functional  C,  where 


Consider  a  basic  state  wind  U(z),  in  a  Boussinesq  fluid  with 
constant  stratification  on  a  /3-plane,  confined  between  rigid  sur¬ 
faces  .at  z  =  0  and  z  =  1.  The  governing  equations  are  the 
linearized  nondimensional  quasi-gcostrophic  potential  vorticity 
equation,  along  with  the  boundary  conditions 


1l  = 

-Uqx~vQv, 

0  <  z  <  1 

(1) 

1 !>zt  = 

-Ulpzz  +  vUz, 

Z  =  1 

(2) 

i>zt  = 

-Ulpzz  +  vUz- 

rV2^,  z  =  0. 

(3) 

Here  lowercase  letters  represent  perturbation  quantities,  while 
uppercase  letters  refer  to  basic  state  quantities.  The  basic  state 
potential  vorticity  gradient  is  Qy,  defined  by: 


Qy  =  P~UIZ>  (4) 

The  dimensionless  parameter  r  represents  Ekrnan  pumping  at 
the  ground.  The  perturbation  streamfunction  ip(x,  y,  z,  t)  is  re¬ 
lated  to  the  wind  components  by  u  =  —ipv,  v  =  ipx,  and  to  the 


potential  vorticity  q  by 

q  =  V2ip  +  i>Iz.  (5) 

An  energy  equation  is  obtained  by  multiplying  (1)  by 
and  proceeding  in  the  usual  way.  We  obtain. 

^  =  ~f0  Wdz  -  r(Wp|(l=0).  (6) 

Overbars  represent  a  horizontal  domain  average.  The  total  en¬ 
ergy  E  is  defined  by: 

E  =  0.5  [\VVW  +  W*y}dz.  (7) 

Jo 


C=aE-  AA.  (10) 

In  the  case  with  friction,  (10)  is  replaced  by 

£  =  eriJ  -  A((Tb  -  a A).  (11) 

For  optimal  potential  enstrophy  growth  rates,  oe  is  replaced  by 
an  in  (10)  and  (11).  Now  let  i/>(x,  y,  z,  t)  =  t/>(z,  t)e'lkx*lv^  -f  cc. 
From  Here  on  the  method  is  exactly  analogous  to  the  derivation 
of  Lagrange’s  equations  from  a  variational  principle  [3]. 

The  same  procedure  is  followed  for  all  cases.  For  optimal 
energy  growth  in  the  inviscid  case,  we  obtain  a  fourth  order 
nonlinear  ordinary  differential  equation  as  a  structure  equation 
for  i>[z)  (henceforth  dropping  the  “hat”).  For  Uz  =  const  (the 
classical  Green’s  model)  this  equation  reduces  to: 

'l>zzzz-(2K3+'yaE)Tpzz+2i~ikUz‘ilix+(LKi+')aEK2)ilj  =  0,  (12) 

where  7  —  QV/(XE)  and  K2  =  k2  +  l2. 

Boundary  conditions  may  be  obtained  for  (12)  in  exactly  the 
same  way  that  the  boundary  conditions  (2)  and  (3)  are  obtained 
for  (1).  This  yields: 

ipz  =  (ikUz/aE)i>,  Z  =  0;  z  =  1.  (13) 

Since  growth  rate  is  independent  of  the  wave's  amplitude  and 
phase,  these  quantities  may  be  arbitrarily  fixed  at  one  level  to 
provide  a  third  condition  on  (12).  A  fourth  condition  is  the 
integral  constraint  A  =  0,  which  is  necessary  to  determine  the 
value  of  the  multiplier  A. 

Assuming  that  a  consistent  value  of  as  exists,  the  general 
solution  to  (12)  has  the  form 

^  =  (14) 

1=1 
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where  m,  are  the  roots.of  a  quartic  equation  and  A,  are  (com 
plex)  constants  determined  by  the  boundary  conditions  and  con¬ 
straints. 

One  approach  to  solving  the  problem  (12)  with  its  boundary 
and  integral  conditions  is  to  fix  A,  E  ana  ag  initially  at  some 
arbitrary  values.  The  "constants”  A,  in  (14)  can  then  be  deter¬ 
mined.  This  solution  can  be  used  to  update  as  and  E  in  (12). 
Proceeding  iteratively  in  this  way,  the  values  of  a  e  and  E  used 
in  (12)  may  or  may  not  converge  to  values  consistent  with  their 
definitions.  Convergence  only  occurs  for  isolated  values  of  A 

The  approach  outlined  above  was  used  in  solving  the  Eady 
problem  (fl  —  0).  For  the  general  problem,  however,  the  opti¬ 
mal  structure  for  ip  was  obtained  by  discretizing  in  z ,  thereby 
reducing  (12)  to  an  algebraic  problem  which  was  solved  using 
standard  routines. 


5  Results 

In  the  results  presented  here,  0  —  0.5  and  the  optimization 
and  eigenvalue  problems  are  both  solved  in  a  20-layer  domain. 
Where.friction  is  included,  a  value  of  r  =  2  is  used. 

Fig.  1  shows  as,  a#, and  the  growth  rate  for  quadratic  func¬ 
tions  of  the  most  unstable  normal  mode.(referred  to  as  an)  as 
functions  of  zonal  wavenumber  k,  when  as  is  optimized.  The 
normal  mode  growth  rates  (aw)  show  the  well-known  separa¬ 
tion  between  the  so-called  Chamey  modes  (for  k  >  1.75)  and 
the  Green  modes  ( k  <  1.75).  The  curves  for  optimal  as,  and 
the  corresponding  an  all  decrease  monotonically  as  k  increases 
and  do  not  have  a  short-wave  cutoff,  at  least  in  the  inviscid  case. 


Fig.  1.  Growth  rate  as  a  function  of  zonal  wavenumber  k  (l  =  0) 
for  the  most  unstable  normal  modes  (quadratic  growth  rate  an), 
the  optimal  energy  growth  rate  (as),  and  the  corresponding 
potential  enstrophy  growth  rate  (an)-  Solid  curves  are  from  the 
inviscid  case,  dashed  curves  from  the  case  with  friction. 


Fig.  2.  Strcamfunction  structures  at  k  —  2.3  (r  =.  0).  (a)  the 
unstable  normal  mode;  (b)  the  optimal  as  wave. 


Fig.  2a  shows  the  structure  of  the  most  unstable  normal 
mode  (at  k  —  2.3)  in  the  inviscid  case.  The  phase  tilt  is  concen¬ 
trated  near  the  bottom  of  the  domain.  The  structure  which  has 
optirnal  energy  growth  rate  at  the  same  wavenumber  is  shown 
in  Fig.  2b,  it  has  a  phase  tilt  almost  uniform  with  depth.  This 
difference  between  normal  modes  and  optimal  structuresrseems 
to  be  quite  general. 

Fig.  3  shows  the  time-evolution  of  energy  and  potential  en¬ 
strophy.  growth  rates  from  an  initial  condition  of  optimal  ob  at 
k  -  2.3,  for  both  the  inviscid  and  viscid. cases.  All  cases  show  a 
similar,  smooth  evolution  pattern,  with  the  normal  mode  struc¬ 
tures  essentially  established  by  t  —  10.  However,  the  waves  have 
lost  their  character  as  optimal  structures  by  t  —  2. 

Normal  modes  in  the  vertically  disci  itized  model  have  also 
been  obtained  using  the  variational  principle  by  imposing  the 
extra  constraints  that  energy  and  potential  enstrophy  growth 
rates  in  each  layer  all  be  equal.  The  phase  speed  c  also  emerges 
from  this  analysis.  An  jV-layer  model  produces  a  nonlinear  alge¬ 
braic  system  of  4/7  — 2  equations  in  4 N  —  2  unknowns  —  clearly 
an  inefficient  way  to  find  normal  modes.  However,  the  exercise 
serves.to  demonstrate  the  generality  of  the  optimization  theory, 
and  in  practise  provides  a  check  on  our  other  results. 


Energy  and  potential  enstrophy  growth  rates 


Figure  3.  Time  evolution  of  energy  (solid)  and  potential  enstro¬ 
phy  (dashed)  from  an  initial  optimal  as  structure  at  k  =  2.3. 
Upper  two  curves  are  from  the  inviscid  case;  lower  curves  from 
the  viscid  case. 


6  Conclusions 

By  the  measure  of  growth  rate  in  the  energy  or  potential  en¬ 
strophy  norms,  optimal  structures  have  been  found  which  are 
significantly  more  unstable  than  normal  modes,  because  of  their 
freedom  to  grow  at  different  rates  in  different  places.  Normal 
modes,  which  grow  at  the  same  rate  everywhere,  appear  in  this 
perspective  as  severely  constrained  optimal  structures  Indeed, 
optimal  perturbations  can  grow  (at  least  initially)  even  where 
there  is  no  normal  mode  instability  at  all. 

An  intuitively  appealing  feature  of  the  optimally  unstable 
structures  is  that  they  vary  only  slightly  in  JV-layer  models  as 
JV  is  changed.  Normal  mode  growth  rates  and  structures,  on  the 
other  hand,  can  be  very  sensitive  to  the  value  of  JV  in  JV-layer 
models  [4,  5)  because  of  resolved  levels  falling  near  critical  levels. 
In  our  work  the  concepts  of  phase  speed  and  critical  levels  only 
arise  in  the  specially  constrained  case  of  normal  modes. 

The  mathematical  approach  employed  in  this  study  can  be 
applied  to  a  wide  range  of  instability  problems,  including  the 
instability  of  initial  conditions  in  forecast  models. 
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Abstract  A  neural  network  approach  is  presented  for  making 
short  term  predictions  on  time  series.  The  neural  networkdoes 
better  at  short  term  predictions  of  a  chaotic  signal  than  does  an 
optimum  autoregressive  model.  Also  the  neural  network  is 
clearly  capable  of  distinguishing  between  chaos  and  additive 
noise. 

I.  INTRODUCTION 

One  of  the  basic  tenets  of  science  is  making  predictions.  If 
we  know  previous  behavior,  how  can  we  predict  the  future 
behavior.  The  approach  in  many  sciences  requires  two  steps; 
construct  a  model  based  on  theoretical  considerations  and  use 
measured  data  as  initial  input.  Since  in  many  cases  the 
underlying  theoretical  principles  are  known,  model  construction 
has  been  and  continues  to  be  a  primary  area  of  interesting 
research. 

One  class  of  alternative  approaches  is  to  build  models 
directly  from  the  available  data.  For  these  methods  the  data, 
given  as  a  time  series,  is  usually  considered  a  single  realization 
of  a  continuous  random  process.  This  is  appropriate  when  the 
randomness  is  a  result  of  complex  inteiactions  involving  many 
independent  and  ultimately  irreducib'  *  degrees  of  freedom. 

Along  these  lines,  linear  models  have  had  some  success 
especially  in  regards  to  relating  cause  and  effect  to  physical 
phenomena,  however,  their  predictive  power  is  limited.  The 
limitation  is  perhaps  related  to  the  inability  to  model  the 
evolutionary  dynamics  of  the  system  [1], 

In  the  last  decade  advances  in  the  theory  of  dynamical 
systems  have  demonstrated  the  existence  of  dissipative 
systems  whose  trajectories  that  depict  their  asymptotic  final 
states  are  not  confined  on  limit  cycles  (periodic  evolutions)  or 
tori  (quasi-periodic  evolution)  but  in  submanifolds  of  the  total 
available  phase  space  which  are  not  topological.  These 
submanifolds  are  fractal  sets  and  are  often  called  strange 
attractors.  The  corresponding  dynamical  systems  are  called 
chaotic  systems  and  their  trajectories  never  repeat.  Thus,  their 
evolution  is  aperiodic  but  completely  deterministic.  Because  the 
evolution  is  aperiodic  any  "signal”  measured  from  a  chaotic 
dynamical  system  “looks”  quite  irregular  and  exhibits  frequency 
spectra  with  energy  at  all  wavelengths  (broadband  spectra) 
similar  to  those  of  random  “signals”.  Another  important 
property  of  chaotic  dynamical  systems  and  their  strange 
attractors  is  the  divergence  of  initially  nearby  trajectories.  Due 
to  the  action  of  the  attractor  the  evolution  of  the  system  from 
two  (or  more)  nearby  initial  conditions  will  soon  become  quite 
different.  Since  the  measurement  of  any  initial  condition  is 
subjected  to  some  error  such  a  property  imposes  limits  on  long¬ 
term  prediction.  Nevertheless,  for  a  short  time  nearby 
trajectories  may  not  diverge  significantly  and  thus  even  though 
each  individual  evolution  might  be  quite  complex,  the  knowledge 
of  the  dynamics  and  especially  of  the  structure  of  the  attractor 
(dimensions,  Lyapunov  exponents,  etc.)  may  prove  beneficial  to 
the  an  of  short-term  prediction. 

Motivated  by  the  above  ideas,  very  recently  a  number  of 
techniques  for  making  predictions  have  been  developed  to 
exploit  the  underlying  determinism  in  complex  systems  [2,3,4J. 
The  purpose  of  this  paper  is  to  show  that  neural  networks  are 
capabable  of  making  short-term  predictions  on  time-series  data 
that  are  better  than  an  optimum  autoregressive  model  and  to 
show  that  such  a  methodology  is  capable  of  distinguishing  chaos 
from  noise. 

II.  EXAMPLES 

In  this  section  we  present  two  examples  showing  the 


effectiveness  of  us.ng  a  neural  network  for  making  predictions  on 
time-series  data.  In  general'neural  networks  work  by  iteratively 
solving  for  a  weight  matnx  which  is  used  for  the  inner  product 
that  takes  inputs  to  outputs.  For  time-senes  prediction,  the 
inputs  are  taken  as  lagged  values  of  the  discrete  time  sequence. 
More  details  concerning  neural  networks  are  given  in  Rumelhart 
et-al.  [5]  and  Owens  and  Filkin  [6]. 

The  neural  network  architecture  we  employ  consists  of  three 
layers,  one  input,  one  hidden,  and  one  output  layer  (fig.  1). 


Finiire  1.  Architecture  of  the  neural  network  used  in  the 
study. 

Learning  is  achieved  using  back-propagation  of  errors  resulting 
from  the  difference  between  predicted  and  the  actual  values 
during  training  [6].  Both  of  the  time  senes  used  in  this  study 
consists  of  1000  data  points.  Training  is  performed  on  the  first 
500  values  with  subsequent  predictions  made  on  the  remaining 
500  values.  The  number  of  input  nodes  is  set  at  eight,  the 
number  of  hidden  nodes  is  set  at  three  and  the  number  of  ouput 
nodes  is  set  at  one.  Some  trial  runs  indicated  that  the  accuracy 
of  prediction  was  not  sensitive  to  small  changes  in  the  number  of 
input  or  hidden  nodes.  The  single  ouput  node  represents  some 
future  value  of  the  time  series  we  wish  to  predict.  Each  training 
pattern  consists  of  successive  time-delayed  values  of  the  senes 
similar  to  the  method  used  by  Pcrrett  and  van  Stekelenborg  [7J 
to  predict  annual  sunspot  numbers.  For  example,  if  we 

represent  the  series  as  x(t)  where  t=l,  2 .  1000,  then  the 

first  training  pattern  is  (x(l),  x(2) . x(8)}  and  the  ouput  we 

arc  trying  to  predict  is  (x(9)}.  Similarly,  the  second  training 
pattern  is  (x(2),  x(3), . . . ,  x(9)}  and  the  ouput  we  are  trying  to 
predict  is  (x(10)}.  Training  continues  over  all  input  patterns  for 
several  thousand  iterations. 

For  the  first  example  a  time  senes  is  taken  from  numerically 
integrating  the  Lorenz  system  [8]  consisting  of  three  ordinary 
differential  equations  describing  convection  of  a  fluid  warmed 
from  below  in  time.  The  lime  senes  of  convective  motion  after 
all  transients  have  diminished  is  shown  in  fig.  2a.  Positive 
values  indicate  upward  motion  in  the  fluid.  We  take  1000  values 
from  the  time  senes,  tram  the  network  on  the  first  500  values 
and  make  predictions  on  the  last  500  values.  Results  of  the 
neural  network  at  predicting  one  step  into  the  future  (points) 
compared  with  the  actual  values  (connected  line)  are  given  in  fig. 
2b.  The  normalized  root-mean-squarc  error  (RMSE)  between 
the  actual  and  predicted  values  is  0.072  where  zero  implies  a 
perfect  forecast.  Clearly  the  network  is  capable  of  captunng  the 
underlying  chaotic  dynamics  of  the  system. 

To  assess  the  predictive  ability  of  the  neural  network  against 
that  of  a  standard  statistical  model  we  fit  the  first  half  of  the  time 
scries  using  an  optimum  autoregressive  process  and  then 
compare  predictions  on  the  second  half  of  the  senes  from  both 
models.  For  the  autoregressive  model  the  time  senes  is  viewed 
as  a  single  realization  of  a  stochastic  process  which  is  taken  to 
be  stationary  and  having  a  Gaussian  disinbution.  Employing  the 
method  of  Katz  [9]  the  optimum  autoregressive  model  for  the 
time  scries  was  found  to  be  of  12th  order. 

Comparisons  between  the  models  are  made  by  quantifying 
how  the  prediction  accuracy  (skill)  decreases  as  predictions  arc 
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Fipure  2  a.  Time  series  of  convective  motions  generated  by 
numerically  integrating  the  Lorenz  system,  b.  Comparison 
of  the  actual  time  series  (continuous  line)  with  a  neural 
network  prediction  (dots). 

made  further  into  the  future.  To  do  this  we  make  a  prediction  one 
step  into  the  future  and  then  use  this  predicted  value: as  one  of 
the  lagged  inputs  for  the  next  prediction  two  time  steps  into  the 
future.  Similarly,  the  prediction  at  this  second  time  step  as  well 
as  the  previous  time  step  are  used  as.laggcd  inputs  for  the  next 
prediction  three  time  steps  into  the  future.  Doing  this 
successively  allows  us  to  compute  the  correlation  coefficient 
between  actual  and  predicted  values  as  a  function  of  prediction 
time  where  prediction  time  is  given  as  discrete  time  steps  into 
the  future.  The  correlation  coefficient  between  actual  and 
predicted  values  is  defined  in  the  standard  statistical  way  and  is 
widely  used  as  a  measure  of  predictive  skill.  This  procedure  is 
followed  for  both  the  neural  network  model  and  for  the  optimum 
autoregressive  model.  Results  are  shown  in  fig.  3a.  For  the 
first  few  steps  into  the  future  predictions  from  both  models  are 
good  and  the  difference  between  the  two  models  in  terms  of 
predictive  skill  is  small.  However,  the  neural  network  makes 
significantly  better  forecasts  than  does  the  autoregressive  model 
as  prediction  time  increases.  The  neural  network  model 
maintains  greater  predictive  skill  compared  with  the 
autoregressive  model  throughout  the  entire  forecast  period.  The 
autoregressive  model  is  essentially  a  linear  model  and  therefore 
incapable  of  capturing  the  inherent  nonlinear  nature  of  such  a 
record.  Since  the  signal  is,  in  fact,  chaotic  we  cannot  hope  to 
make  accurate  predictions  with  any  model  too  far  into  the  future 
and  we  see  the  predictive  slill  of  the  neural  network  also  drops 
to  near  zero  after  a  relatively  short  time. 

Recently  it  has  been  suggested  that  certain  nonlinear 
prediction  techniques  are  capable  of  distinguishing  between 
chaos  and  noise  in  time-series  records  [4],  We  demonstrate 
this  capability  with  neural  networks  by  comparing  the  above 
results  with  results  from  a  model  trained  on  a  time  series 
generated  from  discrete  points  on  a  sine  wave  having  a  unit 
amplitude  and  adding  to  it  at  each  step  a  uniformly  distributed 
random  variable  in  the  interval  [-0.5, 0.5].  Such  an  example  may 
display  dynamical  character  similar  to  chaotic  systems.  For 
example,  spectrum  analysis  will  result  in  spectra  exhibiting 
peaks  superimposed  an  a  continuous  background  and 
dimensional  analysis  may  indicate  anything  from  a  low- 
dimensional  system  (if  noise  is  weak)  to  a  random  signal  (if 
noise  is  strong). 

After  training  the  neural  network  on  the  first  half  of  the  signal 
composed  of  a  sine  wave  plus  noise  we  make  predictions  on  the 
second  half  and,  as  was  done  with  the  Lorenz  system,  we 
compute  the  correlation  coefficient  between  actual  and  predicted 
values  as  a  function  of  prediction  time.  The  nearly  horizontal  line 
in  fig.  3b  is  the  rcsult  of  this  procedure.  The  independence  of 
predictive  skill  with  prediction  length  for  this  example  is  in  sharp 
contrast  to  the  rapid  decrease  of  predictive  skill  for  a  chaotic 
signal  (also  shown  in  fig.  3b).  From  the  differences  we  suggest 
that  predicting  time  series  using  neural  networks  is  another 
method  for  differentiating  additive  noise  from  deterministic 
chaos.  With  a  simple  autoregressive  model,  predictive  skill  on  a 
time  scries  containing  periodicities  and/or  noise  will  show  a 
marked  dependency  on  prediction  length  making  them 
inappropriate  for  distinquishing  chaos. 


actual  values  and  predicted  values  as  a  function  of  prediction 
time  for  the  convective  motions  using  a  neural .  'twork 
model  (dashed  line)  and  using  a  optimum  autore?,  °ssive 
model  (solid  line).  b.  Correlation  coefficients  computed 
between  actual  values  and  neural-network  predicted  valuis 
as  a  function  of  prediction  time  for  the  convective  motio.s. 
(.dashed  line)  and  for  the  wave  plus  noise  (solid  line). 

III.  CONCLUSIONS 

In  applying  chaos  theory  in  the  analysis  of  time-series  data 
one  usually  begins  by  estimating  the  dimension  of  the  underlying 
attractor  [10,  11,  12,  13].  This  is  done  by  constructing  a  state- 
space  embedding  from  the  time  series  and  then  applying  some 
vanant  of  the  correlation  algorithm  [14].  The  dimension,  which 
is  given  by  the  power-law  (scaling)  behavior  of  the  correlation 
integral,  gives  a  measure  of  the  effective  number  of  degrees  of 
freedom  of  the  system.  Because  the  scaling  regions  used  to 
estimate  the  dimension  involve  only  a  small  number  of  distances 
between  points  in  the  state  space  much  of  the  information  in  the 
ume  senes  is  lost  which  for  relatively  short  series  can  cause 
senous  problems.  In  addition,  such  methods  cannot  in  general 
distinguish  output  from  a  random  process  from  output  as  a  result 
of  a  chaotic  dynamical  process  [15].  In  this  paper  we  show  the 
ability  of  neural  networks  in  making  time  senes  predictions  and 
demonstrate  that  such  methodology  is  capable  of  distinguishing 
between  additive  noise  and  chaos. 

Thanks  are  extended  to  Jay  Perrctt  ana  John  van 
Stckclcnborg  for  introducing  me  to  the  back-propagation  neural 
network  and  to  A.  A.  Tsoms  for  stimulating  discussions  dunng 
the  course  of  this  research. 
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Spurious  high  frequency  oscillations  occur  in 
forecasts  made  with  the  primitive  equations  if 
the  initial  fields  of  mass  and  wind  are  not  in 
an  appropriate  state  of  balance  with  each  oth¬ 
er.  These  oscillations  are  due  to  gravity- 
inertia  waves  of  unrealistically  large  ampli¬ 
tude;  the  primary  purpose  of  initialization  is 
the  removal  or  reduction  of  this  high  frequen¬ 
cy  noise  by  a  delicate  adjustment  of  the 
analysed  data.  In  this  paper  a  simple  method 
of  eliminating  spurious  oscillations  is 
presented.  The  method  uses  a  digital  filter 
applied  to  time-series  of  the  model  variables 
generated  by  short-?range  forward  and  backward 
integrations  from  the  initial  time. 

The  digital  filtering  technique  is  applied  to 
initialize  data  for  the  HIRLAM  model.  The 
method  is  shown  to  have  the  three  characteris¬ 
tics  essential  to  any  satisfactory  initializa¬ 
tion  scheme;  (a)  high  frequency  noise  is  ef¬ 
fectively  removed  from  the  forecast;  (b) 
changes  made  to  the  analysed  fields  are  ac¬ 
ceptably  small;  (c)  the  forecast  is  not  de¬ 
graded  by  application  of  the  initialization. 

The  digital  filtaring  initialization  (DFI) 
technique  is  compared  to  the  standard  non¬ 
linear  normal  mode  initialization  (NMI)  used 
with  the  HIRLAM  model.  Both  methods  yield  com¬ 
parable  results,  though  the  filtering  appears 
more  effective  in  suppressing  noise  in  the 
early  forecast  hours.  The  computation  time  re¬ 
quired  for  initialization  is  about  the  same 
for  DFI  and  NMI.  The  outstanding  appeal  of 
the  digital  filtering  technique  is  its  great 
simplicity  in  conception  and  application. 
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Abstract. 

The  multigrid  method  fui  numerical  solution  of  first  order  partial 
differential  equations  is  analyzed.  The  smoothing  iterations  are  of 
polynomial  type  and  are  used  on  all  grids,  also  the  coarsest.  It  is 
shown  that  the  convergence  is  independent  of  the  grid  under  certain 
conditions.  This  is  a  result  of  a  propagation  of  smooth  error  waves 
out  of  the  computational  domain  and  a  damping  of  oscillatory  error 
m.ides.  Numerical  experiments  illustiate  the  theoretical  results. 

Introduction. 

When  the  multigrid  method  is  used  for  the  numerical  solution  of  sys¬ 
tems  of  first  order  partial  differential  equations  such  as  the  Euler 
equations  of  fluid  flow,  it  is  not  necessary  to  solve  the  equations  ex¬ 
actly  on  the  coarsest  grid  to  obtain  good  convergence  characteristics, 
see  eg  [3].  For  elliptic  equations  all  proofs  of  grid  independent  con¬ 
vergence  assume  that  the  solution  is  determined  exactly  on  the  coar¬ 
sest  grid  [2].  Here  we  explain  why  the  behaviour  of  the  multigrid 
method  is  different  for  the  two  types  of  equations  and  prove  that  un¬ 
der  certain  sufficient  conditions  the  convergence  rate  is  independent 
of  the  grid  also  for  first  order  equations. 

Wave  propagation  and  damping. 

The  multigrid  strategy  adoptedherc  isa  V  cycle  with  a  few  pre  and 
postsmoothing  steps  before  going  to  and  after  returning  from  the 
next  coarser  grid.  Also  on  the  coarsest  grid  a  few  smoothing  steps  are 
taken.  Let  the  discretization  of  our  partial  differential  equation  be 

Qu  =  /. 

For  the  convergence  of  linear  problems  It  Is  sufficient  to  study  the 
case  f=0,  which  is  equivalent  to  looking  at  the  convergence  to  0  of 
the  initial  error.  The  relaxation  scheme  S  on  grid  1  is  assumed  for 
smooth  functions  to  be  such  that 

,*■  .  t  \  i  f  \  i  ni  uh 

-  f  —  ■  — -'.-c.  .  *  — ** ,  .  * 

where  a  hat  denotes  the  Fourier  transform  >uid  A',  is  a  small  para 
n  eter  like  a  time  step.  Itc.ativc  methods  of  this  kind  arc  Range 
Kum  time  stepping  [31  and  the  Chcbyshev  method  [7],  Tor  systems 
of  partial  differential  equations  with  constant  coefficients  in  two 
space  dimensions  it  is  shown  in  [5.  ;y  means  of  Fourier  analysis  tha’ 
oscillatory  pans  of  the  error  on  the  finest  grid  arc  damped  efficiently 
but  the  smooth  parts  of  the  error  are  not  damped  v  cry  well  The  diffe 
rence  be  twee",  first  order  and  elliptic  pdcs  is  that  in  the  first  case  the 
smooth  ,yait  of ’hr  error  is  prop,  .ated  out  through  open  boundaries 
Tltis  propagation  is  achieved  with  a  time  step 

At.  =  £  At,. 
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where  L+T  is  the  number  of  grids.  This  was  proved  in  [ij  for  L=l, 
one  space  dimension  and  a  scalar  equation.  Il  is  shown  in  [4,5]  that 
the  behaviour  of  the  smooth  pan  of  the  error  is  governed  by  thediffe- 
rennal  equation.  Let  us  keep  the  coarsest  gnd  fixed  and  add  finer 
grids  by  halving  the  step  size.  Then  die  smooth  pan,  which  is  well 
represented  on  all  gnds,  is  transported  oui  through  the  computational 
boundaries  at  a  rate  which  is  determined  by  the  differential  equauon 
and  the  accumulated  time-step.  A  lower  bound  on  this  rate  is  given 
by  the  rate  on  the  coarsest  grid.  Furthermore,  the  damping  of  the 
oscillatory  error  modes  can  be  made  independent  of  the  finest  grid. 
In  [4]  an  upper  bound  independent  of  the  finest  grid  size  is  derived 
for  the  number  of  V-cycles  needed  for  a  two-dimensional  scalar, 
constant  coefficient  first  order  pde  to  converge  with  the  multigrid 
method.  The  results  can  be  generalized  to  one  and  three  space  di¬ 
mensions  and  to  the  W-cycle. 

Numerical  experiments. 

A  central  difference  approximation  of  the  space  derivative  with  ad¬ 
ded  artificial  viscosity  and  a  Runge-Kutta  time-stepping  procedure 
as  in  [3]  are  used  in  die  first  two  examples.  The  coarse  grid  with  24 
points  is  the  same  in  the  grid  sequences  in  the  examples  and  the  step 
size  is  doubled  between  a  grid  and  the  next  coarser  grid.  There  is  one 
presmoothing  step  in  the  V-cycie.  In  fig.  I  a  simple  one-dimen¬ 
sional  example  is  displayed.  The  equation  is 

ti,  =  0. 

and  the  initial  error  moves  to  the  left  through  the  boundary  as  the 
iterations  proceed.  The  smooth  errorpulse  is  plotted  every  5:th  itera¬ 
tion.  Ills  damped  and  propagated  at  approximately  the  same  rate 
with  1, 2, 3  and  4  gnds.  In  [4]  similar  results  arc  obtained  with  the 
Chebyshev  method.  The  Eulei  equations  of  fluid  flow  aresolvcd  in  a 
two-dimensional  channel  with  a  bump  using  the  grids 40x1 2, 80x24 
and  1 60x48  in  fig.  2.  The  upper  and  lower  walls  are  solid  and  the  left 
and  right  boundaries  are  open.  The  Mach  number  of  the  flow  from 
the  left  is  0.5.  Tile  steady  state  solution  on  the  intermediate  gnd  is 
shown  and  iherateof  conveigcncc  is  measured  by  the  residual  of  rhe 
vii.iuiuity  equation  vcf.  [3jy.  No  attempt  has  been  made  to  optimize 
the  perfbnnance  of  the  method.  Finally,  m  fig.  3  three  steps  of  the 
GMRES  method  [6]  are  used  as  iterative  smoother  in  the  muhignd 
method.  The  equation  and  the  discretization  arc  the  same  as  in  fig.  1 
and  the  suiution  is  plotted  in  evciy  step.  The  results  with  the  initial 
bell  shaped  error  pulse  arc  sun  dar  io  those  in  fig.  1  with  a  convergen¬ 
ce  almost  independent  of  the  gnd  size  even  if  GMRES  docs  not  sau- 
fy  the  conditions  on  ihs  relaxation  scheme  with  a  constant  time-step. 
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Fig.  1 .  The  initial  bell  shaped  error  moves  to  the  left  as  the  multigrid  iterations  with  Runge-Kutta  time¬ 
stepping  proceed  (above).  Eventually  it  disappears  through  the  left  boundary.  The  number  of  grids  is 
from  left  to  right.  1,2,3  and  4.  The  coarse  grid  is  the  same.  The  logarithm  of  the  Euclidean  norm  of  u  as  a 
function  of  the  number  of  V-cycles  is  presented  showing  the  grid  independence  (left). 


Fig.  2.  The  intermediate  grid  and  isobars  of  the  Eulet  solution  are  displayed  to  the  left.  The  convergence  history  for 
the  multignd  method  with  Runge-Kutta  time-steppmg  for  1, 2  and  3  grids  is  shown  to  the  right  'The  coarse  grid  is  the 
same  in  all  cases.  The  loganthm  of  the  Euclidean  norm  of  the  residual  is  plotted  vs  the  number  of  V-cycks. 
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Fig  3.  The  initial  bell  shaped  error  moves  to  the  left  as  the  multignd  iterations  w  th  GN1RES  proceed 
(above)  Eventually  it  disappears  through  the  left  boundary.  The  number  of  grids  is  from  left  to  right.  1,2, 
3  and  4.  The  coarse  grid  is  the  same.  The  logarithm  of  the  Euclidean  norm  of  u  as  a  function  of  the  number 
of  V-cycles  is  presented  showing  the  grid  independence  (left). 
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Abstract:  We  solve  numerically  a  system  of  partial  differential  equa¬ 
tions  describing  the  motion  of  a  gas  in  which  a  chemical  reaction  occurs.  'We 
investigate  detonation  war  e  solutions  in  two  space  dimensions.  Poor  resolu¬ 
tion  of  the  reaction  layer  will  lead  to  prbt’>  ms  due  to  stiffness  of  low*;  order 
terms.  We  demons t. ate  such  a  failure  and  suggest  a  remedy  for  it. 


1.  Problem  to  Solve 
We  here  consider  the  equations 
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describing  a  fluid  in  which  a  one  step  irreversible  chemical  reaction  is  talc¬ 
ing  place.  p(x,  y,  l),  m{x,  n(x,  y,  f),  *  (x,  y,  l)  are  the  density,  x-and  y- 

momentum  and  energy  of  the  gas.  z(z,y,l)  is  fraction  unrcactcd  gas.  The 
pressure  is  given  by 

P  =  (l  -  1)(«  -  +  T?)jp  -  9o pz) 

and  the.temperature  is  defined  as  T  =  p/p. 

We  restrict  ourselves  to  two  space  dimensions  and  we  have  neglected 
iieat  transfer  and  viscos  effects.  We  will  focus  on  discountinuous  solutions, 
detonation  waves.  For  these  waves  the  '.‘Iseosity  is  not  as  important  as  for  the 
slower  deflagration  wave  solutions.  The  solutions  computed  have  qualitative 
features  agreeing  with  experimental  data. 

yc.?i,7.  K  are  parameters,  named  chemical  heal  release,  ignition  tem¬ 
perature,  Cp  to  c„  ratio,  and  equilibrium  constant  respectively. 

2.  Numerical  Method 

The  solution  to  (1)  b  in  general  discontinuous.  Numerical  methods 
specifically  designed  for  such  solutions  have  been  developed  in  recent  years 
[1,2].  We  use  a  T-VD  method  of  second  order  accuracy  to  approximate 
the  convective  fluxes  (3,-1],  the  right  band  side  is  solved  implicitly  by  the 
trapezoidal  rule. 

In  one  space  dimension,  we  introduce  the  grid  points  Xj,  j  =  . . . ,  —2, 
—1,1,2,..,  and  the  time  levels  fo,fi,fj...~  The  grid  spacing  b  Ar  = 
xj  —  z/_t:and  the  time  step  At  =  l„  — f„_i.  For  (he  equation 

Ut  -h /(“)*=  s(“)  -co  <  sr<  oo  l  >  0  (2) 

the  method  then  takes  the  form 

u;« = uj  -  aa+a;_i/2 + At  i(s(..;+I) + y(U;)) 

here.  A  =  Af/Ar  and  hy+j/j  —  A(u?+Zt  v]+i, u/ ,uj_i)  b  the  numerical  (lux 
function,  satisfying  the  consistency  condition 

h(u,u,  u,  u)  =  /(u) 

ujf-irthe  approximation  to  the  solution  at  the  point  (zj,ln).  The  spatial 
difference  operator  b  defined  as  A +aj  =  ai+I  -  aj  We  solve  the  implicit 
equation  for  v]**  using  Newton’s  method. 

The  approximation  in  two  space  dimensions  b  similar,  but  for  the  usage 
of  a  two  dimensional  grid  (r,,jft),y=  ,—  1,  -1,0,1,.  .  ..-1,-2, 

0,1 . 


3.  Some  Results  nnd  Failures 

The  following  values  of  the  parameters  were  used  m  the  computations. 
7]  —  50,  K  w  10000.  fa  -  50,7  =  1.2.  The  computational  domain  was  t  *  1 
in  sire  and  a  grid  was  moved  along  with  the  detonation  wave. 


Initially  a  Chapman-Joguct  wave  was  *lsrted  along  a  slightly  curved 
front.  Figure  1  shows  a  solution  computed  on  a  100x50  grid,  using  a  cfl 
number  of  0.4  The  solution  i»  displayed  at  six  diffcient  tunes,  to  show  hc.w 
the  triple  points  move  back  end  forth.  This  behavior  leads  to  the  cellular 
pattern  observed  in  experiments  [5]. 


figure  1,  density  contour  lice* 


figure  2  shows  the  same  solution  computed  with  a  twice  larger  time 
step,  i.e.  .cfl— 0.8.  For  thb  time  step  the  method  is  stable  according. to  linear 
stability  analysb.  At  a  certain  time  the  triple  points  cease  to  move  and  a 
pattern  with  a  triangular  shape  extending  from  wave  fiont  emerges.  The 
solution  then  stays  that  way  for  all  times.  No  movement  ol  the  triple  points 
in  the  y  direction  b  observed  This  b  not  a  realistic  solution. 


figure  2,  density,  contour  lines 


It  is  well  known  that  difficulties  due  to  stiffness  is  encountered  for  A' At 
large,  even  when  using  an  implicit  method  for  the  right  hand  side.  Sec  [5,7] 
for  discussions  of  the  one  dimensional  problem. 

We  can  undersland  this  difficulty  by  considering  the  last  equation  in 
(1).  The  approximation  described  above  will  lead  to  the  expression 


(p--ri = 


(pc);  -AA^hy„1/3 
1  +  AtKe~T’fr 


(3) 


here- we  simplify,  by  neglecting  the  dependency  of  T  on  pc,  (thb  simplifi¬ 
cation  is  not  done  in  the  computations  )  If.  the  temperature  increases  near 
7),  and  if  K&l  b  large,  (pc)J+I  will  immediately  drop  to  zero,  A  small 
change  in  temperature  triggers  a  large  change  in  z  which  in  its  turn  effects 
the  temperature  through  the  third  equation  in  (1),  the  result  can  become  a 
wave  traveling  at  the  unphysical  speed  one  grid  point  per  lime  step. 


•1.  An  Improved  Method 

A  dcionalion  wave  consists  ol  a  eon  reacting  shock  wave  which  first 
increases  She  temperavure  of  the  fuel  mixture,  so  that  ignition  occurs  behind 
the  shock  wave.  No  chemical  reacts  as  start  before  the  shock  wave  has 
passed  through.  We  try  to  emulate  this  behavior  in  the  numerical  method 
Numerically,  there  are  always  a  few  grid  points  in  the  shock.  \Vc  want  tc 
make  sure  that  none  of  the  points  inside  the  shock  triggers  the  chcmbtry. 
The  simplest  way  of  ensuring  thb  b  to  evaluate  the  ngbi  hand  side  a  few 
grid  points  ahead  of  ihe  shock.  This  method  has  been  successful  in  one  space 
dimension.  The  main  point  of  this  paper  is  that  the  method  also  remedies 
the  error  in  our  two  dimensional  compulation  above. 
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Figure  3  showsthesime  computation  as  figure  2, -with  tire  exception 
that  thee  right  baud  side  is  evaluated  one  grid-joint -sat  from  the  wave  front. 
Tic  direction  i?  which  t(i  go  is  determined  as  the  direction  of  smallest  tem¬ 
perature.  i.c.  in  one  space  dimension  are  evaluate 

(p:)?1  s(pa)J-M+A^VI-  if/f0.a);+je-r'^ 

with  d-:  the  value  of  i-  that  minimize-:)  'I'p+t  over  6  =  —1,0,1.  The  two 
dimensional  case  is  thi  straightforward  generalization  of  this  procedure. 


figure  3,  dcnJi  tj  contour  lines . 


We  plot  density,  contours  of  the  soluticn  on-a  domain  determined  by 
the  time-  and  y-axis.  The  same  cellular  pattern  as  seen  on  sooted  plate 
recordings  in  experiments  (5]  appears.  Figure  1, 5  and  6  shew  these  plots  for 
the  cases  discussed  above.  Figure  4  is  computed  with  the  small  time  step, 
figure  5  with  the  tiyiccJarger  time  st-p  ar.d  finally  figure  6  is  obtained  using 
the  larger  time  step  and  the  modification. 


figure  4;  the  y-t  plane 


figure  5,  the  y-t  pUne 


figure  6,  ibr  p-f  plane 


Both  the  *im  with  small  timestep,  and  the  modified  m  "  ad  with  larger 
time  step  predicts  approximately  the  same  sixe  for  the  detonation  cells. 
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Abstract- Thts  paper  presents  a  software  design  approach  for  CFD  software. 
The  approach  is  based  on  the  Data  Structure  design  methodology  and 
results  to  an  architecture  built  around  the  Blackboard  structure.  An 
cxpcnmcntal  prototype  implementation  of  this  approach  is  desorbed 
particularly  with  reference  to  the  Blackboard  structure  as  well  as  the 
integrauon  of  an  Intelligent  Knowledge  Based  System  in  the  lurm  of  a 
rulebasc  and  a  set  of  qualitative  data  entries. 

I.  INTRODUCTION 

Computational  Fluid  Dynamics  tCFDy  software  is  a  continuously 
developing  area  m  cnginccnng  software  which  is  panicuiarly  know  n  fur  its 
highly  algorithmic  nature  as  well  as  the  diversity  of  its  application  fields 
within  science  and  cnginccnng.  Different  areas  such  as  aerodynamics, 
meteorology,  thermodynamics  and  chemical  reactions  modelling  arc  among 
those  providing  a  long  queue  of  new  mathematical  models  for  solution  by 
a  CFD  software  package. 

The  need  for  integration  of  all  phases  and  aspects  of  the 
mathematical  modelling  process,  from  problem  set-up  to  the  final  results 
validation  and  interpretation  as  well  as  the  quest  for  more  reliable  and 
accurate  solutions  have  increased  the  demands  on  CFD  software  in  terms 
of  complexity  and  efficiency.  The  increasing  ava.lability  and  accessibility 
of  more  powerful  computer  Hardware  tn  terms  of  memory  and  processing 
speed  has  not  managed  to  quench  the  thirst  for  increased  power  of  the  CFD 
modelling  community  but  on  the  contrary  n  has  increased  the  appetite  foi 
solutions  to  even  more  complex  modelling  problems.  An  other  aspect: is 
that  the  number  and  the  unpredictability  of  tilt  changes  in  specifications 
and  requirements  that  arc  usuat.y  expected  during  utc  iong  hL  -ycie  cf  a 
CFD  software  product  make  the  maintainability  of  the  software  imperative. 

Finally,  the  interactive  nature  ol  modem  CFD  modelling  software 
and  the  diversity  of  the  end  use  is  of  the  software  procuct  longing  from  die 
mathematician,  the  numerical-  analyst  and  the  software  analyst  to  the 
specialised  scientist  and  engineer,  all  with  different  degrees  of  expertise  m 
Ihc  use  dl  (he  software,  make  the  human  interface- a  decisive  facioi  in  the 
overall  performance  of  the  software. 

Aft  these  call  for  a  fresh  approach  to  me.  design  of  CID  software, 
using  an  overall  strategy  which  has  co  be  formally  defined,  wnh  specific 
methods,  tools  and  goals  which  can  be  referred  to  and  used  for  validation 
of  the  final  software  product 

A  Software  design  approach  for  CFD  software 

For  the  construction  of  an  overall  design  approach  for  CFD 
software,  a  is  necessary  to  identify  the  most  important  swgcs  of  the 
software  development  life-cycle  where  vnai  decisions  wiii  be  iakcn 
influencing  and  determining  the  final  quality  of  the  software  product 

We  could  highlight  the  following: 

fat  The  choice  of  a  formal  software  design  straiegv-  The  common  strategy 
used  for  CFD  software  design  is  the  Data  Flow  design  approach 
lYourdony  which  views  the  overall  software  structure  as  based  on  the 
flow  ol  data  between  a  senes  of  software  modulo  that  transform  the  Jam 
in  a  continuous  fashion  ultimately  from  input  to  output  data.  This  view 
which  has  a  taste  of  the  old  batch-yob  days,  revugmscs  die  dominance 
algonthms  and  processes  ova  the  aauai  structure  of  ihc  data.  .Nevertheless, 
dunng  the  hfc-cyclcol  a  CFD  package,  the  algorithms,  liie  vanoua  soiuuon 
techniques  and  processes  are  much  more  utciy  iu  change  than  the  structure, 
of  the  database  which  represents  the  problem  used. 

The  highly  physical  and  cspcuaiiy  geometrical  nature  of  the 
underlying  mathematical  model  creates  the  need  lot  an  accurate  and 
flexible  representation  of  the  real  physical  problem,  mat  is,  the  specific 
portion  of  reality  rcicvanito  the  problem.  Hits  leads  to  a  Data  Struwure 
design  approach  iJacksonj,  which  is  based  on  the  conceptual  database 
schema.  This  is  the  static,  lime-invariant  and  solution  independent  view  of 
the  problem,  which  can  be  the  sound  design  foundation  for  the  resulting 


software  structure.  Die  conceptual  schema  can  be  constructed  using  the 
Entity -Rclauonship  appruach^Chcn',Knighf>  and  it  can  be  shown  that  a 
useful  pafliuon  can  be  made  into  problem  and  solution  spaces(Pctridis  ct 
al ).  Lsing  this  schema  we  can  design  a  flexible,  well  defined  database  By 
reference  to  this,  a  senes  of  cohesive  and  uncoupled  software  modules  can 
be  built,  leading  to  an  overall  software  design  based  jn  the  infotmatior 
hiding  principle. 

(b~)  Integration  into  a  software  architecture-  Once  the  database  and  the 
software  modules  have  been  properly  designed  and  defined,  there  is  a  need 
for  an  overall  architecture  dial  can  provide  the  operational  framework  of 
die  software  paekage.  Dus  architecture  must  be  defined  in  terms  of 

1.  The  control  structure 

2.  The  modular  communications  structure  and  mechanism 

3.  The  human  interface 

fey  The  r1  .Ign  of  the  humanfuser)  interface-  The  human  interface  must  be 
able  to  respond  to  the  user  in  a  natural  and  friendly  way.  It  should 

■  Communicate  to  the  user  using  a  set  of  terms  and  concepts  in  a 
form  that  is  r.aturaiiy  perceived  by  him. 

-  Give  a  flexible  and  layered  "feet"  to  the  different  uscis(in  terms 
of  baekground  anj  expertise^  that  may  use  the  Software. 

Integrate  expert  knowledge  and  InfcrcHcing  procedures  into  the 

software. 

Give  die  ultimate  control  ui>J  decision  making  to  the  user. 

One  way  of  tackling  these  points  is  by  integrating  an  Intelligent 
Knowledge  Based  System  vIKBS,  into  the  software.  Typically  1KBS 
systems  arc  capable  of  delivering  man,,  of  the  requirements  of  such  a 
design.  They  allow  ilk.  integration  of  muc.i  of  die  expertise  needed  in  such 
a  design,  in  a  particularly  flexible  and  ineitmenublc  wav  Expertise  exists 
in  many  different  areas.  Foi  example  in  ihc  solution  method  itself,  in  terms 
of  speed  and  accuracy,  and  in  terms  of  the  user  requirements  of  the 
software,  what,  sort  of  solution  docs  the  uset  want?  These  requirements 
constitute  what  is  afte.  referred  to  as  Intelligent  Front  Ends(RissIand*)  to 
software.  However  it  is  argued  here  that  this  reference  gives  the  wrong 
view  of  the  architecture  for  intelligence,  since  it  implies  e  j  it  can  be 
bolted  on  to  existing  software  packages.  Die  view  we  take  here  is  that  the 
architecture  for  die  system  must  allow  for  a  more  integral  IKBS 
component.  Expertise  exists  at  every  level  of  CFD.  from  solution  method 
to  physical  processing  requirements,  to  user  interface. 

The  integration  of  the  software  into  the  overall  software 
architecture  which  was  discussed  in  point  (b)  above,  is  the  design  decision 
that  will  affect,  most  the  resulting  software  quality  mainly  in  tenns  of 
maintainability  and  efficiency.  One  suJv  archiicolurc  which  has  shown 
considerable  advantages  foi  budding  CFD  software  packages  is  presented 

in  the  following  sections. 

The  Bb.ckbo.ini  architecture 

The  Blackboard  arcnncctuic  is  a  software  framework  that  has  its 
roots  m  Artifiviat  intelligence  ^Morgan  >.  ft  is  built  around  the  Blackboard 
tB-By  construct  which  is  used  as  the  main  mechanism  for  passing 
mlormalion  and  control  between  software,  moduli -s.  As  its  name  indicates, 
the  blackboard  is  basically  a  mechanism  (hat  stores  several  pieces  of 
information  and  on  which  a  number  of  software  modules  have  restricted 
access  to  wme and  read.  As  shown  in  figure  1.  modules  A  and  B  have  both 
access  to  parts  of  the  B  B  and  so  can  selectively  share  information  they 
need  for  then  function.  This  is  a  flexible  way  of  passing  data  from  one 
module  to  an  other,  hiding  if  necessary  information  aLwul  the  nature  of 
these  data,  as  each  module  knows  where  to  find  ihc  information  it  needs. 
The  Database  Management  SvsicimDBMS,  can  be  used  as  a  fine!  of  such 
information  providing  different  modules  with  lilt  data  they  request  and  in 
the  form  they  need  them. 


The  B-B  architecture  for  Cl:D  softw-., 


Figure  1  The  Blackboard 


The  Blackboard  _ j 

architecture  was  implemented  juiac<ooara  j  | 

in  an  experimental  prototype  ^  i 

CFD  application  which  was  _ _ _ _ _ I 

built  to  demonstrate  this  (  ih 

approach  to  CFD  software  \  'y - \ 

design.  This  is  a  working  CFD  /  A  \  f  Q  > 

package  developed  to  deal  with  .  •  >  i  i_j  i 

a  characteristic  family  of  CFD  V  J  \  / 

modelling  applications.  It  is  w - '  — 

essentially  a  two  dimensional  Figure  1  The  Blackboard 
transient  scalar  multiphase 
finite  difference  code 

containing  among  others  a  numba  ot  numerical  soi»crs  and  gnd  generators 
that  can  be  used  to  tackle  a  class  of  application  problems.  Hie  code  is 
implemented  in  the  C  programming  language  and  runs  under  vanous 
operating  systems.  The  database  and  the  software,  modules  are  designed 
using  a  Data  Structure  oriented  approach  and  the  whole  software  structure 
is  built  around  the  Blackboard  architecture  as  shown m  Figure  2. 

The  information  stored  _  'Jse^ 

on  the  Blackboard  is  an  ' 

abstraction  of  the  infonnation  g 

stored  in  the  working  database.  5  \ 


on  the  Blackboard  is  an  ' 

abstraction  of  the  infonnation  g  irWlJi  1 

stored  in  the  working  database.  5  \ 

as  the;  Blackboard  provides  an  L  ■  , 

abstract  overview  of  the  — S 

problem  and  the  solution  for  T,  _  D 

the  given  modelling  applicauon  \  -  -  ~ 

together  with  the  state  of  the  ^ - -r .  yc 

modelling  process  at  any  given  [V  ^ 

point  in  time  as  well  as  the  J  X  ^ 

dynamic  of  the  processes  and  et  ~y~T~ - 

tasks  that  arc  currently  V-.  pA 

exacting  or  are  waiting  to  be  (PJ  V-s  's-j' 
executed.  As  shown  in  Figure  \  (T  ( 

2,  the  Blackboard  system  I 
comprises  of  the  blackboard  (Obase  ( 

database  around  which  a  !_ _  _ 

database  management  system  is  p,curc  2  The  Blackboard  architecture 

pra»,vpc 


Ml.  t»  alow  a  tail*  and  !ol 

polymorphic  view  of  the 
Blackboard  data  from  the 

accessing  software  modules.  The  Blackboard  iiscn  is  mipiemcnicu  as  a 
hierarchical  structure  containing  information  abuui  Ore  probiun.  roc  solution 
sellings  and  state  at  any  point  and  a  task*  buffet  containing  a  numba  ot 
tasks  that  have  been  decided  to  fire  but  did  not  have  the  opportunity  to 
do  SO  yet.  A  task  is  implemented  as  a  piece  of  data  encapsulating  a 
function  and  a  number  of  data  parameters  oi  other  functions  that  are  needed 
for  the  realisation  of  the  particular  usk.  The  operation  of  the  Blackboard 
system  is  controlled  by  the  main  module  M  winch  looks  at  the  solution 
state  and  the  tasks  buffet  and  if  required  sends  a  message  to  die  appropriate 
module  to  come  to  tire  B-B  system  and  have  the  particular  task  assigned  iu 
IL  A  scries  of  modules  (0-3/  arc  working  on  the  database  and  have 
restricted  access  to  the  Blackboard  system.  V\  hen  a  message  is  semi  to  one 
of  them  by  the  B-B  system,  that  module  goes  to  the  tasks  buffer  and  t2kcs 
the  next  task  in  it  together  with  the  information  needed  for  its  execution, 
leaving  a  message  to  notify  that  it  has  taken  up  the  task.  After  completion 
of  the  assignment  the  module  returns  to  the  B-B  system  and  reports  UK 
successful  (or  unsuccessful;  termination  of  ns  task. 

There  arc  four  different  types  of  working  modules. 

-  0,  Database  Browsers  -  Pattern  Rcengmserv  that  took  through  the  amount 
of  data  in  the  database  for  patterns  tit  the  data  to  store  m  an  abstract  form 
in  the  B-B. 

-  1,  Database  CotgtniciPivM-idifierx  tsuch  as  gnd  generators;  that 
construct  the  topology  and  instantiate  the  database  in  a  dynamic  fashion. 

-  2,  Database  Updates  tsuch  as  silvers;  having  restricted  access  to  values 
of  data  in  the  database. 

-  3,  Output  functions  that  ctreea  values  from  the  database  and  work  on 
them  in  order  to  output  to  the  usen  such  as  contouring  modules*. 

The  control  module  CNT  asta  the  user  for  his  requirements  anJ 


consults  the  Intelligent  Knowledge  Based  System  (IKBS;  as  well  as  looks 
at  the  B-B  system  to  have  an  overview  of  the  solution  state  at  any  lime. 
Combining  the  above,  the  control  module  uses  its  built  in  inference  engine 
to  decide  what  the  next  task(s)  to  tv.  performed  is(arc), outputs  tc  the  user 
the  reasoning  of  this  decision  and  puts  the  task(s;  in  the  tasks  buffer  (B-B; 

Discussion  of  the  resulting  archiiecture-Conclusions 

This  architec  ure  has  shown  to  possess  a  number  of  advantages. 

U  provides  a  flexible  .  ay  of  intermodular  informauon  and  control  passing. 
It  gives  a  natural  separa.  on  and  data  uncoupling  of  the  control  and  user 
interface  modules  from  ik  number  crunching  modules  which  enhances 
flexibility  and  allows  for  ar.  .aster  maintenance  of  (he  software  because  of 
the  hiding  of  important  decisions  mainly  with  respect  to  the  data  structure. 
-It  contains  an  abstract  rtpicscnu.iqn  of  knowledge  about  the  problem  and 
if  solution  at  any  point  as  a  subsu.  tc  of  the  huge  amount  of  raw  data 
usually  associated  with  CFD  software.  »1  s  information  is  in  a  form  closer 
to  the  natural  perception  of  the  user  and  way  that  expert  rules  arc 
formulated.  This  makes  the  task  of -integrating  „  ,l'BS  into  the  software 
easier. 

An  IKBS  has  been  integrated  in  the  cxpcnmcntal  CFD  software 
prototype  comprising  a  Data-  Dictionary  and  a  Rulcbase  which  arc  accessed 
by  the  control  module  (CNT)  (Figure  2)  anu  interpreted  by  the  Inference 
Engine  which  is  built  in  the  module. 

The  Data  Dictionary  is  a  collection  oi  emnes  describing  qualitative 
data  formally  defining  and  quantifying  them.  Concepts  such  as  'Fine  gnd* 
or  'slow  convergence'  which  can  be  useful  for  the  natural  description  of 
a  state  and  the  formulation  of  expert  roles  arc  defined  in  the  Data 
Dictionary.  The  Rulcbase  is  a  collection  of  expert  rules  (hat  are  formulated 
as  Prolog  clauses  and  describe  in  a  heuristic  or  production  manner  the 
knowledge  that  can  be  used  to  infer  actions  to  be  taken  by  the  software 
during  the  various  stages  of  the  modelling  process.  So  there  arc  rules  to 
decide  the  descretisation  technique  or  the  solver  to  be  used  and  to  monitor 
and  accelerate  the  successful  modelling  process  changing  settings  and 
parameters.  Two  examples  follow: 

-  Setting  up  the  solver 

IsfModd/’LapIacc")  if  Is(Timc_dcpcndency-,"sfcady_state")  and 
Is(Phases,I)  3nd 

Sofvcr(”  rectangular”  ,"linc_SOR"). 

-  Determining  the  successful  conclusion  of  the  solution  procedure 
Endjsolvcr  if  IrfConvergcnec,"aeeepiabIc"). 

The  troth  of  predicates  in  the  roles  is  determined  in  a  usually 
recursive  fashion  looking  up  entries  from  the  Data  Dictionary  and 
comparing  them  re  qualitative  data  fllrered  from  the  working  database.  A 
set  of  tools  has  been  integrated  re  the  prototype  comprising  of  Data 
Dictionary  and  Rules  cdnoi  and  a  comptici  which  translate*  (he  data  enures 
and  the  roles  respectively  re  ~C  structure*  and  C  recursive  structures  so 
that  . different  Rule  sets  and  Data  enures  sets  can  be  embedded  in  the 
software  tc  deal  with  Jiffccni  areas  of  Cl  D  modelling. 

There  is  obviously  a  tnghei  commumcauuns  overhead  associated 
with  the  use  of  tire  B  B  system  but  due  tc  die  CPU  intensive  number 
crunching  nature  of  CFD  software  this  does  not  a  ilea  substantially  die 
overall  efficiency  of  the  software  fret  experience  has  shown  dial  (here  are 
a  louo  be  gained  by  this  approach  re  CTD  software  design  although  more 
work  Is  needed  in- validating  and  extending  (he  existing  prototype  and 
loofdng  for  ways  to  optimize  its  overall  performance. 
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Abstract 

Typical  examples  are  given  for  the  illustration  of- the  role  of  physical 
analysis  in  the  numerical  simulation  of  aerodynamic  flows.  The  first  is  related 
to  the  proper  choice  of  grid  Reynolds  number  and  avoidance  of  spurious 
oscillations  or  even  chaos  in  a  numerical  calculation:  of  shock  waves  with 
shock  capturing  technique.  The  second  shows  the  development  of  a  vortex 
along  its  axis,  the  existence  of  unstable  limit  cycle  and-its  relation  to  flow 
picture  in  the  bursting  region. 

1.  Introduction 

With  the  rapid  development  of  supercomputers  it  seems  that  numerical 
results  are  easily  obtained  The  essential  problem  is  that  whether  the  results 
thus  obtained  are  physically  in  reality  and  the  large  quantity  of  numerical 
data  if  improperly,  treated  would  lead  to  distoited  physical  flow  pictures 
which  may  often  be  misleading  Thus  the  treatment  given  in  this  paper  may 
not  be  without  practical  significance.  Examples  are  given  for  the  study  of 
flows  containing  shock  waves  and  vortex  flows. 

II.  Solution  of  one  dimensional  shock  wave 

For  steady  flow  in  one  dimension,  the  Navicr  Stoke’s  equations  can  be 
integrated  yielding 

du  _.«(»- y<«)(u-m)  /j, 

dx  P  u  ' 

where 

„  _  3b +.1)  PoqUqo  .  . 

p  87  '  l‘  {] 

Poo  and  Uoo  aie  density  and  velocity  at  infinite  upstream  respectively,  q  is 
the  ratio  of  specific  heats  and  /i  the  coefficient  of  viscosity,  u2  is  the  velocity 
at  infinite  downstream,  which  is  just  the  inviscid  velocity  behind  a  normal 
shock  wave  Of  course  here  we  assume  uoo  is  a  supersonic  velocity.  11  we 
take  Uoo  as  the  reference  velocity,  equation  (1)  becomes 

(3) 

dx  u 

where 

U2  =  7+i(I  +  b-i)A^J  W 

In  order  to  reveal  the  possibility  of  producing  chaos  we  first  use  perturbation 
technique  and  keep  only  second  order  <erms,  we  can  see  immediately  the 
equation  is  reduced  to  Landau’s  equation  Let  us  suppose  the  initial  value 
be  given  at  far  upstream  and  wt  are  looking  forward  :the  solution  as  we 
march  downstream.  Then  it  is  possible  to  put 


Substituting  eq.(5)  into  cq.(3)  and  keeping  terms  up  to  Ole')  We  have 

£  + Puts’-  (6) 

which  is  indeed  a  Landau  equation.  Write  down  corresponding  finite  differ¬ 
ence  equation  in  the  following  form 

c"+l  -=  en  -  /JAz(l  -  ujjc”  t  /?Azu2(s2j"  (7) 

where  Az  —  xn+l  -  z"  Introducing  a  new  variable  z 


We  have 


*“+1  =  au2"(i-z") 


au  =  1  +  0(1  -  u2)A£  (1°) 

We  immediately  recognize  that  if  a„  >  3,  i.e. 

£Az  >  t—~~-  “  ru  f11) 

1  —  U2 

period  doubling  will  occur-  We  noic  is  essentially  the  grid  Reynolds 
number,  <  depends  on  q  and  A4>,  take  for  example  q  =  1.4  and  =  4, 
then  r;  =  2.56.  The  period  doubling  pheonomenon  lias  been  verified  by 
numerical  simulation  of  one  dimensional  Navicr  Stokes  equation.  Similar 
conclusion  can  be  drawn  if  we  start  the  solution  at  downstream  side  and 
marching  toward  the  upstream. 

HI.  The  Development  of  a  Vortex  along  its  Axis 

Suppose  we  have  a  vortex  spiralling  around  its  axis  2  We  now  study 
the  flow  pictures  in  the  transversal  planes,  where  z,  y  and  2  rwm  a  local 
cartesian  coordinates  with  the  origin  at  o.  Along,  z  axis  th-  transversal 
velocity  components  u  and  u  are  zero.  Let  us  consider  tn»v  the  flow  is 
steady,  the  equation  for  the.streamline  is 


dx _ 

u(z,p,2) 


dy  _  , 
vfi.y.z) 


‘  I  +0(1  -  tz2)Az 


The  following  results  can  be  easily  obtained. 

1.  If  3[jjw),'3x  has  the  same  sign  in  the  neighboi  huod  of  the  origin  (either 
always  positive  or  always  negative),  then  in  thisiegion  the  transversal  section 
streamlines  will  not  be  closed. 

2.  Depending  on  whether  d{pw)/dz  is  positive  or  negative,  we  will  have 
the  transversal  streamlines  being  spiral  outward  or  inward,  and  in  the  usual 
terminology  wo  call  spiral  inward  vortex  as  stable  and  spiral  outward  vortex 
as  unstable. 

3.  At  the  point  of  a  vortex  bursting  pw  =  0,  so  there  must  be  a  decclleratmg 
flow  just  before  bursting  to  occur  and  vortex  bursting  is  accompanied  with 
an  unstable  spiral. 

4.  1A om  a  similar  analysis  in  nonlinear  mechanics,  we  know  there  exists 
a  stable  limiting  cycle  in  fiont  and  in  the  vortex  bursting  region.  I11  case 
we  have  a  bursting  bubble,  then  tlicie  must  exist  a  second  limiting  cycle, 
though  this  limiting  cycle  is  unstable.  So  there  is  110  guarantee  for  the  actual 
realisation  of  steady  vortex  bursting  bubble. 

5.  In  the  longitudinal  section  at  bursting  point,  the  section  streamlines  are 
of  saddle  type. 

We  have  made  a  systematic-analysis  of  available  experimental  data  re¬ 
lated  to  vortex  bursting  and  also  made  a  study  of  flow  around  an  axisym- 
metric  obstacle  placed  on  a  flat  plate.  The  numeral  results  agree  with  all 
qualitative  pictures  mentioned  above 

IV  Conclusions 

Though  the  physical  analysis  made  so  far  involving  little  mathemat¬ 
ics  yet  it  already  shows  the  potential  involved  to  understand  complex  flow 
pictures,  otherwise  we  will  be  lost  in  an  ocean  of  numerical  data.  It  is  also  es¬ 
sential  to  uncover  the  underlying  physical  mechanism  and  to  lead  to  effective 
means  to  control  or  modify  the  flow  to  suit  our  specific  purposes. 

The  research  was  supported  by  the  China  National  Natural  Science 
Foundation. 
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Abstract-For  improving  the  resolution  of  the 
shock;,  a  dispersion  regulator  and  an  artifici¬ 
al  dispersion  are  introduced,  and  an  upwind 
compact  scheme  with  dispersion  regulator  is 
developed. 


1.  INTRODUCTION 

In  ref.l  a  compact  scheme  was  developed. This 
scheme  was  useful  for  improving  both  of  the 
accuracy  and  the  efficiency,  but  there  are  os¬ 
cillations  in  the  numerical  solutions.  In  this 
paper  a  dispersion  regulator  and  artificial 
dispersion  are  introduced  and  an  upwind  com¬ 
pact  scheme  with  dispersion  regulator  is  deve¬ 
loped.  Numerical  experiments  show  the  scheme 
developed  has  high  resolution. 

2.  UPWIND  COMPACT  SCHEME  WITH 
DISPERSION  REGULATOR 


,  I  ~  o  -  _  n 

it  +  j  0 

The  modified  equation  with  the  leading  term 
takes  form 

-AX2cl(p  32U_ 

3t  +  OX  3XtR  } 


(5) 


f=au  ,  R=const 


Rewrite  it  into  form 


(6) 


311  3-f  ,  a  gu 

-nr  +  Ax'ssf* - 


3t 


ax 


3X1  3X 


..  .  ah 

jKa  sY 


If  we  have  a  shock  as  shown  in  Fig.l  the  coe¬ 
fficient  ,M  > 0  in  the  front  of  the  shock.  Ne- 
getive  jW  is  a  reason  of  oscillation  produc¬ 
tion  behind  the  shock  in  the  numerical  solu¬ 
tions.  In  the  present  paper  the  parameter  R 
in  (6)  is  reconstructed  as 


A.  Compact  Scheme  and  Upwind  Compact  Scheme 
Consider  the  model  equation 


|u(x+ax) -u(x)|  - |u(x) -u(x-ax) | 

R(u)  =|6"  al -  C7} 

|u(x+Ax)  -u(x)l  -|uCx)-u(x-4x)  I 


9U 

¥t 


f=au 


a=const.  (1) 


In  ref.l  a  compact  scheme  is  developed.  The 
scheme  has  high  accuracy,  but  there  are  osci¬ 
llations  in  the  numerical  solutions  near  the 
shock.  The  solutions  may  be  improved  if  the 
scheme  is  upwind  biased.  Consider  a-  semi-dis¬ 
crete  approximation  for  equation  (1) 


S.U  _L_  p.  _  n 
ft  +  2x  FD  -  0 

^Fj+1+  F3  +  *•  Pj-l=ao  ^  fj+bo^'x  f  j 

K=r  '  ao=4  - 

Yq  ="  ,  b0=-^~  +  2^, 

&-j“  +  2?3 


(2) 

(3) 


where  T  ,  and  are  forward,  backward  and 
central  differences.  Scheme  (2)  and  (3)  for 
a>0  with  f*>  0  and  f u  >  0  is  called  upwind  com¬ 
pact  scheme.  With  different  choice  of  the  pa¬ 
rameters  different  schemes  can  be  obtained. 
The  simplest  one  within  schemes  with  accuracy 
of  order  three  is 


|-Fj+  Sjfj+  f  ^fj  (4) 

It  is  dissipative  and  it  can  be  solved  easily. 


B.  Upwind  Compact  Scheme  with  Dispersion 
Regulator 


v;hich  is  called  dispersion  regulator  in  this 
paper.  The  function  R(u)  changes  sign  across 
the  shock. 

With  dispersion  regulator  we  have  two  kinds 
of  schemes: 

a.  Scheme  with  ’artificial  dispersion.  The 
scheme  suggested  is 


I 

4X_ 


{  (R^Uj)-  -^  ClRl^Uj) 


b.  Upwind  compact  scheme  with  dispersion  re¬ 
gulator.  The  parameters  2^  are  determined  as 
follows 

82=0,  5?--80R(u)  ,  54  =0.125 

where  is  a  positive  parameter  and  R(u)  is 
determined  by  equation  (7) . 

3.  APPROXIMATION  OF  THE  EULER  EQUATIONS 
Consider  the  1-D  Euler  equations 


3U  9f_ 
31  3X 


0 


U=(  f  ,  ?u,  E)t  ,  f=  C  $>u,  f>u2+p, 

p  =  y^-9T,  E=5>(CvT  +  y-) 


(8) 

u(E+p))T 


Consider  a  semi-discrete  second  order  accu¬ 
rate  scheme 


1  This  work  supported  in  part  by  the  National 
Foundation  of  Natural  Science 


The  difference  approximation  used  is 

<I+-f  A++-f  i? ^  a-)  vr1 L=-  ia(Fj+Fj> 

(9) 

•  (10) 


F~.= 
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•  -  .  +  + 

wnere  A  is  the  Jacobian  matrix  and  £~  =A“U, 

i  l  a-  - 

A  =S_i-A  S,  and  A  are  the  diagonal  matrices 
with  elements 

are  the  eigenvalues  of  the  matrix  A.  In 

the  computation  the  parameters  8^  are  deter- 
mi ned  as 

£*=0,  8‘3=+S0R  (f),  £  .125 


4.  NUMERICAL  EXPERIMENTS 

A.  1-D  Shock  Tube  Problem 

The  upwind  compact  scheme  was  used  to  solve 
this  problem.  The  computed  results  at  the  time 
t=0.1'4  are  given  in  Fig. 2. 

B.  2-D  Shock  Reflection 

The  free  Mach  number  is  Moo=2.9,  and  the  in¬ 
cident  angle  is  29  degree.  Some  computed  re¬ 
sults  are  given  in  Fig. 3.  The  numerical  expe¬ 
riments  show 

a.  the  third  order  accurate  scheme  (2)  and 
(4)  has  nice  solutions  near  the  shock  but 
still  with  small  oscillations; 

b.  the  third  order  accurate  upwind  compact 
scheme  with  dispersion  regulator  has  high  re¬ 
solution  of  the  shocks. 

C.  Supersonic  Flow  Around  Blund  Body 

The  scheme  developed  in  ref. 2  with  artifir- 
cial  viscosity  and  with  artificial,  dispersion 
was  used  to  solve  the  axial  symmetrical  su¬ 
personic  flow  around  a  sphere-cone.  The  shock 
near  the  axis  oscillates  in  the  numerical  so¬ 
lution  obtained  with  artificial  viscosity. 

When  the  scheme  with  artificial  dispersion  is 
used  non  oscillations  are  found  in  the  nume¬ 
rical  solutions. 
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Fig.l  sketch 
of  the  shock 


c.  pressure  d.  intenal  energy 

Fig. 2  shock  tube  solutions  at  t=.14 
(  upwind  compact  scheme  i 


a.  the  pressure  (  y=o.5  ) 

(simplest  upwind  compact  scheme) 


c.  the  pressure  at  y=. 5 (scheme  with 
dispersion  regulator) 


d.  density  contours (scheme 
with  dispersion  regulator) 
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NUMERICAL  SIMULATION  OF  SUPERSONIC  SEPARRATED 
FLOW  OVER  BLUNT  GONE  AT  HIGH  ANGLE  OF  ATTACK 


Shen  Qing  Gao  Shuchun  and  Zhang  Hanxin 
China  Aerodynamics  Research  and  Development  Center 
P.O.Box  211,Mianyang,  Sichuan  621000,  P.R. China 


Abstract-Through  a  study  for  the  properties  of  boundary  layer  equations,  a 
space-marching  technique  for  solving  parabolized  Navier-Stokes  (PNS)  equa¬ 
tions  has  been  developed  by  Zhang  recently,  and : the  axisymmetrical  flows 
over  blunt  cones  have  been  simulated  successfully.  In  the  present  paper,  the 
above  technique  is  extented  to  the  calculation  of  flow  over  blunt  cone  with 
cross-flow  separation  at  high  angle  of  attack  • 


Introduc.ion 

Flow  fields  with  cross- flow  separauons  which  duminai  die  shock  layer 
during  the  reentry  of  configurations  at  high  angles  uf  attack  can  be  simulated 
numerically  by  solving  Navier  StokcstNS;  equations,  where  £uler_ones  be¬ 
come  invalid.  Because  the  tost  is  very  high  and  the  computer  storage  is  limit¬ 
ed,  the  application  of  time  dependent  NS  solver  to  the  tliree-dimenstonal  con- 
figrations  is  restricted  greatly.  Thus,  discussant  about  various  simplification 
for  the  NS  equations  has  been  tnadcM.  Tltis  analysis  shows  that  the  PNS  e- 
quations  are  of  the  most  interest.  The  reasons  for  this  are  (1)  falling  between 
the  complete  NS  equations  and  the  boundary  layer  equations,  the  set  of  equa¬ 
tions  ,.rc  applicable  to  both  in.scid  ,nd  viscous  flow  regions,  which  means  that 
the  inviscid-viscous  interaction  is  included  automatically!  (2)  the  PNS  equa¬ 
tions  are  hyperbolic  parabolic  type  when  certain  conditions  are  met  U-  e. ,  the 
inviseid  region  of  the  flow  is  supersonic  and  the  streamwise  velocity  compo¬ 
nent  is  positive)  ,and  then  can  be  solved  by  advancing  an  initial  plane  of  data 
in  space.  As  a  consequence,  a  substantial  reduction  in  computation  time  and 
storage  Is  achieved  i  (3)  for  stable  marching  downstream ,  the  detail  informa 
tion  can  be  supplied  for  the  flow  fields  without  reverse  flow  in  the  marching 
direction. 

Recent  years ,  various  supersonic  viscous  flows  have  been  computed  with 
PNS  rncthod[2'10l.  The  key  technique  for  stable  computing  is  the  proper  treat¬ 
ment  of-the  streamwise  pressure  gradient  inside  the  subsonic  region  near-body 
surface  which  produces  the  influence  to  the  upstream  and  leads  to  the  so  called 
"departure  solution".  Numerous  researchers!2-113  have  done  a  lot  of  work  to 
overcome  this  difficulty. 

Zhang  et  aF”1.  improved  the  PNS  method  based  on  die  properties  of  the 
boundary  layer  equations.  No  departure  solution  occurcd  with  small  marching 
step  size.  The  computational  results  for  the  three-dimensional  flow  fields  with 
the  method  of  [Tl]  are  presented.  The  present  PNS  code  has  been  used  to  cal¬ 
culate  the  laminar  flow  over  shpere  cone  at  angle  of  attack  up  to  20*.  The 
computational  results  arc  compared  with  the  data  from  references  and  expen- 
ments. 


Numerical  Method 


Governing  Equations 

Thc.conscrvativc  form  of  the  PNS  equations!’3  is 


E{  +  r,  +  G(  =  It?S,  (1) 

where  the  perfect  gas  assumption  is  taken,  y=l.  i,  P,<=  0. 72,  T—yhl^/p 
and  the  coefficient  of  viscousity  (;i)is  determined  from  Sutherland' s  law. 
Numerical  Algorithm 

Eq.  (1)  can  bo  rewrittenas 

Bi  +  +  7-,  +  O,-  =  rr.'s(  (2) 

where  E‘*=E-P,  and 


P  =  J~  * 


'0 

0 

0 

.0 


a  is  min  (1 , Mff) ,  t  is  a  safety  factor  and  Is  taken  as  0.  8  in  the  calculation. 
For  computing  efficiently,  an  Euler  Implicit  approximate  factored,  finite  dif 
fcrcnce  algorithm  in  delta  form  is  used ,  where  P(  is  treated  explicitly.  The  dif 
ference  equations  of  Eq.  (2)  are 


!>*  +  AiW,B*)3A5*  =-(/**- 

+  <5,  P*  +  6tG--R?d(  S') 

[>*  +  Ai(iiC'-rt.'6!M')l&?  = 

9*+1  =  9*  +  A9* 

According  to  Zhang'  s  technique ,  (5{P'!>  in  Eq. 

■  If  Beam— Warming  scheme  is  used, the  fourth-order- dissipation 
term  of  [3]  is  empioyed  lo  supress  high  frequency  oscillations.  Eqs.  (3)  rep¬ 
resent  block  tri-diagonal  systems  of  equations  which  are  solved  using  a  matrix 
sot  er  as  desc.ibcd  in  [3].  It  is  important  lhai  [he  main  diagonal  .elements  oc¬ 
cupy  a  domniani  position rin  solving  the  matrix,  osuaily  ,  implicit  smoothing 
terms  arc  used  to  enhance  the  main  diagonal  demerits'-*  The  same  purpose 
ts  attained  with  limning, lite  marching  step  size,  then  no  implicit  smoothing 
terms  are  needed  and  higher  accuracy  is  achieved.  Also,  the  implicit  NND 
schetrirf1*’ has  been  used, and  no  obvious  difference  is  fuund  between  results 
given  by  two  methods  separately. 

Boundary  Conditions 

The  body  surface  conditions  [.no- slip,  a, specified  surface- temperature, 
and  zero  normal  pressure  gradient;  are  implemented  implicitly  in  the  algo¬ 
rithm. 

The  oui  bow- shock  is  fined  using  the  "  pressure  approach"  procedure. 
The  pressure  behind  ihe  shock  is  calculated  from  Eqs.  t.3;  with  one-side  differ¬ 
ence  in  the  q-direction ,  and  the  remaining  f  luw  variables  are  evaluated  by  sat¬ 
isfying  the  Rankine-Hugomot  relations. 

At  symmetry  plane,  the  reflect  condition  is  employed  implicitly. 
Initial  Conditions 

Initial  conditions  for  starting  downstream  marching  computation  are  pro¬ 
vided  with  the  thrcc-dimensionai  time-dependent  NS  code-'3!. 


^•-‘)9*-A«W{P 

(3) 

A"  Ay* 

(3)  is  calculated  by  (1-to)  • 


Results  and  Discussion 

Cacs  1 

At  first,  the  flow  over  a  blunt  sphere  cone  witli  10*  cone  half— angle  at 
no  incident  is  calculated  in  order  lo  deinonstraio  ihe  efficiency  of  the  algo- 
ritlim.  The  flow  conditions  are 

=8,  R,l  =  5  «  10!  (/./«.  =  50), 

T„  =  72.  KK,  T,  =  200 K. 

The  results  show  good  agreement  with  ihe  data  from  [id]  for  the  shock  loca¬ 
tion  in  Fig.  i  and  surface  pressure  in  Fig.  2,  which  verifies  the  vahdaty  of  the 
present  code. 

Caes  2 

Flow  over  a  blunt  sphere  cone  with  d.  7*  cone  half— angle  for  an  angle 
of  attack  of  20*  is  computed  here.  Flow  conditions  arc 

AU  =  10 ,  R.i  =  2. 3  X  10HL/R.  =  10. 52) , 

T„  =  d9  K,  T,  =  29d/F. 

Results  are  compared  with  those  of  [1 5].  Fig.  3a  presents  the  shock  shapo  of 
thepresent  calculation  on  the  pitcli  plane.  Fig.  3b  is  an  experimental  photo¬ 
graph!*3.  Fig.  d  and  5  present  the  surface  pressureand  heat  transfer  rate  re¬ 
spectively.  The  comparison  of  calculated  and  measured!"3  surface  pressuie 
variation  with  the  circumferential  angle  at  difference  axial  positions  is  present¬ 
ed  in  Fig.  6 ,  and  the  similar  comparison  for  the  normalized  heat-transfer  rate 
is  shown  in  Fig.  7.  Tho  comparison  shows  the  good  agreement  between  the 
computational  and  experimental  results. 

No  adverse  pressure  gradient  along  the  meridienal  angle  exists  at  x/L= 
0.  II.  However,  a  minimum  pressure  point  develops  off  the  lee  meridian  at 
x/E=0.  dd5,  which  indicates  the  existence  of  the  crossflow  separation.  As 
the  result  of  the  apparence  of  the  secondary  crossflow  separation,  thcsccond 
minimum  pressure  point  occurs  between  the  first  minimum  point  and  the  Ice 
meridian  at  x/L=  0. 95.  Fig.  8a  presents  the  limiting  strcamlincswhcrc  the  de¬ 
velopment  of  the  open  separation  is  observed.  The  primary  group  of  converged 
limiting  streamlines  and  the  second  group  of  converged  limiting  streamlines 
manifest  the  primary  and  secondary  separation  lines.  Tile  experimental  pho’o- 
graph  (.Fig.  8b;  of  [iSjwhich  provide  us  the  real  onflow  pattern  shows  the 
same  image.  The  vortex  structure  is  given  by  plotting  crossflow  velocity  vec¬ 
tors  in  Fig.  9. 
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Conclusion 

The  space-marching  technique  developed  by  Zhang  for  the  axisymxnetri- 
cal  flows  over  blunt  cones  is  extented  to  simulate  asymmetrical  flaw  with 
crossflow  separation.  The  results  for  blunt  cones,  specially  the  separated  flow 
patterns  calculated ,  aro  obtained  satisfactorily.  It  is  shown  that  the  -PNS 
method  used  in  this  paper  is  successful. 
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Abstract  Based  on  the  Single  Level  Conservative  Supra-charactcnstic 
method  (CSCM-S)  proposed  by  Lombard  et  al.  (l],  we  suggest  a  more  fast 
elTicient  algorithm,  which  combines  a  single-  marching  technique  for  super¬ 
sonic  dominant  zones  with  a  multi-sweep  procedure  for  complex  flowficlds. 
The  new  one  requires  about  an  order  of  magnitude  less  CPU  time  than  the 
CSCM-S  algorithm. 


I.  INTRODUCTION 

Over  the  past  ten  years  there  has  been  a  great  development  in  efficient 
algorithms  for  comprissible  flow.  Among  them  the  CSCM-S  algoritm  (1|  is 
very  attractive  for  multidimensional  Euler  and  Navicr-Stokcs  problems.  The 
algorithm  is  based  on  an  implicit  symmetric  Gauss-Scidel  method  along  the 
flow  direction  together  with  an  implicit  block-tridiagonal  diagonally  domi¬ 
nant  approximate  factorization  scheme  along  the  other  directions.  In  prac¬ 
tice  the  global  relaxation  in  whole  computational  domain  is  not  economical 
for  a  large-scale  supersonic,  dominant  flowfield  around  a  missile  or  space 
shuttle  orbitcr.  In  this  paper  we  suggest  the  more  fast  efficient  algorithm, 
which  combines  the  single-sweep  for  the  supersonic  dominant  flow  with  the 
multi-sweep  process  in  the  complex  flow  zones  along  the  flow  direction  and 
adopts  an  explicit-implicit  scheme  rather  than  the  full  implicit  scheme  in 
the  crossflow  directions.  We  call  such  combinations  as  CSCM-S  algorithm. 
Numerical  experiments  showed  the  efficiency  of  our  new  algorithm. 


II.  SIMPLIFIED  NAVIER-STGt.ES  EQUATIONS 


The  viscous  flow  is  described  by  the  full  Navicr-Stokcs  equations  (NS). 
However,  in  many  practical  problems  some  viscous  terms  appearing  in  NS 
equations  may  be  negligible.  Based  on  this  idea,  the  simplified  Navicr- 
Stokcs  (SNS)  equations  were  derived  using  either  the  order  of 'magnitude 
analysis  or  the  viscous-inviscid  interacting  flow  theory  (2).  The  conservative 
three-dimensional  SNS  equations  have  the  following  form  in  t.ie  generalized 
coordinates 


,0q  dE  dF  3G  1  ,dFv  3G„ 

•/3T+3?+3?+  3F  =  7i?3^  +  -3r 


(1) 


where  q  =-(p,pu,pu.pui,  £i)r,  e,  =  e+  J  =  §[|]  !~|'.  He  =  1 

D,  F,  G  and  F„,  G„  represent  inviscid  and  viscous  flux  vectors,  respectively. 
Fv,  G„  contain  such  viscous  terms  that  have  orders  of  magnitude  0(1)  and 
0{R~  1 ),  The  velocity,  density,  temperature,  viscosity  and  pressure  were 
nondiincnsioncd  by  U„,  pOT,  Tm,  and  pmUm,  respectively. 


III.  NUMERICAL  METHOD 

A.  MULTIPLE  SWEEP  PROCEDURE 

We  consider  an  explicit-implicit  difference  equation  for  (1)  at  any  grid 

Point  (&,ij/,  ft) 


,«7"+1  ,  A En+l  .  A Fn+I  .  A C"+I  1  .A/T  AG" 

~ + —  + —  +  —  =  +  w) 


(2) 


ThcCSCM  flux-difference  splitting  |I|  is  chosen  as  the  basic  scheme  of 
our  algorithm,  i.c.  the  inviscid  flux  difference  can  be  expressed  as 


A  E  =  A  E+  +  A  E-  =  A+V{?  +  ~A~  A<7 

Af  =  Af+  +  AE-  =  U+V,7  +  g-A,7  (3) 

AG  =  AC+  +  AG"  =  C*V(q  +  O'"  A,7 


where  V7  and  A7  arc  the  forward  and  backward  differences,  A  = 

H  —  §7"'  &  ~  §p  '  Jacobian  matrices  and  the  matrices  A *,  5*,  Ci 

1  This  work  is  supported  by  the  National  Natural  Science  Foundation  of 
China. 


arc  obtained  through  A,  B,  C  by  the  characteristic  information  along  each 
coordinate  direction  and  have  the  special  form  as 


where 


T'  = 
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D1  =  5(|A|Pi  A)/jA|,  A  15  the  diagonal  matrix  consisted  of  eigenvalues 
of  the  matrices  A.  The  M  and  T  represent  the  transformed  matrices  from 
non-conservative  to  conservative  equations  and  from  characteristic  to  non- 
conservative  ones,  respectively.  The  bars  indccatc  that  the  matrices  contain 
averages  of  the  adjacent  grid  point  data.  The  viscous  terms  arc  approximated 
by  central  difference.  Thus,  the  resulting  difference  scheme  is 


-2+«, -u+Kl-uk  +  w«Pj ft 

+2“<tf++,  \,*  +  v-KUi.k  =  -Ki.> 


(<) 


where  Lq?i$k  =  A+  V{,"  +  A~ A£q"  +  B+Vaaq"  +  B~Cxnqn  +  G+Vt7"  + 
G“At7",  D  =  /+  A*  —  A~  +  l)+  —  B~.  For  solving  cq.(d),  the  symmetric 
marching  iteration  is  adopted  along  ^-direction,  i.c.  the  iteration  consists 
of  a  forward-sweep  step 

{-D+,D,D-)6q-  =  (5) 


7*  =  7"  +57',  Sq'l+Uk  =  0 
and  a  backward-sweep  step 

(-5+,D,2r)d7"'‘  =  -L(*-n+1)7 

7"+1  =  7*+d?"+1,  Sq^[.k  =  0 


where 


/>*>7  =  -Lq"  +  A*  (7 ?j.k  -  7p— I./.fc)  +  AT  (q?+i,j,k  -  q?.i,k) 
*‘,n+,,7  -  -V  +  A-  (&  ~  li.j.t)  ~  A+(ql,k  - 


(0) 


B.  SINGLE  SWEEP  TECHNIQUE 

Note  that  the  backward-sweep  step  (6)  may  be  removed  for  the  super¬ 
sonic  dominant  flowfield  and  the  numerical  solution  is  found  using  only  the 
forward-sweep  (5).  In  fac',  this  can  be  easily  done  putting  s  0  in  cq.(-i) 
and  numerical  results  in  this  way  are  in  good  agreement  with  those  obtained 
by  the  PNS  space-marching  technique.  In  this  case  tiu  forward  sweep  step 
becomes  the  following  form 


where 


(-3+,D,2-)A7"+1  =  -L("'"+»7 

7n+1  =  7"  J.  Sqn*1 

L("."+,l7  =  -iq"  +A+(q?y  k  -q"_u  k) 


(5') 
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Jig"  =  A+V<g"  +  S +V„g"  +  S~6^n-  i-C+Vtgn  +  C~At9" 


A 


IV. -NUMERICAL  TESTS 

In  order  to  lest  the  efficiency  of  the  CSCM-C  algorithm,  we  computed 
some  large-scale  two  and  three  dimensional  hypersonic  flows  past  a  sphere- 
cone  and  a  simple  space  shuttle  orl'tcr.  A  part  of  results  for  the  sphere- 
cones  isgiven  here.  In  the  paper  |3)  numerical  test  was  accomplished  for  the 
sphere-cone  hypersonic  flow.at  =-20  and  zero  angle  of  attack  with  the 
CSCM-S  algorithm  and  the  convergent  solution  was  reached  through  200 
global  sweeps.  The  same  problem  has  been  also  computed  by  thcCSCM-C 
under  the  following  frccstream  conditions 

Men  =  20,  Rt  =  0.6xl0‘,  T„  =  250C,  Ta  =  lOOOfc 

Numerical  solution  was  found  by  using  the  single  sweep  technique  except 
for  a  small  nose  region,  inwhich  the  steady  solution  was  obtained  through 
100  global  sweeps.  Figs  1  and  2  show  surface  pressure  and  heating-rate 
distributions,  respectively.  They  arc  in  excellent  agreement  with  those  ob¬ 
tained  by  our  3-D  VSi,  rode  (4).  The  similar  test  was  carried  out  for  15° 
sphere-cone  three-dimensional  flow  at  20°  angle  of  attack  and  the  frecstream 
conditions  arc  the  same  as  (5],  i.e. 


AfM  =  10.6,  Rc  =  1.318  x  10s,  To o  =  47.34fc,  Tw  =  300k 

In  this  case  the  explicit-implicit  scheme  may  reduce  one-third  of  CPU 
time  in  comparison  with  the  full  implicit  scheme  (see  table). 


TABLE 

COMPARISON  OF  DIFFERENT  SCHEMES 


Fig.  1.  Surface  pressure 
along  sphere-cone  at  zero  angle  of  attack 


AT  ONE  MARCHING  STATION 


SCHEME 

EXPLICIT-IMPLICIT 

IMPLICIT 

CPU  of  per  lime  stcp(scc.) 

10.36 

24.93 

CPU  of  per  grid  point 

0.021 

0.032 

total  number  of  iteration 

12 

12 

total  CPU  lime 

196.32 

299.16 

Figs.3  and  4  represent  axial  distribution  of  surface  pressures  and  heating 
rales  along  different  mcridianal  planes.  The  points  indccalc  experimental 
data.  Clearly,  the  single-sweep  technique  is  acceptable  in  the  supersonic 
dominant  flowflelds. 


V.  CONCLUSION 


along  sphere-cone  at  zero  angle  of  attack 


As  is  well  known  that  the  time-dependent  Navier-Stokcs  solver  requires 
a  large  amount  of  CPU  times  to  obtain  a  convergent  numerical  solution  and 
it  is  more  adequate  to  local  complex  flowfields.  The  space  marching  PNS 
algorithm  can  save  an  order  of  magnitude  CPU  time  in  comparison  with 
the  complete  NS  solver.  However  it  has  the  inherent  problem  with  stability, 
i.e.  the  exponentially  growing  solutions  will  occur  if  the  streamwisc  pressure 
gradient  is  retained  in  the  subsonic  regions.  The  present  CSCM-C  algo¬ 
rithm  consists  of  the  space-marching  technique  and  the  time  iteration  and 
it  is  free  of  instability  and  requires  less  CPU  time  than  the  lime-dependent 
Navier-Stokcs  solver.  We  expect  the  present  algorithm  would  be  more  effi¬ 
cient  to  the  large-scale  flowfields  around  to  the  missile  spai*  shuttle  orbiler 
configurations. 
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NUMERICAL  SIMULATION  FOR  ?-D  FLOWS  USING  NND  SCHEMES 
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Abstract  ;  NND  scheme  which  is  developed  by  Zhang  has  been  applied  u» 
the  hypersonic  flow  around  a  shuttle— orbiter— like  geometry  proposed  by 
CARDC.  Euler  equations  in  a  finite  difference  are  solved  by  using  explicit 
space— marching  algorithm  and  implicit  marching  iteration  algorithm.  Nu- 
meiical  calculations  are  performed  for  the  problem  under  the  conditions  that 
Mach  number  is  7.  0  and  the  angle  of  attack  is  5.  0  degree.  Numerical  re¬ 
sults  of  these  two  algorithms  are  compared  with  each  other,  and  agree  very' 
well. 


Introduction 

In  the  calculation  of  complex  flow.fieids  containing  shock  waves,  mo-; 
attention  lias  been  paid  to  the  shock  capturing  method.  In  order  to  capture 
shock  waves  smoothly  without  spurious  oscillations  near  or  in  the  shock  re¬ 
gions,  mixed  dissipative  schemes  including  free  parameters  with  first  order 
accuracy  near  shock  and  second  order  schemes  elsewhere  have  been  widely 
■,'sed  t'-O.  There  are  inherent  disadvantages  in  employing  these  schemes. 
Firstly ,  the  free  parameters  are  basically  determined  by  numerical  experi¬ 
ments.  Secondly ,  the  resolution  o;  the  shock  is  not  very  satisfactory.  Natu¬ 
rally.  tlio  development  of  non— oscillatory  dissipative  schemes  containing 
no  free  parameters  with  high  resoluuon  has  much  been  emphasized  rcccnt- 
ly,  such  as  TVD  schemes^’Jand  ENO  schemes  t'®. 

Through  a  study  of  the  one  dimensional  Navier— Stokes  equations,  it 
was  found  that  the  spurious  oscillations  accuring  near  shock  waves  with  fi 
nite  difference  equations  are  related  to  the  dispersion  term  in  the  corre¬ 
sponding  modified  differential  equations.  If  the  sign  of  the  dispersion  coef- 
ficieiit  is  proper!;*  adjusted  in  order  to  in- he  the  sign  change  across  the  shock 
waves,  the  undesirable  oscillations  can  be  totally  suppressed.  Based  on  this 
discovery,  the  non— oscillatory  and  dissipative  scheme  containing  no  free 
parameters  (  NND  scheme  )  is  developed.  This  is  one  of  "  TVD  In  or¬ 
der  to  tesc  the  effectiveness  of  the  scheme  in  space— marching  calculations, 
we  haze  carried  out  numerical  simulations  for  two  dimensional  flows  of 
shock  and  expenskm  wave  interaction  flowfield.  Moreover,  the  NND 
schemes  have  been  employed  for  the  calculation  of  hypersonic  inviscid  flow 
around  the  shuttle— orbiter— like  geometry. 


Numerical  Algorithm 
I ,  Semi— discreted  NND  scheme 
For  an  one  dimensional  Euler  equations  : 


'<fJ  ,  arm  _  n 

31  ■*"  3r 


(1) 


here  U  is  t.  vector  and  F  is  a  function  of  the  vector  U.  The  NND  scheme  of 
semi— discreted  form  ist"!. 


(§)!  'hin',¥m ' 


WJ-r/r) 


(2) 


where 

11  mn  ~  Fhvtc  +  F7*irt* 

FT+\m,  Ff  +  l/2rnuuno<f(AF£-i/j>  AF/j-i/j) 
PJ+uu  —  Fj+r  —  1  /2minmod(  AFj+i/2 ,  AF£  m) 


2 ,  Explicit  NND  scheme 

For  equation  (1) ,  two  step  predictor -corrector  scheme  is  . 

fop  =  -  ^<f/;ti«, //;-.«) 

jf/J+i  =  i-Cf/J  +  Vf'  -  ^(fijfi/e./fjli/,) 

T  iis  scheme  is  second  order  in  time  and  space ,  and  ls  TVD  scheme.  The 
maximun  allowable  Courant  numeber  is  I. 

For  simplicity,  the  predictor  step  of  (3)  can  be  also  taken  as  : 

j/ft  =  U)  -  ^<A‘7-'.«  +  A  fifin') 

f.c.  mlnmod(a,b)=’0  in  (3)  is  used. 

3,  Implicit  NND  scheme 

For  one  dimensional  Euler  equation  (1) ,  we  have 

(f>;  =-  -  //;-.«>  «> 

§  ■)}«  -  -  (Si 

From  (2),  according  to  Crank— Nicolson  method,  Uj"’1  can  be  expressed 
as 


(7) 


'»+'  =  V)  +  A<C(1  -  8)(|r)J  +  )5+,D  (6) 

This  expression  is  second  order  accuracy  in  time  for  8=1/2  and  is  first  or¬ 
der  for  0=1.  Substituting  (1)  and  (5)  into  this  expression,  the  following 
implicit  scheme  can  be  obtained  : 

«5+1  =  vy-  -  n,- irt) 

W  4  - 

Hj+i/:  —  =  CO  —  0)7IJ+!/r  +  8//3tl/0  — 

eel  -  (8) 

i-  , 

*1  —  \tnmnod  (yCf ■>~ ,  i) 

4  Af  ->/* 

*!  =  -|-mmvaxi(^pj^~,l) 

**  =  imI„ffiod(l,|g=!fI) 

.  e  it  lin  idea  in  cs,  Wishing  our  implicit  scheme  is  to  use  the  above  hmi.ers 
k,  -t  time  step  n.  We  have  in  general  : 

=  kjAFjqtfj  +  0(A<Ax> 

Then  equation  (8)  may  b  written  as  : 

-  JTj-tji  ■=  //;+,«  -  //;-,«  +  8(1  -Ml  -  «V 

(<5F/,+l  -  iFp}',  h  8(1  -  ki  +  Hi)  •  {4Fpt‘  -  it>P  ‘) 


where 


Since 


where 


<SFi«*-i  =  fi‘+'  -  Fp 

iFp *>  =  ApW*'  +  0(A<*> 
iFp*-  r=  ApiWp'  +  0(A<*) 

HI-*'  ,=  (fj+«  —  V) 

A++  A~  v.  A 


The  above  equation  (7)  c  i.l  be  estimated  by  the  equation 

p-MH  +  m?'  +  cUw.ti  =-  —(//;*,*  -  /;;-!«) 


(9) 


where 

Aj-I  =-  8-^(1  +  *!-  K)Af-i 
Bj  ■=  l  +  0  ^O  +-*1  -  *\)Af  ~  8  ^(1  -  it  +  i!)Af 
Cj+i  =  8^(l-  it-i-  WAp, 

This  equation  u  what  we  have  pursued  i:i  order  to  establish  (h,e  so  called  im¬ 
plicit  NND  scheme,  we  can  prove  that  this  scheme  for  6=  1  is  one  of  TVD 
schemes,  and  is  unconditionally  stable. 


Numer.cal  Resuits 

1 ,  Interaction  of  shock  wave  and  expansion  wave 

In  order  to  check  out  shock  —  capturing  properties  oi  NND  schemes, 
we  consider  the  problem  showed  in  Fig.  1 ,  OBAC  is  a  curve ,  MN  is  a  flat 
plate ,  FA  Is  an  oblique  shock-wave.  Computational  region  is  OABCDEFO. 
We  specify  a  uniform  Macii  number  2. 9  at  the  left  boundary  FO,  and  the 
conditions  at  EF  which  is  behind  the  shock,  where  the  angle  contained  by 
the  incident  shock  wave  a.,J  the  flat  plate  is  29*.  A  flow  langency  condition 
is  given  at  boundary  OAEC  and  MN ,  and  the  variables  arc  extrapolated  at 
boundary  CED. 

Since  the  flow  is  supersonic  in  this  case ,  we  can  solve  Euler  equation 
by  using  the  explicit  space— marching  algorithm. 

The  space— marching  computation  is  started  out  at  the  left  boundary, 
the  space— marching  step  is  0. 01. 

Fig.  2  shows  the  pressure  contours  ev«i,.a.ed  by  «ND  scheme,  and  the 
first  order  upwind  (OP—  I)  and  second  order  upwind  (UP— 2)  schemes, 
it  is  quite  clear  that  the  spurious  oscillations  neai  or  in  the  shock  region  can 
be  totally  suppressed  with  NND  scheme,  and  NND  scheme  has  high  resolu¬ 
tion  to  shock  captulng. 

2,  Hypersonic  Flow  Around  Shuttle— Orbile'— Like  Gco-r.ety 

Wc  study  the  hypersonic  flow  around  the  vhut.le— orbitc.  — like  gcom- 
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etry,  it  is  obvious. that  theilowis  supersonic  in  the  afterbody  flowfield 
when  the  angle  ofattack  is  not  very  large,  so  the  space— marching  method 
is  applied  to  solving  the  steady  Euler  equations.  Through  the  transformation 
of  coordinate  system ,  we  obtain  the  three— dimensional  compressible  steady 
Euler  equations  in  dimensionless  as  : 


3B.3F.SG 

~f  + *i  +  3g  ! 


(10) 


where  art  the  coordinates  of  streamwi'-e  wall— normal  and  circum¬ 
ferential  directions  respectively.  Since  equations  (TO)  are  hyprbolic  and 

F=F(E);G=G(E)  so  the  two  step  NMD  scheme  (3)  can  be  used, directly. 


When  the  angle  of  attach  is  large ,  the  subsonic  pockets  will  arise  in  the 
afterbody  flowf ied ,  so  the  time  and  space  —marching  methods  should  be  ap¬ 
plied  to  solving  uns.eady  Euler  equations  On  the  one  hand ,  space  — 
marching  calculation  is  performed  along  sneamwise  diiection,  on  the.uther 
hand,  the  time  iteration  is  carried  out  on.the  every  cross  section.  It  is  easy 
to  obtain  implicit  marching— iteration  scheme  from  model  scheme  (9),  the 
Gauss— Seidel  iteration  will  be  used  in  the  circumferential  direction. 

On  the  body  surface,  all  variables  can  be  determined  by  using  tangen¬ 
tial  flow  condition  and  four  characteristic  relations  derived  from  Euler  e- 
quations.  At  the  shock  wave,  the  Raukine— Hugoniot  and  one  characteris¬ 
tic  relation  can  be  used  ,  determine  tue  shock  wave  shape  and  all  variables. 
The  initial  profile  can  s  given  by  time—  dependent  blunt  booy  code 
The  invitcid  solution  teen  obtained  on  the  following  ft.  est.eam  condi¬ 
tion  :hfc,= 7,  a=S*.  Fig.  3  gives  tic  pressure  contours  on  .he  body  sur¬ 
face  of  leeward,  the  meridional  surface  q.=90*,  270*,  and  out  boundary 
cross  section,  the  density. contours  are  showed  in  Fig.  4,  interaction  of  the 
body  shock  and  wing  shock  are  showed  clearly  on  the  merldions’  surface  cp 
=  90*,  270*.  Fig.  3  and  Fig.  i  also  show  the  contact  discontimhies  after 
the  interaction  of  body  shock  and  wing  shock.  The  pressure  distributions  on 
meridional  surface  <p=  90*  obtained  with  explicit  and  implicit  scheme  are 
compared-i-1  Fig.  5,  which  agree  very  well.  The  above  results  detr.  mstrate 
that  ttic  capability  of  capturing  shock  and  other  contact  d^continutics  with 
NND  schemes  is  satisfactory. 

Concluding  Remarks 

According  to  the  calculated  results  aid  the  others  t-’a-lfl,  v/c  arc  sure 
it  is  reliable  to  the  NND  scheme.  "So  distiti  juished  feature  of  the  rchemes  is 
capability  of  caixuring  shock  and  other  contact  discontinuties,  Futhermore, 
the  schemes -possess  good  stable  characteristics  and  converged  accuracy, 
which  is  essential  to  any  high  shock  resolution  scheme.  In  addition,  the  pre¬ 
sent  form  seems  to  be  the  simplest,  meanwhile, .the  amount  of  the  numeri¬ 
cal  work  is  much  reduced  in  comparison  with  some  other  high  resolution 
TVD  schemes. 
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Abstract — A  dual  porosity  m°del  *s  derived  by  the  formal  the¬ 
ory  of  homogenization.  Themodel  Ptuperly  mioipoiuies  gravity 
in  that  it  respects  the  equ.hbriutn  sWtcs  of  the  rriedium. 

1.  iNTRObtlCTlON* 

We  consider  flow  in  a  naturally  fractured  reservoir  which  we 
idealize  as  a  periodic  medium  Us  shown,  in  Fig-  J.  There  are 
three  distinct  scales  in  this  system,  the  pore  Scale,  the  f'’a!e 
of  the  average  distance  between  fractures,  and  the  scale  of  ti.  ’ 
entire  reservoir.  The  concept  of  do^-porosity  [4],  [JO]  is  used  to 
average  the  two  finer  scales  in  *Uch  a  way  that  tllc  pore  scale  is 
recognized  as  being  much  smaller  than  the  fracture  spacing  scale. 
The  fracture  system  is  modeled  a  porous  structure  distinct 
from  the  porous  structure  of  the  rock  (the  matriz)  itself. 


Dual-porosity  models  can  be  defied  by  the  technique  of  ho¬ 
mogenization  [2],  [3],  [6]  (sec  also  the  general  references  (5],  [7j, 
and  [9]).  Briefly,  we  pose  the  correct  microscopic  equations  of 
the  flow  in  the  reservoir  and  then  let  the  block  size  shrink  to  zero. 
The  resulting  macroscopic  model  js  formulated  in  six  space  di¬ 
mensions,  three  of  them  represent  the  entire  rcscrv0ii  over  which 
the  fracture  system  flow  occurs,  frt  each  point  of  the  reservoir, 
there  exists  a  three  dimensional,  "infinitely  small”  matrix  block 
(surrounded  by  fractures)  in  which  matrix  flow  Occurs. 

For  singlephasc,  single  component  flow,  it  is  recognized  that 
diffusive,  gravitational,  and  viscous  forces  affect  the  movement 
of  fluids  between  the  matrix  and  fracture  systems;  however,  only 
diffusive  forces  arc  easily  handlcd-(sec,  e.g.,  (lj,  (4),  |6],  (8),  [10], 
n.:d  the  many  multiphase  models  in  the  petroleum  literature). 
Simply  including  gravity  in  the  maWx  of  the  standard  model 
[2],  [3],  [G]  creates  an  inconsistency  in  that  when  the  fracture 
sy.Acm  is  in  gravitational  equilibrium,  the  matrix  system  is  not. 
In -thi«  paper  we  derive  a  consistent  mode!. 

2.  The  Microscopic  a  r-'b  Macroscopic  Models 

Denote  the  reservoir  by  12.  For  a  sequence  of  e’s  decreasing  to 
ze  1,  wc  consider  equivalent  reservoirs  with  matrix  blocks  that 
arc  e  times  the  original  size  in  any  linear  direction.  Let  I2J-  and 
be  the  ftacturc  and  matrix  parts  of  Si,  respectively.  Each 
period  of  the  reservoir  is  congruent  to  the  unit  cell  eO,  the 
period  at  poin*  j  6  12  is  denoted  by  For  the  nxed  unit 

coll  Q  (see  Fi,,.  ?.),  we  write  £/  a11*!  Qm  for  the  fracture  and 
matt* .  parts,  respectively.  Let  Tc  centro>J  of  Q  be  *ite  origin, 
at*  ’  'be  centroid  of  Q'(x)  bc^'(z).  Then  x  ~  f'(-t)4  '!/  -  x  +  oj. 
Asymptotically,  1  --  4'(x)  selects  upeffod  and ;/  specifies  a  point 
in  the  enlarged,  congruent  period  Q.  Let  ,,  denote  the  unit 

'This  work  was  supported  in  part  fry  t,  Rational  Science  Foun¬ 
dation  and  the  State  of  Texas. 


normal  vector  to  the  matrix  fracture  interface  0Sl’m  (or  0Qm). 

Wo  uat  upper  and  low ei  vaselcttcrs  for  fractuie  and  matrix 
quantities,  respectively.  Let  P  (or  p)  be  the  fluid  pressure,  and 
‘I’’  (or  4>)  and  AT*  (or  k)  be  the  porosity  and  permeability  on 
the  pore  scale  (so  <P*  «  1  and  K*  is  very  large).  The  fracture 
sgstem  porosity  and  permeability, <I>  and  K,  are  defined  on  the 
fracture  spacing  scale.  Easily 

*  =  IQ/I  *7121,  (i) 

where  j  |  denotes  the  volume  of  the  set,  while  A"  is  derived  by 
lioiiiogenization.  Finally.  ,  (P)  (or  p{p))  and  /*  art  fluid  density 
and  viscosity,  ai*d  ij  is  the  gravitational  constant.  Let  ej  point 
in  the  jth  Cartesian  direction,  where  c3  points  down. 

Define  the  function  ■,  (.13)  as  the  solution  to 

=  p(t%;  ie.,  J  =  <7(2:3  -  x3,°).  (2) 

Then  Vp  —  p(p)gc 3  =  0  if  and  only  if  p  —  ${x3  +  £3)  for  some 
constant  £3,  and  so  +  £3)  is  the  gravitational  equilibrium 
pressure  distribution.  We  note  that  the  pseudopotential  of  the 
flow  is  given  by  ^“'(p)  —  X3. 

We  ignore  boundary  conditions  on  dfl,  external  sourccs/sinks, 
and  initial  conditions  since  wc  are  interested  in  internal  flow. 

The  microscopic  model:  for  the  fracture  flow, 

#*|p(P‘)  -  v  ■  {p-'p{P')ic ‘(VP*  -  p(Pc)g^)} 

=  0,  r  SI),  (3a) 

/« -'p[P<)K-{VP'-p{P<)gc3)-v 

=  ep-*  ''(pe)k(cVp<  -  p(pf)gc3)  v,  x  €  dl i(m.  (3b) 
For  the  matrix, 

*§iplT,‘]~  ’  [/* ~ *  /’Cp' (eVp'  -  p(p)ge3)} 

=  0,  *  €  S2lm,  (4a) 

p"  =  +  («-1  -  l)(x3  -  «(x))  +  CO, 

x  €  dfi<m.  (4b) 

On  each  Q'(x),  we  need  to  define  ('.  For  a  given  P',  we  can  find 
for  each  constant  the  solution  p'  of  the  steady  -state  problem 
corresponding  to  (4).  So,  for  the  given  fracture  pressure  P‘,  we 
take  the  which  gives  rise  to  the  p‘  that  satisfies 

[  dp{p)dx  =  f  <fp{p')dx,  (5) 

JHUM  ■'Qfo(x) 

where  p'  is  t*  steady  state  solution  of  the  unsealed  problem 
coiicspon,..i*£  to  (4),  (jiven  by  removing  the  two  e’s  appearing 
as  coefficients  in  (4a)  and  replacing  (4b)  by  p'  ~  P'.  (In  the 
case  of  an  incompressible  fluid,  simply  take  ('  =  0.) 

This  £  fantily  of  micruscopie  models  satisfies  the  following. 

(i )  Darcy  flow  governs  the  reservoir,  and  it  docs  so  in  the 
standard  way  when  £  =  1  (since  then  —  0); 

(ii)  For  each  f,  Darcy  flow  occurs  in  the  fractures  and  within 
the  scaled  matrix  blocks  (i.e.,  if  any  matrix  block  Q'm 
is  expanded  to  unit  size  Qm,  tlie  transformed  equations 
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indicate  that  Darcy  flow:  results); 

(in)  If  the  fracture  system  is  in  gravitational  equilibrium  in 
the  vicinity  of;a  block,  then  the  boundary  conditions  on 
that  block  reflect  this  gravitational  equilibrium; 

(iv)  For  fixed  fracture  conditions  around  any  matrix  block, 
the  steady  state  matrix  solution  gives  rise  to  the  same 
mass  as  calculated  from  the  steady-state  solution  of  the 
unsealed  matrix  problem. 

We  require  (iv)  so  that  mass  is  conserved,  since  when  we  scale 
the  matrix  problem  with  (ii)-(iii),  we  change  the  pressures  which 
may  change  the  total  mass.  Under  steady-state  conditions  it  is 
easy  to  account  for  any.  such  spurious  changes. 

We  remark  that  the  standard  microscopic  model  [2],  [3],  [6] 
replaces  (4b)  with  p '  —  P' ,  omits  (5),  and  to  be  consistent 
needs  to  have  p(p')g  replaced  by  ep(p')g  in  (3b)  and  (4a).  The 
novel  expression  (4b)- can  be  viewed  as  a  scaled  continuity  of 
pseudopotential,  since  we  can  rewrite  it  as 

“  (&(*)  +  e"*(*3  “  S(*))  +  <‘)  =  <T‘(-pt)  -  *3- 

The  macroscopic  model:  For  the  fracture  flow, 

-v*  ■  [ii-'p(P°)K(VtP°  -  p(P°)«7e3)]  =  0,  X  642,  (G) 

where  (1),  (9),  and  (10)  define  the  new  coefficients.  For  the 
matrix- flow,  for  each  x  6  42, 

«*JjP(P°)  -  -  [p~l p(p°)k(V yp®  -  p(p°)gc 3)] 

=  0,  y  €  (?a) 

p°  =  ’>(0-1(P°)  +  yz  +  C°),  y  e  3q,„,  (7b) 

where  i[>  is  defined  by  (2)  and  £°  is  defined  by 

~[  Mv(v-'(P°)  +  JO  +  C0))  drj  =  <pp{P°b  (S) 

|=2ml  JQ„ 

Note  that  no  auxiliary  steady-state  problem  need  be  solved. 

The  standard  macroscopic  model  replaces  (7b)  by  p°  =  P°, 
omits  (8),  and  should  have  g  =  0  in  (7a)  to  be  consistent. 

3.  Formal  Homogenization 

We  follow  the  homogenization  of  the  standard  model  given  in 
[2]  and  (6J.  As  usual,  for  some  functions  P(  and  pe,  C  —  0,1,2, ..., 
we  assume  the  formal  asymptotic  expansions 

x  —  £'(x)  ~  eg  and  V  ~  e_l  Vy  +  Vr, 

50 

Pc(x,t)  ~  lP((x,y,t ),  *€/?,)/€  Gy- 

e= o 

oo 

^  V  €  Qtn* 

1=0 

where  the  Pl  are  periodic  in  g  with  period  Gy,  reflecting  the 
periodicity  of  the  medium.  We  note  that  if  some  function  F 
depends  on  ~  f  t~* ,  then  Taylor’s  Theorem  shows  that 

F(-')  ~  F(£tV)  -  F(-«)  +  f  \fFl, 

'  o  '  t- 1 

for  some  Fl  that  depend  on  the  zl\. 

Substituting  the  formal  expansions  into  (3)-(5)  and  isolating 
the  coefficients  of  powers  of  <  yield  relations  for  the  Pl  and  //. 

We  begin  with  two  standard  results  which  can  be  easily  de- 
rived  and  appear  in  (2|  arid  [G].  First,  the  e~2  terms  of  (3a)  ami 


the  e  1  terms  of  (3b)  imply  that  P°  =  P°(x,i)  only.  Second, 
the  e“*  terms  of  (3u)and  the  e°  terms  of  ^3b j  allow  us  to  write 


3  npo 

pl~Jl  ~  PkP*)9“3  + ' 

j=  l  ox> 


for  some  ~(x,i),  where  the  wfly),  j  -  1,2,3,  are  periodic  across 
dQ  and  satisfy 


-  Vj,  •  (Vj,wy)  =0,  y&  Q/,  (9a) 

Vsw j  ■  v  =  -ey  •  i/,  y  6  0Qm.  (9b) 

Recognizing  that  (e_1  -  l)(x3  -  £J(x))  ~  (1  -  e)y3,  we  have 
(7)  from  the  e°  terms  of  (4). 

We  now  consider  (5).  First,  (4 )  ot  (7),  without  the  time  deriva¬ 
tive  term,  implies  p°  —  v(y>~l(P°)  -r  !/3  +  C°).  For  p%  the  e~2 
terms  of  its  defining  equation  and  the  e°  terms  of  its  boundary 
condition  imply  p°  =  P°,  Now  a  rescaling  shows  that 


Jcu 


(*) 


$p(pc)dx ■ 


i  *(± 

JQm  \  (~Q 


for  some  pc  depending  on  the  Pl's  and  on  A  similar  expres¬ 
sion  holds  for  the  right  side  of  (5),  and  so  the  t°  terms  of  (5) 
give  the  definition  of  Cfl  as  (S). 

Finally,  the  e°  and  el  terms  of  (3a)  and  (3b)  can  be  analyzed 
exactly  as  in  the  standard  model  [2j,  [Gj  to  give  (6),  and  the 
tensor  K  is  seen  to  be  given  by 


I\  is  symmetric  and  positive  definite  (sec,  c.g.,  [3]). 
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Abstract  Simulation  of  three  dimensional  unstable  miscible  dis¬ 
placement  utilizing  a  numerical  method  which  combines  the  mod¬ 
ified  method  of  characteristics  is  described.  Numerical  experi¬ 
ments  are  presented. 

I.  INTRODUCTION 

In  flow  through  a  porous  medium  small  flow  disturbances  are 
continuously  generated  due  to  heterogeneities  of  the  medium, 
both=  physical  and  chemical.  The  processes  of  finger  growth  and 
interaction  are  linked  to  the  heterogeneity  of  the  medium  and  m 
particular  to  the  spatial  variation  of  porosity  and. permeability. 
For  example  viscous  fingering  arises  in  the  displacement  of  a  fluid 
in  a  porous  medium  by  a  less  viscous  fluid.  That  is  small  per¬ 
turbations  tend  to  grow  with  time  producing  large  protrusions  or 
fingers.  A  large  number  of  miscible  enhanced  oil  recovery  pro¬ 
cesses  are  dominated  by  viscous  fingering  and  cause  a  severe  re¬ 
duction  in  displacement  efficiency.  In  groundwater  fingering  can 
cause  uneven  spread  of  a  contaminant.  Chemical  heterogeneities 
arising  from  adsorption  and  ion  exchange,  further  accentuate  the 
instabilities. 

Numerical  simulation  is  a  major  tool  in  understanding  the 
effects  of  various  parameters  on  miscible  viscous  fingering.  Inves¬ 
tigation  of  the  effect  of  the  structure  of  the  porous  medium  has 
been  an  active  research  area  for  many  years.  A  major  difficulty  is 
in  developing  realistic  descriptions  of  the  medium  for  numerical 
simulation.  Conditional  simulation  [4, 5,  7,  8,  lj  involves  the  gen¬ 
eration  of  synthetic  .porous  media.that  are  compatible  with  the 
available  statistical  information.  To  obtain  a  meaningful  statisti¬ 
cal,  result,  many  realizations  must-be  carried  out  and  then  aver¬ 
aged.  A  number  of  statistical  techniques  that  have  been  employed 
for  generating  realizations  of  a  porous  medium  arc  described  in 

(e) 

In  [7,  SJ  Moissis,  Miller,  and  Wheeler  studied  by  numerical 
simulation  the  effects  of  spatial  variation  in  permeability  and  of 
the  viscosity  ratio  on  horizontal  unstable  miscible  displacement. 
Their  numerical  experiments  were  limited  to  a  two-dimensional 
porous  media  and  to  a  linear  (rectangular)  geometry.  In  this  pa- 
per-wc  briefly  discuss  extensions  of  these  results  to  three  spatial 
dimensions,  for  a  linear  Hood  problem  vve  tormuiatc  a  numerical 
method  combining  a  Galcrkin  characteristics  method  with  con¬ 
tinuous  trilinear  elements  for  the  concentration  of  the  invading 
fluid  and  admixed  finite  clement  (cell-centered  finite  differences) 
for  the  pressure  equation.  Some  numerical  results  are  presented 
which  involve  a  porous  medium  previously  studied  (3,  7). 


II.  METHODOLOGY 

2.1  The  Problem. 

Consider  incompressible  miscible  displacement  in  a  porous 
medium  having  the  shape  of  a  rectangular  parallelpiped.  The 
pore  space  of  the  medium  is  initally  filled  with  the  resident  fluid. 
The  medium  is  flooded  at  the  side  x  =  0  with  pure  invading 
(ot  displacing;  fluid.  Thus  x  the  piincipal  flew  ditccliun  and 
y  and  z  are  the  directions  transverse  to  the  flow.  Let  Lx,Ly, 
and  Lz  be  the  x,  </,  and  »  dimensions  of  the  parallelpiped  and  let 
fl  —  (0,  Lz')  a  (0 ,Ly)  a  (0 •Lz).  Under  the  above  assumptions,  the 
displacement  can  be  muddled  by  the  following  set  of  equations. 


Ji¬ 
ll  =  — Vp 
/I 

(1) 

V  ■  u  =  0 

(2) 

(£c)  +  u  -  Vc  =  V  •  j DVc 

(3) 

Equations  (1)  (2)  can  be  combined  to  yield  the  pressure  equa¬ 
tion  and  (3)is  the  concentration  equation.  Here  D  is  the  diffusion 
dispersion  tensor.  The  eigenvectors  of  this  tensor  arc  orthogonal 
with  one  of  the  eigenvectors  being  u  and  the  eigenvalues  Oi,a, 
and  or j. 

Wc  impose  the  Dirichlet  boundary  conditions  />  -  pu{l)  and 
c  =  Cg(f)  at  the  Inflow  boundary  x  -  0.  The  outflow  boundary 
conditions  at  x  =  Lx  are 

P  ~  0  (4) 

Oc 

— +u-Vc=0  (5) 

The  remaining  faces  have  noflovv  boundary  conditions.  The 

initial  condition  is  c  —  0.  The  viscosity  /l  In  (I)  is  a  function  of 

the  concentration  c  of  the  invading  fluid.  The  equation  of  state 
used  in  this  work  is 

—  =  [l  -t-(i\/,/'1  -  ljcl’1  (G) 

lb  1  1 

where  /ir  and  p,  arc  the  viscosities  of  the  resident  fluid  and  the 
invading  fluid  respectively  and  M  =  /i,//r,. 

2.2  Numerical  Method 

The  system  of  coupled  equations  is  numerically  approximated 
by  a  predictor  corrector  time  stepping  method  which  combines  the 
modified  method  of  characteristics  for  the  concentration  equation 
and  a  mixed  finite  element  method  (cell  centered  finite  difference 
method)  for  the  pressure  equation  (MMOC-MFE). 
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Let  Mh(Zh)  denote  the  finite  dimensional  space  spanned  by 
the  continuous  (discontinuous)  trilinear  (constants)  defined  on  ft. 
Let  Vh  =  Vh{x)  x  Vl{y)  x  V'h{z)  where  Vh(x)  denotes  the  ten¬ 
sor  product  space  of  continuous  piecewise  lincars  on  [0,  Lx]  and 
discontinuous  piecewise  constants  on  [0,  Ly]  *  [0,  Lz\.  \\iu)  and 
Vh{z): are  defined  similarly. 

Let 

V‘h(z)  =  Vh{z)  fl  {u|u(i,y,0)  =  v(x,y,Lz)  =  0.}  (7) 

Similarly  we  define  V‘h(y). 

We  define  the  inner  product  <  v,u  >—  Jjj  vudxdydz.  Let 
At”  >  0  and  in  =  nAt. 

In  the  MMOC-MFE  formulation  we  seek  an  approximation 
(C;P,U)  in  Mh  x  Zh  x  Vk  to  the  solution  (c;p,  u)  as  follows. 

For  n  >  0,  the  MFE  approximation  (P”,Un)  isdefined  by: 

<  >  -  <  P",  V  ■  v  > 

=  /  f  " My<z^n)v{0,y,z)dydz,  vg  Vh  (S) 

JO  Jo 

<  V  •  U",  w  >=  0,  wezh  (9) 

where  C°-°  =  C°. 

For  n  >  1  the  MMOC  approximation  Cn,k,  k  =  0,1,  is  de¬ 
fined  by 

<d’Cn'k~fn~',x  >  +  <  D(U”-,+fc)VC”,  >=0,  (10) 

for  x  €  Mh  where 
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C"-*(0,y,r)  =  l  (11) 

Cn-k(l,y,z)  =  C*'l0,y,*),  (12) 

(13)  u-.,(.ES.VSA3UTYPUXE 

(>/,r)  €  (0 ,Ly)  x  (fi,Lz).  Here 


CB-,(x)  =  CP'1  — 

and 

Cn  =  C”'1  (15) 

£Un(x)  is  an  approximate  average  velocity  between  the  times 
tn~l  and  t”,  which  is  computed  by  segmenting  the  time  step  At 
into  smaller  sub-lime  steps  and  using  a  predictor-corrector  pro¬ 
cedure  to  determine  the  velocity  along  the  characteristic  in  each 
sub-time  step. 

The  combination  of  the  MFE.M  and  the  MMOG  has  been  pre¬ 
viously  applied  to  the  solution  of  miscible  displacement  problems 
in  two  spatial  variables  [9, 2,  7,  S). 


MXSH  PVAS- 


III.  NUMERICAL  RESULTS 


Tfie  following  data  has  been  used  in  the  simulation,  a 1  = 
2.76  x  10"3,  orj  =  7.73  x  10"5  and  zero  molecular  diffusion.  The 
inflow  boundary  condition  for  c  was  unity.  We  set 

Lx  —  Ly  =  I.z  =  1. 


Ccrcv-iMn  Ccnxn  r-ai5.PlA.VE  l 


«»  f>  *•  «•  «i  >1 

' — 


CoKxn  T-aiiPUMt 


H  «•  f#  ## 
*  <» 


The  isotropic  permeability  used  in  the  model  is  described  graph¬ 
ically  in  Fig.I  for  a  high  and  a  low  permeability  planes.  Corre¬ 
sponding  concentration  profiles  arc  shown  in  Fig.2. 
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Fig.  I 


Fig.  2,  M=10 


ORDER  OF  CONVERGENCE  ESTIMATES  FOR  FINITE  ELEMENT 
APPROXIMATIONS  OF  DEGENERATE  PARABOLIC  SYSTEMS 
MODELLING  REACTIVE  SOLUTE  TRANSPORT  IN  POROUS  MEDIA 

PETERKNABNER 
Univcrsitat  Augsburg 
Institut  fur  Mathcmatik 
Univcrsilatsstr.  8 
D-8900  Augsburg,  Germany 


Abstract  -  The  scmidiscrcte  finite  element  approximation  is  stud¬ 
ied  for  a  scmilinear  reaction-diffusion  system  consisting  of  a 
parabolic  and  an  ordinary  differential  equation,  where  the  non¬ 
linearity  is  non-Lipschit2,  and  a  related  pde  of  'porous  medium 
equation'  type.  Based  on  stability  estimates  for  the  continuous 
problem,  order  of  convergence  estimates  are  proved  for  linear 
elements  in  energy-  and  L2-norms,  which  partially  arc  optimal. 

We  consider  the  finite  clement  approximation  of  equations,  which 
are  conceivable  as  a  macroscopic  model  for  transport  and  adsorp 
tion  in  porous  media  (cf.  [4J  for  details).  A  water  flow  regime, 
characterized  by  the  water  content  0  and  the- flux- vector-  field  q 
and  assumed  to  be  known,  causes  the  transport  of  a  solute  with 
concentration  u  by  convection  and  diffusion/dispersion.  The 
substance  undergoes  a  surface  reaction  with  the  porous  sceleton 
like  adsorption,  i.e.  there  is  an  adsorbed  concentration  c.  The 
adsorption  reaction  may  be  cither  in  non  equilibrium,  leading  to 

dt(Qu)+pdtv  -  V  -  (DVu—  qu)  =  0, 

div-k{<p(u)~v )  in  QT  :=  ft  x  (0,Tj, 

or-jn  equilibrium,  which  gives  rise  to  v  =  «(u),  i.e. 

di (0u)  +  pd&{ u)  —  V  -  (DVu  -  qu )  =  0  in  Qt ■  (BA) 

(KA)  or  (EA)  are  supplemented  by  boundary  and  initial  condi¬ 
tions 

(DVu  -  qu)  -  n  ss  F  (>  0)  on  Sir  :=  Sj  x  (0,Tj, 

jDVtt  - n  ss  0  on  Srr  ~  S»  x  (0,T|,  (1) 

u(.,0)  =  no  {—  0)  [c(.,0)  =  t'o  (>  0)]  in  fl. 

Hereby  fl  C  IR,V  is  a  bounded  domain,  dfl  =  SjOSz,  such  that 
q-n  <  0  on  Si  and  q-n  >  0  on  Si,  n  being  the  outward  normal. 
The  nonlinearity  tp,  the  adsorption  isotherm,  only  fulfills 

V  €  C°-?[0,  oo)  H  C^(0,  oo)  for  some  p  €  (0, 1),  ^ 

9(0)  =  0,  «(■»)  >0  for  s  >  0,  y>  is  non-decreasing, 

such  that  degeneration  may  occur  atu  =  0  leading  to  finite  speed 
of  propagation  ofsupp  u  (and  supp  r)  and  limited  smoothness 
of  the  solution.  For  the  following  results  certain  conditions  arc 
necessary  with  respect  to  the  coefficients.  These  are  fulfilled  if 
the  rale  parameter  k  >  0  in  (KA)  is  a  constant  and  the  other 
coefficients  depend  only  on  space  satisfying 

0(x)>0a>O,  p(x)>po>0,  V-q(s)=0,  (3) 

jD(x)  is  symmetric  and  positive  definite  uniformly  in  x. 


One  may  think  of  other  rate  functions,  ,.e.  descriptions  uf  Qt t, 
than  the  explicit  une  in  (KA),  but  this  specific  structure  is  im 
portant  for  the  following  considerations. 

For  the  semihnear  case  (KA)  ac  have  despite  of  the  possible 
degeneration  the  optimal  Lipsd.it 2  stability  of  u.  ivith  respect  to 
the  energy  norm 

\u\<h  :=  max|ju(.,/)[l£i(ft)  4-  fiVu[j£z(Qrj. 

Theorem  1.  Let  (u„c,)-hc  weak  solutions  for  the  data  uq,, 
voi  and  Fi,  then 

Juy  -  uyjyj.  <  £7(!Iuoi  -  -^2tii2(5,}-})- 

0 

Here  and  in  the  following  C  s  0  is  a  constant  independent  of 
the  quantities,  with  which  it  is  multiplied.  The  proof  ^cf.  [2j,  |4jy 
consists  of  three  basic  steps: 

(I)  Test  the  pde  with  the  primitive  of  u  :ss  tij  —  kj, 

(II)  Test  the  ode  with  u, 

(III)  Test  the  pde  with  u. 

These  steps  will  reappear  in  the  proofs  of  all  the  following  as¬ 
sertions. 

For  k  — *  00  we  expect  convergence  of  (KA)  to  (EA).  Under 
certain  conditions  on  the  data  the  speed  can  be  estimated  (cf. 

{4J  for  details  of  the  convergence  proof): 

Theorem  2.  Let  (ttW,»W)  be  weak  solutions  of  (KA)  for  the 
rate  parameter  k  and  let  ir  be  the  weak  solution  of  (EA)  for  the 
same  data,  then: 


□ 

This  justifies  the  kinetic  approximation  for  (BA ),  i.e.  to  approx¬ 
imate  the  solution  of  (EA)  by  the  solution  of  (KA)  for  large 
k. 

We  now  turn  to  the  finite  element  approximation  of  (KA),  where 
wc  only  consider  the  discretization  in  space.  Let  fi  t,  HI*  be  a 
bounded  domain  with  smooth  dfl  and  7)  a  regular  tnangulation 
of  fl.  The  discretization  parameter  h  is  given  by  the  maximal 
diameter  of  the  triangles  1 1  7*.  To  simplify  the  notation,  we 
ignore  T,  i.e.  we  treat  fl  as  a  polygonal  domain.  Let 

p  be  a  constant  and  define 
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$A  :=  {a  €  C(n)  |  X|T  is  linear  for  each  T  €  7),}, 

f fgdx.  ^ 

J  f) 

Then  the  consistent  semidiscrete  Galerkin  approximation  is  given 
ty  «A  :  [0,T]  -»  SA  satisfying 

(9t(0MA),7;)  +p(5<vA,7/)  -  (Lh(uh),t])  =  0.  (5) 

(9tVh,fl)  ~  -  »*),»/)  for  ij  tS/,,  tfc  (P.T),  (6) 

u/.(0)  =  «o;»  ^a(O)—  no;,.  (7) 

where  Lf,  =  JD^(t)  is  defmed  as  follows:  For  q  €  Sy. 

{Lh{u),rj)A= —(DVu  —  qu,Vrj)  -  /  q.-nui]d<r  +  /  Eqda. 

Js 2  >/5i 

The  data  arc  assumed  to  be  sufficiently  smooth  and  uo;,,  vq/,  are 
taken  as  the  T2-projections  onto  Sj,. 

Despite  of  the  missing  Lipschitz  continuity  of  <p  there  is  an  op¬ 
timal  order  of  convergence  estimate  for  the  cnergynorm: 

Theorem  3.  Let  (a,  a)  be  the  weak  solution  of  (KA)  and 
(.uhiv/i)  ffle  consistent  senildiserete  Galerkin  approximation,  then. 

i)  |u  -  Uh\qT  <  Gh, 

ii)  ||tt  -  m|[£2(Qr)  <  CK&. 

Hereby  p  is  the  Holdcrexponent  of  ip. 

0 

The  proof  uses  an  auxiliary  linear  problem  by  freezing  the  non¬ 
linearity  at  the  solution.  Let  (u'h,v*h)  denote  the  Galerkin  ap¬ 
proximation  for  this  problem.  Then  optimal  convergence  results 
for.u  -  are  well-known.  The  remainder  u"h  -  u/,  is  investigated 
by- means  of  the  basic  steps  in  the  proof  of  Theorem  1  and  rea¬ 
sonings  in  [1].  It  is  open,  whether  also  in  IMI£2(Qr)  the  optimal 
estimates  0(h 2)  holds.  Investigations  of  uniform  convergence 
are  in  progress. 

The  consistent  approximation  is  only  asymptotically  in  accor¬ 
dance  with  the  physical-picture  insofar  (6)  is  not  a  local  equa¬ 
tion  in  space.  This  is  achieved  by  considering  the  semidiscrete 
Galerkin  approximation  with  mass  lumping,  which  is  defined  by 
(7)  and 

{dt(Quh),v)  +  p(9tvh,t])h  -  (Lh(uh),v)  =  0,  (8) 

{9tvi„v)h  =  (H<p(uh)  -  for  7j  €  t  €  (0,jTj,  (9) 

where 

{f,g)h  •■=  [  d(f,g)dx  and  for  u  e  (7(0) 

J(i 

I(u)  €  Sh  is  defined  by  I(u)(P)  =  u(P)  for  all  nodes  P  of  T. 

In  fact  (9)  is  equivalent  with  the  collocation  approach  requiring 
the  ode  to  be  fulfilled  at  the  nodes  P.  Proceeding  as  in  the  proof 
of  Theorem  3  we  arc  lead  to  an  additional  term  which  can  be 
interpreted  as  the  quadrature  error.  If  the  solution  u  of  (KA) 
would  have  the  nondegeneracy  property  with  a  =  which 
roughly  states  that  u^a  grows  linearly  away  from  d  supp  u  into 


supp  u,  then  the  estimates  of  Theorem  3  can  be  shown  along 
the  lines  of  (1).  We  conjecture  that  this  property  holds  true,  as 
this  is  the  case  for  travelling  wave  solutions  (cf.  [3]),  but  there 
is  no  proof  up  till  now.  Without  nondegencracy  property  it  is 
possible  to-consider  (7),  (8)  for  a  regularized  y>e  and  to  adapt 
the  regularization  parameter  £  to  h. 

This  leads  again  to  an  order  of  convergence  estimate,  but  weaker 
than  in  Theorem  3. 

Finally,  we  consider  the  convergence  of  the  semidiscrete  kinetic 
approximation.  A  combination  of  Theorem  2  and  an  estimate 
similar  to  Theorem  1,  but  uniform  in  the  rate  parameter  k,  leads 
to 

Theorem  4.  Let  u  be  the  weak  solution  of  (BA), 
the  solutions  of  (5),  (6),  (7)  for  the  rate  parameter  k,  then: 

for  k  = 

G 
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COMPUTATIONAL  ASPECT'S  OF  CONTAMINANT  TRANSPORT  WITH 
NONLINEAR  ADSORPTION 
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Abstract  Simulation  of  advcction-diffusion  equations  modeling  solute  tran- 
port  in  groundwater  by  higher  order  Godunov-mixed  lite  element  tech¬ 
niques  is  described.  In  this  approach,  a  higher  order  aov  method  mod¬ 
els  advection,  while  the  mixed  method  models  diffub  These  methods 
ore  especially  useful  for  problems  with  nonlinearities,  -n  as  nonlinear  ad¬ 
sorption  terms.  Numerical  results  for  solute  transport  with  instantaneous, 
nonlinear  adsorption  are  presented 

I.  INTRODUCTION 

As  noted  in  two  recent  reports  by  the  United  States  Environmental  Pro¬ 
tection  Agency  (1)  and  Department  of  Energy  [2],  the  potability  of  ground¬ 
water  at  many  locations  in  the  United  States  is  being  adversely  affected  by 
the  introduction  of  hazardous  chemicals  into  the  subsurface  Such  chemicals 
include  BTX  (benzene,  toluene,  xylene),  gasoline,  herbicides,  and  pesticides 
Modeling  the  flow  of  these  types  of  chemicals  through  the  subsurface  has 
seen  increasing  interest  in  recent  years. 

The  (low  of  contaminants  in  groundwater  is  influenced  by  many  factors, 
including  the  aquifer  characteristics  (hydraulic  conductivity,  porosity,  etc  ), 
the  presence  of  microorganisms  capable  of  biodegrading  certain  compounds, 
and  the  chemical  process  of  adsorption.  Biodegradation  is  an- important 
aspect  of  groundwater  flow,  as  many  compounds  may  be  eliminated  by  nat¬ 
ural  biodegradation.  Moreover,  natural  biodegradation  processes  may  be 
enhanced  to  effectively  remove  contaminants  [1].  Adsorption,  which  is  a  re- 
tardation/release  reaction  between  the  solute  and  the  surface  of  the  porous 
structure,  is  also  a  significant  factor  in  contaminant  movement.  Adsorp¬ 
tion  can  haie  thc  effects-of  segregating  a  hazardous  compound  frum  the 
groundwater,  and  slowing  the  overall  movement  of  the  chemical  species. 

The  author  and  M.  F.  Wheeler  have  developed  and  tested  a  numerical  al¬ 
gorithm  for  modeling  multidimensional,  multicomponent  contaminant  flow 
which  includes  the  effects  of  biodegradation  and  linear  adsorption,  see  for 
example  (3,  4].  In  this  paper,  we  consider  onc-dtmensional  flow  of  a  chem¬ 
ical  species  in  groundwater  undergoing  (possibly)  nonlinear  adsorption.  In 
an  earlier  paper  [5],  the  author  and  M.  F.  Wheeler  described  a  first-order 
method  for  simulating  this  problem.  We  will  describe  here  a  higher-order 
extension  of  this  technique  and  use  it  to  study  nonlinear  adsorption  phe¬ 
nomena  in  one  space  dimension. 

II.  THE  MATHEMATICAL  MODEL 

Let  e  denote  the  concentration  of  a  chemical  species  in  solution  We 
assume  a  source  of  solute  c  =  Co  at  x  =  0,  and  assume  flow  is  in  the  positive 
x  direction.  In  one  space  dimension,  conservation  of  mass  yields 

(5c,  +  pA,  +  ucz  -  Dcxz  =  0,  x  >  0,  <  >  0,  (1) 

c(*,0)  =  c°(z).  (2) 

Here,  the  positive  constants  u  (cm/h),  and  D/d  (cmJ//i)  denote  poros- 
Ity,  Darcy  velocity,  and  the  sum  of  the  molecular  diffusion  and  mechanical 
dispersion  coefficients,  respectively.  The  term  pA  represents  the  amount 
of  solute  adsorbed,  where  p  (3/cm3)  is  the  bulk  density  In  many  cases 
of  physical  interest,  flow  is  advection-dominated;  that  is,  u  is  much  larger 
than  D  multiplied  by  some  appropriate  length  scale.  This  causes  numerical 
difficulties,  which  we  will  discuss  in  more  detail  below. 

The  term  pA  is  in  general  heterogeneous,  depending  on  the  adsorbent 
surfaces.  The  adsorption  process  can  be  divided  into  two  classes,  equilib¬ 
rium  and  non-equilibrium.  We  will  only  consider  the  case  of  equilibrium 
adsorption.  Adsorption  is  assumed  to  be  in  equilibrium  when  the  reaction 
kinetics  occur  at  a  much  faster  rate  than  the  rate  of  transport.  In  this  case, 
A  can  be  written  as  (see  [6,  7))  A  =  ’k(c),  where  'i(c)  is  an  adsorption 
isotherm.  We  will  assume  'f'(c)  is  described  by  the  Freundlich  isotherm, 

>P(c)  =  Kif,  0<p<l,  (3) 

where  Ki  (cm3/j)  is  the  distribution  coefficient.  Note  that  in  this  case  'I'(c) 
is  not  Lipschitz  continuous  at  c  =  0  for  0  <  p  <  1. 

For  more  details  on  these  models,  and  the  mathematical  ramifications, 
see  (7). 


III.  NUMERICAL  APPROACH 

Under  the  assumptions  given  above,  (1)  can  be  written  as 

$c,  +  R(cp)i  +  fiCi  -  Dcc.  =  0,  x  >  0,  (  >  0,  (4) 

where  R  -  pKaj$,  u  =  u/<j>,  and  D  =  D/d’  Let  /1  =  c  +  Rtf,  and  let  1 j(p) 
be  the  inverse  function,  >)(/i(c))  =  c  Then  (4):can  be  written  as  a  parabolic 
equation  in  p: 

Pt  +  iii?(p)r  -  Dq(/i)xr  =  0,  i  >  0,  t>  0.  (5) 

As  mentioned  before,  this  equation  poses  the  difficulties  that  the  nonlinearity 
<?  is  non-Lipschitz  at  c  =  0,  and  the  flow  is  generally  advection-dominated, 
thus  the  solution  exhibits  sharp  fronts.  The  effects  of  choosing  p  <  1  (as 
opposed  to  p  =  1)  are  to  make  the  fronts  even  sharper,  and  to  further  retard 
the  flow  of  the  chemical  species.  In  fact,  in  the  limit  of  zero  diffusion  with 
p  <  1,  solutions  to  (5)  can  exhibit  shocks  for  smooth  initial  data. 

For  advection-dominated  flow  problems  such  as  (5),  we  have  studied  the 
application  of  higher-order  Godunov-mixed  methods.  This  class  of  methods 
was  formulated  and  analyzed  for  nonlinear  advection-diffusion  equations  in 
[8).  A  multidimensional  extension  of  the  method  is  described  in  (9).  We  now 
describe  the  application  of  this  algorithm  to  (5). 

Assume  we  truncate  our  computational  domain  to  a  region  (0,x).  At 
the  point  x  we  will  assume  the  “outflow”  boundary  condition 

p,  +  uij(p)I  =  0,  at  x  =  x.  (6) 

Let  0  —  x,/2  <.  X3/2  <-  ...  <-  Xj+i/z  —  x  be  a  partition  of  [0,x]  into  grid 
blocks  Bj  —  [x;-i/2,  *y+i/zl>  and  let  z,  be  the  midpoint  of  B, ,  h,  —  xJ+1y2- 
Xj-i/z,  and  hJ+1/2  -  (A;  +  AJ+i)/2.  Let  At  >  0  denote  a  time-stepping 
parameter,  and  let  tn  —  nAt.  For  functions  y(x,t),  let  g "  —  g(xt,t"). 

On  each  grid  block  Bj ,  we  approximate  p”  by  a  piecewise  linear  function 
pn,  where 


Pn|  B,  =  l‘j  +  (*  - 

c"  is  approximated  by  a  piecewise  constant  function  C",  where 


(7) 


Cn\B,  =  Cf.  (8) 

In  (7), 

tf=C?  +  R(C?y.  (9) 

Let  7 (x,<)  denote  the  diffusive  flux,  7(1,  f)  =  -Dq(p)r  =  -Dcr.  Ap¬ 
plying  the  mixed  finite  element  method  to  the  diffusion  terms  in  (5)  with 
the  lowest  order  Raviart-Thomas  approximating  spaces,  and  using  the  ap¬ 
propriate  quadrature  rule,  7  is  approximated  by  (see  (8]), 

7(*y+./z,t")*  =  («» 

for  j  =  1,2, . J  —  1.  At  the  inflow  boundary, 

r>n  _n 

7?/2  =  -2D^_f°.  (11) 

We  discuss  the  handling  of  the  outflow  boundary  condition  (6)  below. 
Discretizing  (5)  we  obtain  the  difference  equation 


At 


-  +  u- 


A; 


h 


=  0, 


(12) 


which  holds  for  j  =  1 . J— 1.  In  block  Bj,  we  first  compute  the  predictor 

W  by 


(f‘P)j+1  -  p"  .  -  ~  -1/2) 

At  +U  hj 


=  0. 


(13) 


We  define  Cn+1(x)  =  q((pp)J+1),  and  the  diffusive  flux  at  x  is  approximated 
by 


74!/,  = -2D 


cn+1(x)-c;+1 
hj 


(14) 


Finally,  we  update  /Vj+1  by  an  equation  of  the  form  (12),  with  j  =  J. 
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The  term  is  an  approximation  to  <n+1/2))  We  ap¬ 

proximate  this  term  by  characteristic  tracing  from  the  point  (xj+1/2 .f"+' ,J) 
back  to  time  t",  i.e.,  we  define  the  characteristic  i(()  satisfying 

x\t)  =  un'(fij),  i(tn+I/J)  =  xy+1/j.  (15) 

Assuming  the  GFL  constraint 

Ay  =  fV(/iy)  <  1,  (16) 

then  x(i)  crosses  the  t  =  t"  axis  at  a  point  x}ti  €  B, ,  where 

xhL  =  xi+ip-fu,/(tf).  (17) 

The  term  >«  given  by 

(18) 

Thus,  the  advcctive  part  of  (12)  is  handled  fully  explicitly.  Substituting 
(9),  (18),  (10),  (11),  and  (14)  into  (12),  we  obtain  a  nonlinear  system  of 

equations  in  C?+l,j=-l . J.  Once  Cj*+1  is  determined, /iy+I  is  updated 

by  (9)7 ' 

The  last  step  in  the  calculation  at  time  i,l+1  is  the  computing  of  the 
slopes,  d/iy+I,  j  =  1,...,  J.  The  slope  in  the  last  interval,  Sflj*1  is  set  to 
zero.  In  the  remaining  intervals  wc  set 

«5/-.y+!  =  W<?+1  ■  ~  09) 

where 

,  _n+1_  f  min([A+py+'|,|A.fiy+1|),  if  A+/iy+1 .  A-fi]*1  >  0,  (20) 

Hml  i  ~  \  0,  otherwise  .  v 

Here  A+/iy  is  the  forward  difference  (ftj+i  -  l‘j)/hj+i/ti  and  A./iy  is  the 
corresponding  backward  difference.  The  point  of  the  procedure  (19)-(20)  is 
to  compute  a  piecewise  linear  approximation  which  doesn't  without  intro¬ 
ducing  new  extrema  into  the  approximate  solution.  Thus,  in  blocks  where 
the  solution  already  has  a  local  extrema,  the  slope  bq ij  is  set  to  zero. 

IV.  NUMERICAL  RESULTS 

In  this  section,  wc  study  the  effect  on  the  solution  of  varying  the  exponent 
p.  We  choose  c0  =  1,  <j>  =  .5,  ft  =  1.5,  u  =  2.5  cm/h,  and  D  =  .15  cm2/h. 
The  computational  domain  is  0  <  x  <  100  cm.  The  initial  condition  for  all 
cases  is  plotted  in  Figure  1. 

We  first  consider  the  case  p  =  .8.  To  test  the  convergence  of  the  scheme, 
we  compare  the  approximate  solutions  at  time  t  =  25  hours,  generated  using 
50  and  100  grid  blocks.  As  seen  in  Figure  1,  these  solutions  arc  very  dose 
In  Figure  2,  wc  compare  solutions  for  p  =  .5,  .8,  and  1  at  i  =  25  hours. 
This. figure  shows  that  increasing  p  results  in  sharper  fronts  and  substantial 
retardation  of  the  solution,  as  expected. 

In  conclusion,  the  Godunov-mixed  method  approach  described  here  gives 
solutions  which  agree  with  physical  intuition.  I11  future  work,  wc  will  extend 
the  method  to  model  more  physically  interesting  situations  in  multiple  space 
dimensions. 
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Figure  1 :  Test  of  convergence  for  p  =  .8. 
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Figure  2:  Comparison  of  />  =  .5,  .8,  and  1. 
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Abstract-In  order  to  scale  the  highly  localized  behavior  of  viscous  fin¬ 
gering  generated  by  heterogeneous  media  up  to  computational  and 
field  scales,  we  must  develop  techniques  to  obtain  effective  parameters 
for  coarse-grid  models  which  match  fine- grid  simulations.  In  [1],  Rus¬ 
sell,  Young,  and  the  author  presented  a  coarse-grid  dispersion  model 
of  heterogeneity  and  viscous  fingering  to  match  fine-grid  simulation 
of  miscible  displacement  processes.  They  adjusted  longitudinal  and 
transverse  dispersivities  in  a  dispersion  tensor  to  match  recovery  curves 
for  simulations  of  viscous  fingering  on  fine  grids.  Although  they  were 
able  to  match  production  from  various  simulations,  they  pointed  out 
that  permeability  averages,  variances,  and  standard  deviations  alone 
are  not  able  to  determine  dispersivities,  since  the  specific  permeabil¬ 
ity  distribution  in  each  realization  can  have  significant  impact  upon 
'the -flow  and  hence  the  recovery.  In  [2],  Espcdal  at  al.  consider  sim¬ 
ilar  dispersion  models  for  immiscible,  two-phase  flow.  In  this  paper 
we  combine  these-ideas  for  multiphase  and  multicomponent  flow,  us¬ 
ing  dispersion  models  coupled  with  accurate  treatment  of  first-order 
transport  effects  for  both  models.  This  coupling  will  be  very  important 
for  fully  compositional  models,  which  possess  aspects  of  each  process. 
The  dispersion  models  are  presented  for  both  multicomponent  and 
multiphase  cases.  Then  accurate  high-resolution  numerical  simulators 
are  introduced  and  used  as  our  experimental  tool.  Numerical  results 
illustrate  the  success  of  dispersion  models  for  all  these  problems. 

I.  INTRODUCTION 

The  understanding  and  prediction  of  the  behavior  of  the  flow  of 
multiphase  or  multicomponent  fluids  through  porous  media  are  often 
strongly  influenced. by  heterogeneities  or  quite  localized  phenomena. 
Although  considerable  information  can  be  gained  about  the  physics  of 
multiphase  flow  of  chemically  reacting  fluids  through  porous  media  via 
laboratory  experiments  and  pore-scale  models,  the  length  scale  of  these 
data  is  quite  different  from  that  required  for  field-scale  understanding. 
The  coupled  fluid/iluid  interactions  are  highly  nonlinear  and  quite 
complex.  The  presence  of  heterogeneities  in  the  medium  greatly  com¬ 
plicates  this  flow.  We  must  understand  the  effects  of  heterogeneities 
coupled  with  nonlinear  parameters  and  functions  on  different  length 
scales.  We  use  the  simulators  as  “experimental  tools”  in  the  laboratory 
of  supercomputer  environments  to  simulate  the  process  on  increasingly 
larger  length  scales  to  develop  intuition  on  how  to  model  the  effects  of 
heterogeneities  and  viscous  fingering  at  various  levels. 

II.  DISPERSION  MODELS 

In  order  to  ensure  that  the  information  passed  from  scale  to  scale 
is  dependent  upon  the  physical  properties  of  the  flow  and  not  upon 
the  numerics  of  the  specific  simulator,  we  have  extensively  studied  the 
codes  used  and  have  shown  them  tc  be  essentially  free  of  numerical 
dispersion  and  grid  orientation  effects.  The  codes  utilize  mixed  fi¬ 
nite  clement  methods  for  accurate  fluid  velocities  in  the  presence  of 
heterogeneities  and  modified  method  of  characteristics  techniques  for 
accurate  fluid  transport  without  numerical  dispersion. 

The  miscible  displacement  of  one  fluid  by  another  in  a  porous 
medium  ST  is  given  by 


+  V -uc  -  V  ■  DVc  =  gc,  sell, 

whole  c,  a  fraction  between  0  and  l,is  the  concentration  of  the  invading 
fluid,  <p  is  the  porosity  of  the  medium,  u  is  the 'fluid  velocity,,!;  is  the 
flow  rate  at  the  wells,  c  is  the  resident  concentration  at  the  well  and 
D  is  the  dispersion  tensor  g  ven  by 

D  =  <f>  (dmJ  +  dr|t!E  +  d(|ti|EJ')  ; 

here  rfm,  d(,  and  dt  a;e  the  molecular,  longitudinal,  and  transverse 
dispersivities,  respectively,  e,j  =  u,u./|u|2,  and  E1  =  I  -  E.  Both 
miscible  and  immiscible  codes  used  in  our  simulations  utilize  a  physi¬ 
cal  dispersion  tensor  with  different  lor  gitudinal  and  transverse  terms. 
Usually  d(  is  approximately  ten  times  6|.  Although  this  is  clearly  natu¬ 
ral  for  miscible  displacement,  the  local  physics  of  multi-phase  flow  does 
not  normally  involve  a  dispersion  phenomena.  However,  via  perturba¬ 
tion  analysis,  Espedal  has  developed  a  natural  dispersion  tensor  arising 
from  heterogeneous  flow  at  larger  length  scales.  Furtado  cl  al.  [3]  have 
stochastically  arrived  at  a  dispersion  phenomenon  with  effects  some¬ 
where  between  transport  and  diffusion  in  origin.  This  corresponds  to 
the  need  to  match  the  gross  permeability  effects  with  first-order  trans¬ 
port  concepts  and  the  finer-scale  fingering  with  dispersion  models. 

III.  NUMERICAL  EXPERIMENTS 

In  the  numerical  experiments,  we  systematically  vary  mobility  ra¬ 
tio,  longitudinal  and  transverse  dispersivity,  and  heterogeneity  on  fine 
gilds.  We  use  lognormal  permeability  distributions,  considering  the 
effect  of  variance.  We  also  simulate  several  different  randomly  gener 
ated  permeabilities  with  the  same  statistical  properties.to  see  whether 
the  gross  fingering  behavior  and  recovery  are  similar.  Then  we  seek 
relationships  between  the  fine  grid  parameters  and  those  in  the  coarse 
grid  models  to  use  effective  parameters  which  match  ’’averaged”  prop 
ertics  of  many  fine  grid  simulations.  The  computations  for  both  the 
multicomponent  and  multiphase  models  on  fine  grids  have  been  match 
ed  effectively  via  dispersion  models. 
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Abstract-  The  hypersonic  flow  around  space  capsule-like 
bodies  under  the  conditions  of  reentry  into  the  earth's 
atmosphere  is  simulated.  As  an  appropriate  numerical 
algorithm  the  Taylor-Galerkin  finite-element  method  has 
been  selected.  Results  are  presented  for  flows  in 
thermodynamical  and  chemical  equilibrium. 

I.  INTRODUCTION 

The  engineering  need  to  simulate  reentry 
aerothermodynamics  requires  the  development  of  new 
numerical  algorithms  and  their  application  to 
realistical  configurations.  The  physical  problem 
involves  strong  shocks,  high  temperatures,  boundary 
layers,  entropy  layers  and  the  interaction  of  these 
phenomena.  Therefore  a  numerical  method  to  simulate  such 
flows  must  posess  flexible  spatial  approximation 
properties,  such  as  provided  by  unstructured  locally 
refined  computational  grids.  Furthermore  it  is  desirable 
to  couple  the  flow  computation  with  computations  of  the 
heat  flow  within  the  heat-shield  consisting  of  non¬ 
ablative  ceramic  material.  We  have  chosen  the  Taylor- 
Galerkin  finite-element  method  [1,2]  as  the  basis  for 
the  development  of  a  three-dimensional 
aerothermodynamical  simulation  code.  In  the  present 
paper  some  computational  aspects  are  outlined  and  new 
three-dimensional  simulations  under  reentry  conditions 
are  presented. 

II.  GRID  GENERATION 

An  axi symmetric  three  dimensional  grid  around  bodies  of 
revolution  is  generated  using  the  cyl indrical  coordinate 
system  x,r,</>.  First  a  relatively  coarse  two-dimensional 
unstructured  grid  consisting  of  triangles  in  the  x-r- 
plane  is  computed  using  transfinite  interpolation  to 
generate  the  nodes  and  Delaunay  triangulation  [3]  to 
generate  the  triangles.  The  grid  is  then  locally  refir.ed 
in  regions  of  shocks  and  boundary  layers  by  subdivision 
of  selected  triangles  with  'hanging  nodes'  avoJed.  This 


grid  is  then  rotated  around  the  axis  r  =  0  by  small 
angles  tpn  forming  an  array  of  n  sectors  between 
successive  planes  0  <  ip  <  2ir.  Corresponding  triangles  of 
these  planes  form  skewed  prisms,  each  of  which  is 
subdivided  into  three  tetrahedrons  in  space.  By  this 
technique  large  three-dimensional  grids  consisting  of 
tetrahedrons  can  be  generated,  the  tetrahedrons  of  each 
plane  being  geometrically  similar.  The  grid  is 
'semistructered' ,  i.e.  unstructured  in  x,r  and- 
structured  in  <p. 

III.  SIMULATION  ALGORITHM 

As  the  algorithm  to  simulate  aerothermodynamics  of 
reentry  including  strong  shocks,  boundary  layers, 
entropy  layers,  and  thermodynamical  and  chemical 
relaxation  the  explicit  two-step  Taylor-Galerkin  method 
[1,2]  is  applied.  This  algorithm  is  formulated  in  a 
cartesian  coordinate  system  x,y,z  using  transformed 
node-coordinates.  Elementwise  constant  and  linear  shape 
functions  are  used.  Beginning  with  a  parallel  flow  the 
Navier-Stokes  and  coupled  chemistry  equations  are 
integrated  in  time.  Integrals  of  the  shape  functions  and 
their  derivatives  are  split  into  two  parts,  the  first 
only  depending  on  x  and  r  and  the  second  on  ip.  In  an 
efficient  implementation  of  explicit  finite-element 
methods  integrals  must  be  precomputed  and  stored  for  all 
permutations  of  element  numbers,  local  node  numbers  and 
coordinate  directions.  In  our  method  we  reduce  the 
computer  space  greatly  by  only  precomputing  the  first 
part  for  each  tetrahedron  of  one  sector  and  the  second 
for  each  sector.  Using  the  axisymmetric  grid 
nonaxisymmetric  flow  can  be  computed,  e.g.  with  a  small 
angle  of  attack. 

In  order  to  improve  shock-capturing  properties  the 
algorithm  of  flux-corrected  transport  [4,5]  has  been 
implemented.  A  model  of  chemically  reacting  air  [6]  at 
high  temperatures  was  so  far  applied  to  thermal  and 
chemical  equilibrium  and  is  currently  being  implemented 
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for  nonequilibrium  flow.  In  the  equilibrium  case  the 
system  of  chemical  reactions  as  well  as  the  vibrational 
excitation  of  the  molecules  can  be  decoupled  and  solved 
a  priory.  This  precomputed  solution  is  used  during  the 
simulation  as  a  Chebychev  approximation. 


IV.  RESULTS 

The  algorithm  is  tested  using  the  two-dimensional 
example  of  a  circular  cylinder  at  an  inflow  Mach  number 
of  20  for  frictionless  flow.  The  computational  grid  and 
a  perfect  gas  solution  is  shown  in  fig.  1.  A  three- 
dimensional  Euler  simulation  of  a  sphere  (220  000 
elements,  40  sectors)  is  shown  in  figured. 


V.  CONCLUSIONS 

Finite-element  simulations  of  three-dimensional  flow 
around  capsuled  ike  configurations  can  be  conducted  on 
axisymmetric  semi  structured  grids.  First  results  for 
thermochemical  nonequilibrium  and  viscous  flow  will  soon 
be  available.  However,  physical  and  numerical  models 
must  be  validated  by  comparision  v/ith  experimental 
measurements  during  actual  reentries. 
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Fig.  1.  Two-dimensional  simulation  at  an  inflow  Mach 
number  of  20,;  a)  computational  grid, 
b)  isolines  of  the  density 


Fig.  2:  Three-dimensional  Euler  simulation  of  a  sphere 
in  a  Mach  6  flow,  a)  C’uss  section  of  the 
compuational  grid  in  the  x-r-plane, 
b)  isolines  of  the  density 
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Abstract  -  We  continue  our  investigation  of  the 
three-dimensional  evolution  of  nominally  axisymmetnc 
transitional  jets  subject  to  axisymmetnc,  helical  or  azimuthal 
perturbations  and  combinations  thereof.  Our  approach  is  a 
computational  one,  employing  inviscid  vortex  filament 
techniques  to  gain  insight  into  the  mechanisms  leading  to  the 
concentration,  reorientation,  and  stretching  of  vorticity.  Our 
earlier  studies  had  demonstrated  the  emergence  of  vortex 
rings  connected  by  couterrotaung  pairs  of  streamwise  braid 
vortices  for  the  case  of  superimposed  axisymmetnc  and 
azimuthal  perturbations.  Furthermore,  for  the  case  of  a  helical 
perturbation  combined  with  an  azimuthal  one,  we  observed 
the  emergence  of  concentrated  streamwise  braid  vortices  all 
of  the  same  sign.  In  the  present  investigation,  we  study  the 
interaction  of  two  helical  perturbations  of  opposite  sign. 
While  they  cancel  each  other  at  some  azimuthal  locations,  they 
become  amplified  at  others,  thus  leading  to  a  complex 
three-dimensional  flow  pattern  exhibiting  regions  of  strong 
azimuthal  vortices  connected  by  concentrated  streamwise 
vorticity.  In  addition,  the  interaction  between  the 
opposite-sign  helices  results  in  strong  azimuthal  velociues. 

1.  Introduction 

The  present  investigation  represents  a  continuation  of  our 
earlier  studies  of  the  evolution  of  transitional  jets  under 
three-dimensional  perturbations  (Meiburg,  Lasheras  and 
Martin  1989,  Meiburg  and  Martin  1990,  Martin  and  Meiburg 
1991).  The  types  of  perturbations  we  have  been  considering 
are  of  wave-like  character  in  the  streamwise,  helical  and 
azimuthal  directions,  as  past  stability  analyses  had 
demonstrated  their  relevance  v.  ith  respect  to  axisymmetnc 
jets  and  vortex  rings  (Batchelor  and  Gill  1962,  Widnall,  Bliss 
and  Tsai  1974,  and  Cohen  and  Wygnanski  1987,  to  mention  just 
a  few).  Recent  experimental  investigations  by  Tso  and  Hussain 
(1989)  as  well  as  Mungal  and  Hollingsworth  (1989)  show 
convincingly  that  even  fully  turbulent  jets  are  dominated  by 
ringlike  and  helical  structures  whose  dynamics  become  largely 
independent  of  the  Reynolds  number  when  this 
dimensionless  parameter  is  large.  Furthermore,  Corkc  and 
Kusck  (1990)  experimentally  demonstrate  the  possibility  of 
resonance  in  axisymmetnc  jets  with  helical  mode  pairs. 
Edwards,  Marx  and  Ashurst  (1991)  observe  large-scale 
structures  of  a  helical  nature  in  swirling  jets  as  well 
Consequently,  our  series  of  studies  aims  at  achieving  a  more 
complete  understanding  of  the  nonlinear  growth  and 
dynamics  of  these  structures,  with  the  ultimate  goal  of 
successful  manipulation  and  control  of  jets.  Our  numerical 
investigation  of  axially  forced  jets  emerging  from  a  corrugated 
nozzle  (Martin  and  Meiburg  1990)  showed  the  formation  of 
vortex  rings  that  set  up  a  strain  field  with  a  free  stagnation 
point  in  the  braid  region.  Small  perturbations  in  the  braid 
vorticity  due  to  the  corrugation  are  subsequently  amplified, 
whereupon  pairs  of  concentrated  streamwise  counterrotating 
vortices  form  in  between  the  vortex  rings.  This  scenario  is  in 
accordance  with  the  mechanism  suggested  by  Lin  and  Corcos 
(1984)  as  well  as  by  Neu  (1981)  for  the  plane  mixing  layer.  If, 
on  the  other  hand,  the  axisymmetnc  jet  is  perturbed  by  a 
helical  wave,  a  layer  of  streamwise  braid  vorticity  forms  that 
has  the  same  sign  everywhere  (Meiburg  and  Martin  1990).  If 
the  helical  symmetry  is  broken  by  introducing  a  periodic 
perturbation  in  the  azimuthal  direction,  streamwise  braid 
vortices  emerge  that  become  amplified  in  the  strain  field  of 
the  helix.  Ir  the  present  paper,  we  will  study  the  inviscid 
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evolution  and  interaction  of  a  helical  mode  pair  of  azimuthal 
wavenumbers  +/-1.  The  numerical  technique  will  briefly  be 
described  in  section  2.  In  section  3,  we  will  discuss  the 
emerging  flow  field  with  particular  emphasis  on  the  large-scale 
vortical  structure. 

2.  Numerical  Technique 

The  non-divergent  nature  of  the  velocity  field  in 
Incompressible  flows,  along  with  the  definition  of  vorticity, 
allows  for  a  complete  description  of  the  kinematics  of  the 
flow  in  the  form  of  the  Biot-Savart  law.  Using  the  theorems  of 
Kelvin  and  Helmholu  for  inviscid  dynamics  and  following  the 
general  concepts  reviewed  by  Leonard  (1985),  vortex 
filaments  are  used  for  the  representation  of  the  vorticity  field. 
Each  filament  is  represented  by  a  number  of  node  points 
along  its  centerline,  through  which  a  cubic  spline  is  fitted  to 
give  it  a  smooth  shape.  The  three-dimensional  Biot-Savart 
integral  is  reduced  to  a  line  integral  by  assuming. an  invariant 
algebraic  voi ficity  distribution  around  the  filament  centerline. 
For  the  numerical  simulation,  we  limit  ourselves  to  the 
temporally  growing  problem,  i.e.,  our  fluw  is  periodic  in  the 
streamwise  direction.  We  take  the  velocity  difference 
between  the  centerline  and  infinity  as  our  characteristic 
velocity.  The  thickness  of  the  axisymmetnc  shear  layer, 
defined  as  the  velocity  jump  divided  by  the  maximum  slope 
of  the  velocity,  serves  as  the  characteristic  length  scale,  which 
results  in  the  filament  core  radius  of  0.5.  In  these  units,  the 
radius  of  the  jet  considered  here  is  5-  Hence,  the  important 
ratio  of  jet  radius  to  momentum  thickness  of  the  jet  shear 
layer  is  22.6.  The  Biot-Savart  integration  is  carried  out  with 
second  order  accuracy  both  in  space  and  in  time  by 
employing  the  predictor-corrector  time-stepping  scheme 
and  the  trapezoidal  rule  fur  spatial  integration,  respectively.  A 
more  detailed  discussion  of  the  numerical  method  can  be 
found  in  Ashurst  and  Meiburg  (1988). 

3.  Results  and  Discussion 

The  subject  of  our  investigation  is  a  nominally  axisymmetric 
jet  perturbed  by  two  helical  waves  of  azimuthal  wavenumbers 
+  1  and  -1,  respectively.  The  axisymmetnc  shear  layer  is 
represented  by  vortex  filaments  that  initially  have-the  form  of 
vortex  rings.  Consequently,  there  is  no  overall  swirl  in  the  jet. 
Numerically,  each  of  the  two  helical  perturbation  waves  is 
introduced  by  slightly  displacing  the  vortex  filament 
centerlines  in  the  streamwise  direction.  Figure  1  show’s  the 
flow  field  at  time  t-1.72.  The  two  side  views  and  the 
streamwise  view  clearly  demonstrate  that  the  two 
perturbation  waves  cancel  each  other  near  y-0,  whereas  they 
amplify  each  other  around  z-G,  thereby  forming  regions  in 
which  the  vorticity  becomes  slightly  more  concentrated. 
Thus,  a  Kclvin-1  Ielmholtz-ty  pc  instability  of  the  axi  .ymmetric 
shear  layer  is  triggered  near  z-U,  which  leads  to  a  roll  up  of  the 
vorticity  layer  and  to  the  formation  of  segments  of 
concentrated  vortex  rings  on  opposite  sides  of  the  jet. 
However,  these  segments  are  out  of  phase  with  each  other,  so 
that  a  contour  plot  of  the  azimuthal  vorticity  component  in 
the  plane  z-0  would  show  a  staggered  pattern,  lesembling  a 
Karman  vortex  street.  This  phase  shift  between  the  emerging 
vortex  ring  segments  on  opposite  sides  of  the  jet  lead,  to  the 
interesting  situation  in  which  some  regions  of  a  vortex 
filament  arc  convectcd  towards  the  jet  axis,  whereas  others  are 
displaced  away  from  the  axis.  In  this  fashion,  the  vortex 
filament,  in  between  the  emerging  vortex  ring  sections, 
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Fig.  1:  Side  views  from 
the  z-  and  y-directions, 
respectively,  as  well  as 
streamwise  view  at  time 
t-1.70.  Shown  are  the 
vortex  filaments  over  two 
streamwise  wavelenghts. 
Observe  the  cancellation 
of  the  perturbations  near 
y«0. 


Fig.  2:  z-  and  y-views:  at  time  t-5.70.  Note  the  formation  of 
out-of-phase  vortex  ring  segments. 


develops  a  streamwise  vorucity  component  which  becomes 
larger  as  the  amplitude  of  the  Kelvin-IIelmholtz  instability 
grows.  This  tendency  has  become  much  more  pronounced 
by  time  t-5.70  (figure  2).  We  observe  the  formation  of 
concentrated  streamwise  vortical  structures  connecting  the 
out-of-phase  vortex  ring  segments.  This  situation  appears 
similar  to  the  one  in  mixing  layers  with  a  defect  caused  by  a 
phase  jump  at  a  given  spanwise  location.  By  time  t-8.05  (figure 
3),  these  concentrated  streamwise  structures  have  grown  in 
strength,  as  they  encompass  an  increasing-  number  of  vortex 
filaments.  We  furthermore  see  that  they  spiral  around  each 
other  where  they  come  together  to  form  a  vortex  ring 
segment.  This  behavior  is  also  clearly  visible  in  the  streamwise 
view,  and  it  becomes  considerably  more  prominent  by  time 
t— 11.95  (figure  '1).  It  creates  a  strong  axial  velocity  component 
along  the  vortex  ring  segments.  This  situation  locally 
resembles  observations  of  helical  vortex  break J.own. 
Interesting  questions  concern  the  dependence  of  the  flow 
pattern  on  the  ratio  of  jet  radius  to  jet  shear  layer  thickness, 
and  its  stability  under  additional  axisymmetric  or  azimuthal 
perturbations.  A  more  detailed  investigation  along  these  lines 
is  currently  under  way. 
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Fig.  3:  x-,  y-,  and  z-views 
at  time  t-8.05.  Concen¬ 
trated  structures  form 
that  connect  the  vortex 
ring  segments. 


Fig.  1-  x-,  y-,  and  z-views 
at  time  t— 11.95.  Where 
they  join,  the  large-scale 
structures  spiral  around 
each  other,  thus  creating 
a  velocity  component 
along  the  axis  of  the  ring 
section. 
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General  considerations  on  hypersonic  reactive  flow 
and  the  challenge  of  computation 

The  hypersonic  flight  of  a  space  vehicle  when  it  reenters  the 
atmosphere  (high  Mach  number,  up  to  30,  high  angle  of  attack, 
up  to  30°)  corresponds  to  a  critical  phase  from  the  viewpoint  of 
aerodynamical  control  and  thermal  loads  control,  and  gives  rise 
to  the  development  of  advanced  numerical  specialized  simulation 
tools. 

At  high  altitude,- the  low-density  atmosphere  (Pss — 3.  52  Pa, 
pc 0=4.28  10-5  kg/m3  at  the  altitude  of  75  km)  undergoes  a 
strong  compression  across  the  mam  detached  shock  of  the  exter¬ 
nal  flow.  ImmcdiatrK  behind  this  shock,  assuming  a  freestream 
Mach  number  of  the  order  of  30,  the  temperature  reaches  sev¬ 
eral  tens  of  thousanc'3-degre<s  (K/and  air  dissociates  and  is  in 
strong  chemical  but  also  vibrational  non-equilibrium.  Along  a 
particle  path,  the  various  non-equilibrium  modes  relax  to  equi¬ 
librium  at  different  time  scales:  vibrational  equilibrium  is  first 
reached,  then  chemical  equilibrium.  The  dissociation  reactions 
being  endothermic,  they  absorb  an  important  fraction  of  the 
energy;  in  this  process,  the  temperature  decreases  rapidly.  To 
realize  the  quantitative  importance  of  this  effect,  it  isinstruc- 
tive  to  consider  the  case  of  a  steady  inviscid  (external)  flow  for 
which,  when  chemistry  is  negligible  (i.c.  at  lower  Mach  numbers, 
Moo  <  10),  the  temperature  at  the  stagnation  point  Ts  can  be 
related  to  the  freestream  temperature  Too  by  the  relation 

Ts/Tco  =  1  +  ^p  Ml 

which  expresses  the  conservation  of  total  enthalpy  per  unit  mass 
along  a  sticamline.  Trying  now  this  foiinula  with  -  25, 
7  =  CP/CV  —  7/5  (diatomic  gas)  and  Too  —  203  Iv  (standard 
atmosphere  at  an  altitude  of  i3  km)  yields  To—  23  830  K!  In 
reality,  in  this  inviscid  cast,  air  is  completely  dissociated  in  the 
stagnation-point  region,  and  the  temperature  is  (only)  near  6000 
K,  that  is,  4  times  smaller. 

Another  important  effect  of  chemist. y  on  a  typical  blunt 
body  flow  is  that  it  modifles  noticeably  the  shock  location;  the 
stand-off  distance  may  be  reduced  in  some  cases  of  40  %  or 
more;  more  generally  speaking,  the  entire  shock  layer  is  thinner. 
This  effect  is  also  of  gic.it  concern  to  the  designer,  since  the 
intersection  of  main  shock  with  parts  of  the  structure  should  be 
avoided  (overheating,  destruction). 

For  all  of  these  reasons,  and  since  laboratory  experimen¬ 
tation  of  this  exticmc  legiine  is  veiv  difficult  (and  costly)  and 
often  impossible  today  for  veitnin  iimfigur.itlon-..  it  is  impoit.  nt 
to  develop  efficient  and  validated  nunit  in .»!  tools  fm  tin  pi  edit 


tion  of  hypersonic  reactive  flow. 

From  a  numerical  point  of  view,  the  challenge  of  this  task 
resides  in  the  necessity  of  accounting  for  more  complex,physical 
models  (more-or-less  complete  chemistry  models,  some  of  which 
being  currently  developed  on  the  basis  of  more  recent  data;  in¬ 
clusion  of  wall  effects,  etc.)  and  accounting  for  more  complex 
aerodynamics:  e.g.  the  presence  of  stronger  shocks  in  particu¬ 
lar,  makes  the  question  of  robustness  more  critical  and  partly 
for  this  reason,  many  authors  employ  upwind  schemes  for  which 
the  artificial  viscosity  is  inherent  to  the. approximation.  Then, 
the  extension  of  known  schemes  to  the  reactive-flow  case  is-usu 
ally  not  immediate,  since  -the  diagonalization  of  the  convective 
terms  (Euler  terms)  in  the  governing  equations  depends  on  the 
form  of  the  state  equation-and  is  different  when  the  fluid  is  made 
of  several  species.  Several  extensions  of  the  van  Leer  flux- vector 
splitting  and  of  the  Roe  and  Osher  flux  difference  splittings  in 
particular  can  now  be  found  in  the  literature. 

From  the  designer  point  of  view,  the  flows  of  greatest  inter¬ 
est  are  those  in  the  “near-equilibrium  regime”.  For  reasons  that 
will  be  discussed  in  the  lecture,  the  numerical  discretization  of 
classical  type  of  the  equations  governing  non-equilibrium  flow  is 
very  stiff  in  this  case,  and  overcoming  this  difficulty  may  reveal 
the  greatest  challenge  to  the  computational  scientist. 

F inally,  since  shock  layers  in  the  hypersonic  regime  are  thin¬ 
ner  than  in  the  better-known  supersonic  regime  due  to  both  ef¬ 
fects  of  larger  Mach  number  and  chemical  dissociation,  and  since 
the  physical  phenomena  are  more  complex  (dissociation,  vibra¬ 
tion,  ctcpand  more  intensive  ^stiongci  shocks),  it  is  evident  that 
the  control  of  the  quality  of  the  discicte  approximation  is  more 
critical  and  is  also  more  strongly  dependent  on  the-quality  of 
the  employed  mesh.  Hence,  issues  such  as  mesh  generation,  and 
mole  generally,  meshsize  control  become  mole  essential. 

Brief  description  of  the  lecture 

The  lcctuie  will  emphasize  some  of  the  most  important  as¬ 
pects  of  the  numerical  computation  of  hypersonic  external  flow 
by  upwind  schemes  applicable  to  arbitiaiy  unstructured  meshes. 

After  the  presentation  A  some  gcncial  considerations  on 
hypersonic  reactive  flow,  basic  cqnihbt..uu  and  non  equilibrium 
models  will  be  described.  The  essential  effect  of  the  Damkolcr 
number  on  a  typical  blunt-body  non-equilibrium  flow  will  be 
briefly  discussed. 

Hybrid  Finite  Volume /Finitv -Eh  ment  upwind  schemes  will 
be  discllbidfoi  both  Hindi  Is,  Weakly -« oltpled  (  equivalent  ") 
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ap.  roach”)  and  strongly-coupled  formulations  will  be  compared. 
Mkny  bluiit-bo<  j  flow- computations-  will  be  shown  to  evaluate 
or  ve.ify  numerically  the  elFect  of  various  parameters,  such  as 
the'freesiream  Mach  number,  or  the  size  of  the  obstacle. 

-Implicit 'tiinestepping  will,  be  presented,  and  its  efficiency 
demonstrated.  The  construction  of  quasi-second-order  schemes 
incorporating  monotonicity  devices  will  be  introduced  with  some 
emphasis  on-the  appropriate  choice  of  the  set  of  physical  vari¬ 
ables  on  which  limitation  should  be  applied.  In  particular,  the 
drastic  effect  on  the  wall  chemical  composition  of  the  order  of 
accuracy  of  the  approximation  scheme  will  be  shown. 

The  difficulty  to  correctly  simulate  the  stagnation-point  re¬ 
gion  in  a  non-equilibrium  flow  will  be  discussed  and  illustrated. 

Many  examples  of  computations  will  deal  with  inviscid  flow. 
However,  a  preliminary  assessment  of  the  effect  of  the  transport 
model  on  a  Navier-Stokes  reactive  flow  computation  will  be  in¬ 
cluded. 

Finally,  some  considerations  on  mesh,  generation  will  be 
made.  An  example  will  be  given  in  which  several  meshes  have 
beenconstr  tided  in  the  course  of  the  solution  convergence.  Ini¬ 
tially,  one  constructs  a  smooth  (structured)  mesh  employing  a 
“hyperbolic  grid  generator”  in  which  the  distribution  of  cell  ar¬ 
eas  is  controlled  to  target  a  prescribed  external-domain  bound¬ 
ary.  Then,  one  or  more  mesh  enrichments  are  made  by  element 
division  to  adapt  the  (now  unstructured)  mesh  to  the  solution. 
The  same  solver  (adapted  to  unstructured  data  base)  is  em¬ 
ployed  throughout. 
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Illustrativ  e  Example: 

Inviscid  Flow  ova  a  Double  ellipse  (hum  [4]) 
(M0O=25,  a  =  30°,  larger  semi-axis  =  GO  cm.) 
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I.  INTRODUCTION 

In  mathematical  physics  problems  an  error 
of  the  finite-difference  method  llzll  =  llu-yll 
(u  is  the  solution  of  an  original  differential 

problem,  y  is  the  solution  of  a 
finite-difference  problem  )  is  determined  by 
the  number  of  grid  points  N  so  that  as  N  ->  m 
the  equality 

11 2  “  =  e  (it)  " 

takes  place  asymptotically.  The  value  of  C  on 
real  "crude"  grids  may  be  decreased  by 
redistributing  the  grid  points.  Without  a 
priori  information  on  the  solution  structure 
the  optimal  grid  can  not  be  constructed.  In  a 
general-  case  such  information  can  be  obtained 
when  solving  the  problem  numerically,  and  then 
the  grid  can  be  property  corrected.  It  is 
natural  to  call  such  a  technique  the  method  of 
grids  adaptive  to  the  solution.  In  this  paper 
this  technique  is  based  on  minimizing  the 
truncation  error  [1],  In  the  method  the 
requirement  of  truncation  error  minimization 
leads  to  the  equations  for  the  grid  points 
coordinates.  Stationary  diffusion-convection 
problems  including  those  with  a  small 
parameter  at  leading  derivative  are 
considered.  In  such  problems  the  solution  has 
high  gradients  in  the  region  of  boundary 
layers.  Using  the  difference  schemes  of  the 
second  truncation  order  in  the  convective 
terms  is  not  expedient  here  due  to 

ocsillations  of  the  difference  solutions.  The 
first  order  upwind  schemes  yield  rather  low 
accuracy.  In  the  paper  this  contradiction  is 
proposed  to  solve  by  increasing  the  upwind 
scheme  accuracy  on  adaptive  to  solution  grid. 
One  [2]  and  two  [3]  dimensional  boundary  value 
problems  are  considered. 

II.  1-DIMENSIONAL  BOUNDARY  VALUE  PROBLEMS 

Consider  the  boundary  value  problem 
/  /  / 

(  e  u  )  +  (P  u  )  -  q  u  =  -  f  , 
u  (  0  )  =  0  ,  u  (  1  )  =  1  ,  (1) 

e(x)>e0,q(x)>q0 
The  problem  (1)  is  approximated  by 


(ihy)i  =  |:[(e  yx)i+1/2-  (£  yx)i-i/2)  + 

i 

+  l  (  wi+1/2  -V1/2]  -  Qi  Vi  =  -  fi  (2) 

i  '=  1 . N-l  ,  y0  =  0  ,  yN  =  1  , 

hi+1/2=  xi+1-  Xi  ’  hi=  0-5  (  hi+1/2+ 

yxi+1/2="J'L~/2  ’ W'+l/2=Pt+1/2y i+l+p i  +1/2yi 

Pi  +  1/2  =  0-5  [  P  ^Xi+l/2^  -  I  P  (Xi+1/2^  J  ' 

We  emphasize,  that  convective  term  (  p  u  ) 
in  (2)  is  approximated  by  the  first  order 

upwind  difference.  It  ensures  the  maximum 

principle  for  (2)  and  removes  the  oscillations 
in  difference  solutions.  The  difference 
solution  error  z.=  y.-  u  (  x.)  satisfies  the 

difference  equation 

(  Lhz).  =  -  ip. 

with  truncation  error 

^  [Ki+1/2lli+1/2“  Ki-1/2hi-1/2]  +  °^‘i^ 

Introduce  the  point  grid  coordinate  x  (  a  ) 
such  that  x.=  x  (  a.)  ,  a.  =  i  h  and  require 

that 

=  O  (  fy1  )  (4) 

at  each  point  i  due  to  a  proper  choice  of  x;  . 
The  condition  (4)  may  be  rewritten  in  the  form 

(l  x)i=Ai+i/2(xi+r  xi)~  ^i-t/2^xrxi-P“®  ^ 

Ai+1/2=  I  ^i+1/2 1  +  “i+1/2  *  X0=  0  ’  XN=  1 

The  given  grid  function  aj+)/2  >  0  (in  the 

simplest  case  al+]/2~  a  )  makes  it  possible 
to  redistribute  the  points  between  the  high 
and  low  solution  change  regions.  To  reserve  an 
order  of  truncation  error  the  regularization 

function  aj+j/2  ‘n  (6)  should  be  compensated 

in  the  right  hand  side  of  the  difference 
scheme  (2)  : 

y)  =  -[  f  +  -  [(a  ll)i+I/2_  (a  1')j_i/2]]  (7) 

I 

Different  simplified  modifications  of  grid 

monitor  (6)  are  possible  as  well. Going  over  to 
the  second  order  simplifies  (6)  essentially 
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[2]  so  that  (6)  takes  the  form 

^i  +  1/2  =\  lpi+1/2  x!.!-  x!  I  +  a  (8) 

1  +  1  1 

III.  TWO  DIMENSIONAL  BOUNDARY  VALUE 
PROBLEMS  ON  TRIANGULAR  GRIDS 

Consider  the  2D  problem 

V-(e  Vu)  +  V-(p  u)  =  0,  x  =  (Xj,x2)  €  £2  ,  ^ 

u  +  n  =  v  ,  x  e  d  Q  , 
d  n 

■+ 

where  p  =  (p,,p2)  is  given  vector  ,  which 
satisfies  -> 

V-p  =  0  .  (10) 

The  problem  (9), (10)  may  be  considered  as  a 
model  for  Navier-Stokes  equations.  Briefly 

outline  the  difference  scheme  and  the 

derivation  of  the  grid  equation  for  problem 
(9).  They  generalize  ID  equations  (7)  and  (8). 
The  standart  finite  element  approximation  of 
(9)  on  an  arbitrary  triangular  grid  may  be 
written  for  point  i  (see  fig.l)  as 


E 

k 


B£<  y„ 


-y.) 


+  E 

k 


yk+  y-, 


=  0 


(11) 


fig.  1 

Element  of  triangular  grid 
for  scheme  at  point  i  . 


In  (11)  the  coefficients  Ak 
coefficients  e(x)  ,  ^(x) 

equation  and  on  grid 
triangular  grid  with 


Bk  depend  on 
in  the  original 
geometry.  On  the 
acute  angles  only 
coefficients  Bk  always  are  positive.  The 
coefficients  Ak  may  have  any  sign,  therefore 
the  scheme  (11)  does  not  satisfy  the  maximum 
principle.  Write  (11)  in  the  form 

E  Bk(yk-  y,)  +  E  (  At  yk+  Ak  y,)  - 

-  Je  IAk|(yk-  y,)  =  0  ,  Ak  = 

Separate  equation  (12)  into  two  equations 
(Lhy).=  £  Bk(yk-yi)  +  E  Ak  yk  +  A"  y.  =  0  (13) 


(12) 


\  S  lAkl  (»„  (14) 

The  difference  equation  (13)  is  a 
generalization  of  ID  upwind  difference  scheme 
(2)  onto  triangular  grids.  It  satisfies  the 
maximum  principle.  From  (14)  we  may  obtain 


equations  for  grid  points  coordinates  like 
(8).  In  fig.2  the  example  of  adaptive  grid 
for  (10)  is  shown.  There  are  two  boundary 
layers  here.  The  first  one  is  located  near  the 
up  boundary  of  width  ~  Ve-,  the  second  -  near 


IV.  GENERALIZATIONS 

Note  some  generalizations  of  the  method. 
First,  we  used  local  optimization  of 
truncation  error.  Meanwhile  it  is  possible  to 
use  optimization  of  some  integral  norm  of 
truncation  error  and  to  construct  the  grid 
equations.  Second,  in  section  III  we 
considered  the  2D  diffusion-convection 
equation.  This  approach  admits  a  direct 
generalization  onto  such  3D  equations.  Finally 
the  proposed  approach  may  be  extended  to  time 
dependent  problems.  The  algorithm  and  resuls 
for  ID  evolution  problems  are  given  in  [4]. 
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Abstract 

In  this  paper  we  review  the  results  on  existence,  unique¬ 
ness  and  regularity  of  invariant  manifolds  for  the  Nawer- 
Stokes  equations.  Some  aspects  of  global  attractors  arc 
also  discussed. 

I  Introduction 

We  will  present  certain  results  on  the  structure  of  attractors  for 
the  Navier  Stokes  equations.  Ladyzhenskaya.  [11]  proved  that 
the  time  dependent  viscous  flow  in  two  dimensional  bounded 
domains  can  be  characterized  by  a  compact  global  attractor  de¬ 
fined  in  thefollowing  way.  Let  lF(t,  0;  •)  be  thesolution  operator 
which  relates  the  velocity-field  at  any  given  time  to  the  data.  For 
the  case  of  fluid  flowdn  two  dimensional  bounded-domains,  the 
operator  IF(t,0;-)  is  defined  in  a  Hilbert  space  H  for  all  pos¬ 
itive  times  as  a  compact  operator  and  satisfies  the  semigroup 
property: 

W(f,t,;lV(f, ,<);•))  =  W(t,0;-),  0  <  f,  <  l. 

We  then  note  that  the  Navier-Stokcs  equations  define  a  dissipa¬ 
tive  dynamical  system.  This  means  there  exists  an  absorbing  set 
in  the  solution  space  inside  which  all  orbits  enter  after  a  certain 
time.  Existence  of  absorbing  set  was  first  noted  by  E.  Hopf  in 
1911  [9]  using  energy  estimates.  Let  Bn(H)  be  the  absorbing 
ball  in  the  Hilbert  space  H.  Then  the  global  attractor  A  associ¬ 
ated  with  the  nonlinear  semigroup  Il'(-)  is  defined  as  the  ft-hmit 
set  of 

A  =  f|  U  H'M;  £«(/!)). 

1>Oi>1 

The  set  A  is  Compact,  connected,  attends  nil  bounded  seta  of 

II  and  is  invariant  to  U’(f, 0,  )  for  positive  ns  well  ns  negative 

times.  This  attractor. contains  in  particular  the  steady,  periodic, 
quasi-pcriodic  and  almost  periodic  solutions.  The  Hausdorif  di¬ 
mension  d/i  of  A  has  been  shown  to  be  finite  (1, 12, 11. 21,  22, 3]. 
Such  results  for  three  dimensional  flow  problems  would  be  of 
great  interest  for  the  understanding  of  the  dynamics  of  turbu¬ 
lence.  Another  open  problem  is  the  task  of  proving  the  existence 
of  global  finite  dimensional  invariant  manifolds  containing  the 
attractor.  The  possibility  of  existence  of  global  invariant  man¬ 
ifolds  containing  A  is  suggested  by  the  theorem  of  Mane  [17] 
which  essentially  implies  that  A  can  be  parametrized  by  A’\ 
number  ofparametcrs  with  Ar„\  >  2d//  +  I.  Coordinates  of  such 
manifolds  would  provide  us  with  an  effective  means  of  comput¬ 
ing  the  properties  of  the  attractor  (which  may  be  of  fractional 
dimension.).  In  this  report  we  will  present  certain  results  in 
this  subject.  First  result  [25]  concerns  with  the  hvpeibolinu 
of  periodic  solutions  of  the  Navier  Stokes  equations  in  bounded 
domains.  Anoiyticily  of  the  invariant  manifold-  is  the  cen¬ 
tral  result.  For  earlier  studies  on  hyperbolicity  see  fI3j,[S].  The 


second  result  is  the  upper  semicontinuity  of  the  global  attractor 
with  respect  to  regularizations  of  the  Navier  Stokes  equations 
by  the  addition  of  artificial  viscosity  terms.  We  will  also  present 
a  siriuuthncss  result  fur  global  invariant  (inertial  )  manifolds  for 
the  regularized  system.  These  global  (ut  inertial  }  manifolds  can 
also  be  regarded  as  approximate  global  manifolds  for  the  original 
system. 

In  this  paper  we  will  only  consider  viscous  flow  in  bounded 
domains.  For  a  discussion  on  various  issues  of  unbounded  do¬ 
mains  see  [25]. 

2  Governing  equations  and  functional 
framework 

Let  ft  C  Rn,n  =  2  or  3  be  a  smooth  bounded  domain.  We  will 
consider  the -problem  of  finding  (u,p)  :  0  x  (0,  co)  — t  if  x  R 
such  that, 

lit  +  (it-  V)u  =  — Vp-f  i/Au  infix(0,oo), 

V-«  =  0  inftx(0,oo), 

u(x,  t)  =  u4(x ,1)  for  (x,  l)  €  3ft  x  (0,  oo)  with  /  - dE  =  0 

Jsn 

and  Ti(x,0)  =  wo>  for  x  £  ft. 

Here  if  ft  is  multiply  connected  then  wc  require  that  the  flux 
through  each  component  of  the  boundary  be  zero. 

Let  [U(x,t),P(x,l))  be  a  basic  solution  field  (which  is  an 
orbit  on  the  attractor)  that  satisfies  the  boundary  conditions.  It 
is  known-that  [11]  the  orbits  on  the  attractor  A  are  regular  (that 
is  U,  P  are  infinitely  smooth  )  and  defined  for  positive  as  well  as 

negative  times.  We  arc  interested  in  studying  the  solution  orbits 
nearby  this  given  orbit  in  an  appropriate  function  space.  Let  us 
introduce  the  change  of  variables  u  —U  rs  and  p  —  P  +  q  so 
that  {v,  q)  satisfy, 

vt+(U  ■'v)v+{v-'?)U +(v-V)v  =  -Vo-j-fAu  in  ftx(0,oo), 

V-v  =  0  in -ft  x  (0,cc),  (l) 

v(x,l)  =  0  for  (x,t)  £  5ft  x  [0,oc). 

and  t)(x,0)  =  ro,  x  £  ft. 

2.1  Functional  frame  work 
We  will  use  the  vector  spaces, 

j(ft)  =  {w  .  ft  — » it";u  £  Cg(f2),divu  *  0}, 

II  —  (u  .  ft  -*  IV,  u  £  £3(ft).divu  —  0.  m(x i  n  -  0,  x  £  0ft}. 
V  =  (it :  ft  — *  it"; u  £  ii'(ft):divu  =:  0;«(x)  =  0,x  £ 
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Lvv  =  P,t[{U-V)v  +  (v-V)U] 


3  Linear  and  nonlinear  semigroups 

3.1  Characterization  of  the  Stokes  operator 
and  the  semigroup  it  generates 

Let  us  define  the  coercive  and  continuous  bilinear  form  a(-,  ■) : 
V  x  V  -+  it  as 

a(u,v)  =  /  Vu  -  Vvdz. 

J  n 

Let  g  6  H.  Then  since  H  C  V  =  C(V;R),  by  Lax-Milgram 
lemma  there  exists  u  £  V  such  that 

a(u,  v)  =  {g,  Vu  €  V. 

This  defines  the  Stokes  operator  A  as  Au  =  g  with  u  £  D[A) 
and  D{A)  C  V  dense.  In  fact  using  the  Cattabriga  regularity 
theorem  [2,  26,  24]  we  obtain  an  explicit  representation  of  the 
domain  of  A  as  B(A)  =  H2(£l)  fl  V  and  A  is  recognized  as 

Au  =  —PiiAu,  Vm  £  D[A) 

where  Pn  :  L‘(fl)  — »  H  is  the  orthogonal  projection.  The 
Stokes  operator  is  self  adjoint  and  positive  definite.  Moreover 
A  £  C{V;V')  fl  £(D(A)',  H)  is  an  isomorphism  on  to.  We 
have  the  continuous,  dense  and  compact  embeddings. 

D(A)C  V  C  H  =  H'  C  V’  c  j 0(A)'. 

Since  /t"1  is  compact  in  H  we  can  define  the  fractional  powers 
A°,a  €  H  of  A  using  its  spectral  resolution: 

Aau  =  (  X°dE{\)u  =  51 <£■■)//&>  Vu6  D{A), 

where  E[Xj  arc  the  resolution  of  identity  generated  by  A  and 
arc  the  eigen  pair  of  A.  The  domain  of  A°  is 

D(Aa)  =  {v  =  <  «)• 

1=1  «=1 

It  follows  from  a  theorem  of  Lions  [15]  that  D(A1^)  =  V- 
We  will  denote  by  D{A~a)  the  dual  of  D{A°)  (closure  of  H 
under  the  norm  of  D[A~°)).  The  resolvent  of  —  A  satisfies 

||/1(A; -A)\\ciiiji)  <  jJXTj  for  *  e  --  ’  0  <  £  < 

Here  E*  is  a  sector  containing  the  right  half  plane. 

Lemma  1  -A  generates  a  compact  semigroup  that  is  holo- 
morphic  in  Ea-  Moreover  for  0  <  ft  <  a, 

!|5(0lie(D[AS);D(^*))  2  1  >  0 

and  3e  >  0  such  that, 

‘SO- 

Here  Sa  is  art  acute  sector  containing  the  positive  real  axis. 

3.2  Characterization  of  the  inertia  terms 

Let  us  now  consider  the ''inertia  terms"  in  equation  ( 1  j.  We  ad! 
define  a  linear  operator  £t>  and  bilinear  operator  B( .  )  in  the 
following  way. 


and  B(v,v)  =  Pu[(v  ■  V)»]. 

Lemma  2  If  U  £  A  then  Lu  €  C(D{Aay,D(A°-in))>a  £ 
(0,1/2).  The  bilinear  operator  satisfies  B(-,  ■)  :  V  xV  — *  D(A~1^'1)- 

Proof  of  these  results  can  be  found  in  [25].  The  second  result  is 
actually  due  to  [G]. 

3.3  The  Linearized  problem 

Let  us  find  v  £  (7(0,  co;  V)  fl  C’fO.oo;  V ')  such  that 

vt  -f  Luv  -r  Av  —  0,  l  >  0. 
t>(0)  =  v0  £  V. 

This  is  resolved  as 

v(t)  =  S{t)v o  —  /  S(t  —  7)Lu(r)v{T)dr. 

Jo 

If  wc  define  the  operator  IC  as, 

[£v](t)  =  /  S(t-  r)Lu(r)v(r]dr. 

JO 

then  [(/  t  X)jr(t)  —  S{t)v0.  Properties  of  Loti  and  the  csti 
mates  on  S(-)  allow  us  to  show  that  for  small  enough  T, 

I!*i  (I  e(C(o.T:v)  iC(o.r:t')  j  <  1. 

Thus  wc  have  the  convergent  series  representation. 

B>0 

Linqucncssof  the  solution  iiiipbcs  that  the  evolution  opciatoi 

Z(l,r )  satisfies  Z(i,r)  =  Z(1,jj)Z( g.r),  0  <  r  <  g  <  l.  Using 
this  wc  extend  Z[l,7)  to  0  <  r  <  l  <  oo.  Estimates  on  the 
Stokes  semigroup  allow  us  to  prove. 

Lemma  3  For  r  <  t  the  maps  l  — *  Z(l,r)  and  r  Z(t,r) 
are  continuous  in  the  uniform  operator  topology  of  C{V\  V)  fi 
C(D{A-'f*)-,V).  For  7  <t  the  operator  Z(t.r)  £  C(V-,  V)  O 
C[D[A~*I*)\  V)  is  compact.  We  also  hate 

QZ((,s-)Oc(Dfa-'/.):n  £  ^  _  -p/U  1  >  ' 

Let  us  now  consider  the  case  where  the  basic  fiow  is  T  -periodic 
in  time.  Existence  theorem  for  lime  periodic  solutions  for  the 
N'jiici-Stolcs  equations  tan  be  found  in  When  U  is  T- 
periodit.  Z{T.  0j  is  tailed  the  monodromy  operator  and  sat¬ 
isfies. 

Z[nT.iS)  =  ZiT.ar.n  >  1. 

3.4  Full  Nonlinear  problem 

Let  us  find  v  £  f’(0.  T'i  f„i;  V)  such  that 

Up)  =  Zil.QfVr,-  (  '/.{t.7)B{Vi7).X<7\\d7 

Jti 

vtO)  -  v.,  £  V 

where  the  liiasimai  liinr  and  »s  deter  iim.ed  by  the  norm 

of  the  initial  data.  r,„  We  write  V\l>  -  H'ttJ.T„|.  Then  we  tan 
show  that  [2-5]. 
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Do  — *  VF(<,0;do)  is  real  analytic  in  B$( 0)  G  V 
This  means  W'(t,  0,  )  can  be  written  as  a  convergent  power  series 
\V(t,  0;  D0)  =  K(d0,  •  ■  ■ ,  d0;  i) 

n>l 

The  n-linear  maps  •••,•;  t)  are  continuous.  We  have 

W(i,0;DO)  =  \V(t,T-,  W(t,0;do)),0  <  r  <  i  <T'(d0). 

For  fl  C  R2,  we  have  T‘(d0)  =  co,  Vu0  €  V  (23).  For  fi  C 
R3,  T"(v0)  =  oo  if  Do  is  contained  in  a  sufficiently  small  ball 
centered  at  the  origin  of  V  (6).  If  U  is  T-periodic  in  time  then 
IF(nT, 0;  •)  =  IF(T,0;  )n,V/i  >  1.  We  note  heie  that  the  Frechet 
derivative  of  this  map  VF(f,0;  •)  is,  DW(t,r\0)  =  Z(t,T). 

4  Invariant  cones  and  manifolds 

Let  us  first  state  the  following  fundamental  result: 

Theorem  1  Let  the  spectrum  of  the  monodromy  operator  Z(T,0)  € 
£(D(Aa)\JD(Aa))  splits  in  to  two  disjoint  sets  cru  mid  a,  such 
that  cr(Z(T,0))  =  <7U  U  cr,  and 

b  =  sup  [A|  <  inf  |A|  —  a. 

a,  a« 

Let  Pu  and  P ,  be  the  spectral  projectors  defined  by  the  Dunford ’s 
integrals , 

Pu  =  ^~.f  R{\]Z(T,0))d\  and 
i~i  Jr u 

ps  =  ±lJrmz(T,o)w- 

(Here  i?(A;  Z(T,Q))  is  the  resolvent  operator  and  Fu,  F,  encircle 
eru,  o,  respectively ).  Then  Ve  >  0,  we  can  choose  a  noi~ni  m 
D(Aa),  equivalent  to  the  given  one  such  thalfi/v  g  D{Aa) 

(0  IMlD(a<*)  =  II-P^Hdi/i")  +  HP»»lb(/i«),  ||.P4  =  IIPjII  =  l, 

(»)  ||Z(T,0)P4d||D(/1o)  <(Hc)||P,d||D(/1<.), 

(in)  P(2',,0)Pud||D(/!<.)  >  (a  -  c)||Pud||0(/i<»). 

Hero  Ps  +  Pu  =  /  ,  P,PU  =  P«Pj  and  P„  Pu  commute  with 
Z(T,0). 

This  result  is  in  fact  valid  for  any  continuous  linear  operator 
in  a  Banach  space  with  the  above  spectral  properties.  For  the 
proof  of  this  results  sec[4).  Let  the  spectrum  of  the  monodromy 
operator  splits  into  two  sets  such  that  o(Z(T,0))  —  ctuU<t4  with 
<7„  fl  as  =  empty  and 

b,  =  sup  |A!  <  inf  |A|  =  b~' 

A€o»  A€<,“ 

Theorem  2  (Invariant  cone  theorem)  Ifbu  <.  1,  then  there 
exists  a  double  cone  that  is  invariant  to  W(T,  0,  J  locally.  Let 
K  =  (d6  V;  ||P,d |[v  <  <yj[P (jDj[ v j  q  >  0}  and  let  K,  =  Ad\{0). 
Then  W(T,0‘,  •) :  D$( 0)  D  )C  — *-K  and  is  injective. 

This  theorem  is  proved  in  (25)  using  a  result  on  geneial  mappings 
by  Kirchgassner  and  Scheurle  (10). 

Theorem. 3  The  invariant  manifold  theorem  Let  b3tb„  < 

1.  Then  in  a  neighborhood  ZJr(0)  C  D(Aa),a  g  (1/2,1), 
there  exists  two  unique,  analytic  manifolds  Ms  and  Mu 
which  are  respectively  the  graphs  of  the  analytic  maps,</>, : 
P,D{Aa)  -*  PuD(A°),  <t>u  ■  PuD(Aa)  P,D(A°)  with, 


(*)  ^u(O)  =  <£a(o)  —  0, 

(ii) D<j>u(Q)  =  D<f>,( 0)  =  0  ■  ■  -tangency  condition 

(iii)  manifolds  M,  and  Afu  are  locally  invariant  under  the 
solution  map  1V(2’,0;  -): 

W(T,0;  Mu  n  Br(0))  c  Mu  and  W(T, 0;  M,  fl  Br( C))  C  M,. 

(iv)  stable  manifold  M,  satisfies 

M,nBr(0)  =  {«  g  J?T(0)  such  that  Vn  >  0,  W(nT,0;u)  € 
2?t(0)  and  -»  0  as  n  ->  co} 

and  M,  fi  Bt((j)  fl  it  =  empty 

Unstable  manifold  Mu  satisfies, 

M„nPr(0)  =  {u  g  Pr(0)  such  that  ]V(I,0,-)nu  is  de¬ 
fined1  Vn  <  0 

and  tends  to  zero  as:  n  ->  -oo)  and  Mu  D  Br(0)  C  K. 

(v)  if  u  £  M,  then  there  exists  8  >  0  and  p  g  N  such  that, 
|[W(pT,0;u)||D(,1„)>5. 

(vi)  dist(Mu, H/(T,0;u))  <  dist(Mu,u)  for  u  6  PT(0)--  -  ex¬ 
ponential  attractive  property  of  the  unstable  manifold. 
dist(A/4,  W(T,0;u))  >  dist(A/„u)  for  u  g  PT(0)---  repelling 
property  of  the  stable-manifold. 

Proof  of  this  result  can  be  found  in  (25). 

5  Regularized  system:  quest  for  global 
unique  solvability 

In  this  section  we  will  present  the  results  on  a  particular  regular¬ 
ization  of  Navier-Stokcs  equations.  For  this  system,  it  is  possible 
to  prove  global  unique  solvability  theorem  up  to  dimension  six 
[16], (18), (19).  In  this  regard  the  regularized  system  in  six  dimen¬ 
sions  or  less,  behaves  like  the  two  dimensional  Navier-Stokes 
equations. 

Let  fi  C  Rn,n  <  6  be  a  smooth  bounded  domain.  Find 
(dc,pc)  :  fi  x  (0,  co)  — >  R"  x  R  such  that, 

d[  +  (d'-V)d'  =  -  Vp'  +  dAd'-cAV  +  Z  in  fix(0,oo), 

V-d'  =  0  infix(0,co),  (9) 

v*(x,t)  =  0,  (x,t)  g  dfi  x  (0,co), 
dv< 

-T—{x,t)  =  0,  (x,t)  e  <9fi  x  (0,co) 

and  Dc(z:,0)  =  vl0  x  6  fi. 

It  is  also  possible  to  use  periodic  bounder ,>  condition  (  pe¬ 
riodic  in  Rn)  for  this  system.  Let  us  define  V  :=  {d  € 
//o(fi);  V.d  =  0).  Then  as  in  the  characterization  of  the  Stokes 
operator,  we  can  define  a  positive  definite,  selfadjoint  opera¬ 
tor  A  =  P„ AJ  with  D(A)  =  V  n  //•'( fi)  then  D{A'!2)  =  V 
as  before.  We  will  obtain  B[  ,  )  .  V  a  V  — »  II  compared  to 
B{  ,  )  .  V  x  V  — >  This  shows  that  the  nonlinearity 

in  the  regularized  system  has  a  better  behavioi.  We  can  prove 
that, 

Theorem  4  If  Cl  C  Rn,  2  <  n  <  G,  then  Jot  a  given  f  t 
L2(0,T-,II)  and  Vg  g  H,  3  a  unique  solution  vc  to  (9)  such 
that,  d1  g  Ifi(0,T  :  V)C\C([0,T}-,TI). 
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6  Global  invariant  manifolds 

For  the  regularized  system  introduced  in  section  (5)  we  can  prove 
the  existence  of  a  compact  global  attractor  as  well  as  the  local 
invariant  manifolds  of  the  type  discussed  earlier  (19], [20].  More¬ 
over,  it  is  also  possible  to  establish  the  existence  of  global  invari¬ 
ant  varieties  of  the  type  introduced  in  [5].  These  global  invari¬ 
ant  varieties  are  modelled  on  finite  dimensional  linear  manifolds 
spanned  by  the  eigenfunctions  of  A.  The  global  invariant  va¬ 
rieties  defined  below  have  C'  smoothness  as  compared  to  the 
Lipschitz  manifolds  proposed  in  (5). 

Definition  1  M  is  called  a  C'-inertial  manifold  if  it  is  finite 
dimensional  Lipschitz  manifold  whose  derivatives  are  Lipschitz, 
has  compact  support,  exponentially  attractive,  contains  the  global 
attractor  and  is  invariant  to  the  action  of  the  solution  map  (the 
nonlinear  semigroup)  in  the  neighborhood  of  the  global  attractor. 

For  the  two  dimensional  regularized  system  with  periodic  bound¬ 
ary  conditions  we  have 

Theorem  5  Let  N '  be  sufficiently  large  so  that  th ^  eigenvalues 
of  the  operator  A  satisfy 

1  >  d\  /«  and  VN'+i  ~  llN •  ^  di/e  (10) 

Then,  ViV  >  N' ,  3  Cl -inertial  manifolds  Mn  which  are  graph 
of  maps  from  PnV  in  to  Q^V,  where,  Pjv  =  (7  —  QN)  is  the 
projection  in  to  the  invariant  subspace  corresponding  to  the  first 
N -eigenvalues  of  A. 

Proof  of  this  theorem  involves  two  steps.  First  we  use  the  general 
method  in  [5]  to  establish  the  existence  of  Lipschitz  manifolds. 
The  spectral-condition  10  is  in  fact  satisfied  for  this  case.  We 
then  prove  that  under- the  same  hypothesis  of  the  theorem,  the 
above  manifolds  have  Lipschitz  derivatives  [19].  This  is  proven 
using  methods  similar  to  that  in  [25]  for  the  analyticity  theorem 
for.the  stable-unstable  manifolds  as  described  in  the  early  part  of 
this  paper.  These  results  on  the  regularized  system  motivate  the 
Limit  case  e  -*  0  :  Let  v  be  the  Hopf-class  weak  solution 
to  the  Navier-Stokes  equations.  Then  for  0  C  R",n  =  2,3  we 
have, 

Theorem  6  If  v‘  £  L'5O(0,T,  uniformly  in  t  then  3 C  > 

0  such  that  for  v  >  C  we  have  as  e  —*  0,  vc  —>  v  strongly  in 
L*(0,T-,H) 

Recall  that.  If  the  Hopf  class  weak  solution  to  the  NS  equations 
v  €  L~(0,r;T/)nZ,2(0,:T;V)  satisfies  v  €  LM(0,T;L\Q)) 
then  it  is  unique. 


7  Upper  semicontinuous  global  attrac¬ 
tors 

We  will  now  state  the  following  powerful  result  [20]  regarding 
such  convergence  for  the  two  dimensional  case.  Let  us  define  the 
global  attractor  for  the  regularized  system  (9)  as 

A(=f]\JW((t,0:BR(H)) 

T>01>r 

where  Wt(f,0  :  •)  is  the  nonlinear  semigroup  associated  with  the 
regularized  system  and  Bp(H)  denotes  absorbing  ball  in  II  for 
the  semigroup  \Vc(t,  0;-). 


Theorem  7  Ve  >  0  and  Vi/  >  0  the  global  attractor  At  corre¬ 
sponding  to  the  two  dimenstonal  regularized  system  (with  peri¬ 
odic  boundary  conditions)  has.  the  following  properties. 

(i)  At  is  compact  and  attracts  boundes  sets  of  H. 

(ii)  Wt(i,0:  A<)  =  A{,  teR. 

(Hi)  A,  is  upper  semicontinuous  at  e  =  0:  <?;/( At,A)  -  0  as 
6  — >  0.  Here  the  semidistance  Sn  is  defined  as 

Si,{ Ae,A)=  sup  inf  ||u-u]|/,. 

u€A< 

We  note  that  A  above  corresponds  to  the  global  attractor  for 
the  two  dimensional  conventional  Navier  Stokes  system. 

Proof  of  this  theorem  involves  certain  uniform  estimates  (in¬ 
dependent  of  e)  for  the  solution  of  the  regularized  system  and 
an  approximation  result  on  the  upper  semicontinuous  global  at¬ 
tractors  for  nonlinear  semigroups.  The  details  of  the  proof  can 
be  found  in  [20]. 

Remark:  In  order  to  show  the  continuity  of  At  at  e  =  0,  we 
need  to  prove  the  lower  semicontinuity  result:  Sji( A,  A{)  — *  0  as 
e  — >  0.  This  issue  is  presently  open. 
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ABSTRACT  •  We  present  here  an  approximation  of 
incompressible  2D  or  3D  Navier-Stokes  equations  in  velocity- 
pressure  formulation  with  a  scheme  which  is  second  order  in  time 
and  of  finite  element  type  in  space.  The  convective  partis  treated 
according  to  a  characteristics  method,  the  Stokes  part  is  solved  with 
the  help  of  an  Uzawa  algorithm. 

Theoretical  results  concerning  the  precision  and  the  stability. are 
given .  Numerical  tests  show  the  improvement  given  by  this  second 
order  scheme  compared  to  a  first  order  scheme  also  using 
characteristics  to  treat  the  convective  part. 

^DESCRIPTION  OF  THE  SECOND  ORDER  TIME 
SCHEME 

This  scheme  is  based  on  an  operator  splitting  method  similar  to  the 
one  proposed  in  [1],  [2]  and  [3). 

We  denote  by  £2  c  RN  (N  =  2  or  3)  the  computational  domain  and 
by  [0,  T]  the  time  interval.  We  consider  the  Navier-Stokes 

equations:  find  v :  £2  ->  RN  and  p  :  £2  ->  R  solutions  of 


0y 

^-  +  v  .Vv  -  v  Av  +  Vp 

=  f  in  £2  x  ]0,  T[, 

(1) 

div  v  =  0 

in£2x]0,T[, 

(2) 

v  (x,  0)  =  v0  (X) 

for  x  e  £2  , 

(3) 

< 

II 

*< 

■o. 

on  T  X  ]0,  T[. 

(4) 

Let  At  be  the  time  step  and  tn+1  =  (n+l)At.  The  second  order  time 
scheme  is  defined  by  two  steps. 

Concerning  the  convection  step,  for  any  point  xe  £2,  we  introduce 

the characterisdc  curve  X$+1 :  [t"'1,  t"+1]  — >RN,  solution  of 

Vt e  [t"*1,  tn+1[,  <f!®- 

v"*  (XS+1  (t)),ifX5+1(t)6  £2, 

0,  otherwise,  '  ' 

X$+1  (tn+1)  =  x, 
where  vn*  =  2  V  -  v"  'J. 

We  set 

v,n+1  (x)  =  vn*  (X"x+1  (tn)) , 
and 

v2n+1  (x)  =  vn*  (X5+1  (t"-1)). 

The  Stokes  step  consists  in  computing  the  approximations 
vn+1 :  £2  — >Rn  and  pn+1 :  £2  -»R  of  the  velocity  and  the  pressure  at 
time  t n+1,  solutions  of 


(2.vn+l  .  2  vin+1  +  L  v2n+1 
2 - . - 2L - v  A  vn+1  +  grad  pn+1 


At 


=  f(.,tn+1)  in  £2, 


div  vn+I  =  0  in  £2, 

\vn+1  =  v,j  (.,  tn+1)  on  T. 


(6) 


We  denote  by  II  llv  the  norm  of  Hi  (£2),  defined  by 
llullv  =  [ II u IIq  +  V At  II Vu llg J 2. 

II.  THEORETICAL  RESULTS 

In  this  section,  we  only  consider  problems  (l)-(4)  the  solution 
(v,  p)  of  which  is  sufficiently  smooth.  Moreover,  we  assume  that 
Vd  =  0. 

11.1  Time  consistency  error 

It.  is  easy  to  see  that  only  the  momentum  conservation  equation 
produces  a  non  zero  consistency  error. 

For  any  point  x  e  £2,  let  Xx+1:  [t"’1  ,tn+1]  ->  rN  denote  the 
characteristic  curve  defined  by  a  system  analogous  to  (5),  where  the 
discrete  velocity  is  replaced  by  v.  We  also  set 
hx  (0  -v  (x5+1  (t),  t)  for  t  e  [t"’1,  tn+1]. 

The  consistency  error  is  of  order  2:  it  is  equal  to 

E  (v,  p)  =  Sup  { II  e(x,  n+1)  II,  x  e  £2 ,  n  /  tn+1  e  [0,  T)  ), 
where 

e  (x,  n+1)  = 

-  (AO2  [1  (tn+1)  +^f  .Vv  (x,  t"«)]  +  O  ([At]3) 

i  dt3  3t2 

(II .  II  is  the  euclidian  norm  of  RN). 

11.2  Stability  results 

The  present  results  are  concerned  with  unsteady  flow  computations 
—  the  steady  case  is  under  consideration  — . 

The  case  of  the  linear  convection-diffusion  problem 
3v 

•^-+u.Vv-vAv  =f  in£2x]0, T[, 

v  (x,  0)  =  vo  (x)  for  x  e  £2 ,  v  =  0  on  F  x  JO,  T[,  (7) 

has  been  already  studied  in  [1].  We  can  deduce  from  Ewing  and 
Russel’s  convergence  results  that  the  scheme  is  unconditionally 
stable  for  the  norm  H  Hi;  moreover  we  have  exhibited  an 

upperbound  of  the  sequence  (II  vn  llv)n  by  using  a  somewhat 
different  proof: 
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Proposition  1:  If  div  u  =  0  in  SI  x  ]0,  T[  and  u.n  =  0  on 
T  x  ]0,  T[,  there  exist  constants  C  (u),  C  (f),  C  (v°,  v>), 
depending  only  on  Eland  respectively  u,  f,  (vn,  v 1 ),  such  that  for 
At  <.  C  (u),  we  have 

l!vn|lv<;C(f)T  +  C(vO,v>).  (8) 

In  the  nonlinear  case  of  the  Navier-Stokcs  equations,  we  can 
presently  get  stability  results  only  when  introducing  the  space 
discretization.  Let  h  be  the  space  step  and  k  the  degree  of  the 
velocity  finite  elements.  By  using  technics  similar  to  those  of  [1], 
we  can  proove  the 

Proposition  2:  There  exist  constants  Ci  and  C2  depending  only 

on  Q.  and  respectively  (v,  v{J,  v/,)  and  (v,  v{},  vj,  e  7w)  such  that, 
for  h  small  enough  and  k  >  N/2,  the  condition 
At  <  inf  (1/Ci,  C2  hN/4)  yields  to 

HvRIIi,~£C,.  (9) 

The  scheme  appears  slightly  less  stable  than  the  first  order  scheme, 
which  is  unconditionally  stable  ([6]),  but  this  instability  may  be  only 
due  to  the  technics  of  proof. 

III.  NUMERICAL  RESULTS 

The  second  order  time  scheme  has  been  implemented  in  the 
thermalhydraulic  finite  element  code  N3S  developed  at  EDF  ([4]). 
Comparisons  have  been  done  with  the  original  first  order  scheme 
([4],  [5],  [6]).  In  all  the  cases,  the  second  order  scheme  improves 
the  results  (t7j). 
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111.1  Results  on  analytical  steady  cases 

We  have  observed  on  analytical  steady  tests  that  the  consistency 
error  affects  more  the  pressure  results  than  the  velocity  ones  (cf. 
Fig.  1  to  3  where  results  are  shown  for  the  same  mesh  and 
At  =  10-3). 

However,  for  the  tested  cases,  with  the  first  (resp.  second)  order 
scheme,  the  computed  time  precision  is  of  order  1  (resp.  2)  for  both 
velocity  and  pressure.  We  get  thus  a  numerical  information 
concerning  the  pressure  rate  of  convergence  since  presently  there  is 
no  theoretical  results  for  any  of  the  two  schemes. 

Moreover  we  have  observed  that  a  too  strong  refinement  of  the  time 
step  leads  to  worth  results.  In  particular,  when  in  the  momentum 
equation  the  convective  part  is  very  important  compared  with  the 
diffusion-pressure  part,  we  cannot  get  a  good  pressure  without 
refining  the  mesh  together  with  the  time  step.  The  theoretical  space- 
time  precision  of  the  second  order  scheme  applied  to  the  Navier- 
Stokes  equations  is  under  consideration  (see  [6]  for  the  first  order 
one). 

111.2  Results  on  an  unsteady  case 

The  computations  of  the  Gamm  workshop  ([8])  have  been 
performed  with  the  two  schemes.  They  are  concerned  with  a  flow  in 
a  heated  cavity  at  a  zero  Prandtl  number  and  with  homogeneous 
Dirichlet  boundary  conditions.  The  following  result  is  given  as  an 
example  of  the  improvements  given  by  the  second  order  scheme. 
For  a  Grashof  number  equal  to  30000,  the  reference  computations 
predict  an  unsteady  periodic  state  winch  is  well  computed  with  the 
second  order  scheme,  although  the  first  order  one  converges  to  a 
steady  state. 


IV.  GENERALIZATION 

This  scheme  can  be  generalized  to  a  k-order  time  scheme  ((3)).  The 
consistency  error  has  been  studied  in  (7J.  Concerning  the  order  3, 
the  scheme  has  been  succcsfully  used  together  with  the  spectral 
methods  ([2]).  The  stability  results  are  under  consideration. 
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Iso-pressure  lines 
Figure  1:  analytical  solution 


Figure  2 ;  solution  computed  with  the  first  order  scheme 
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HOW  DOES  THE  NAVIER-STOKES  EQUATION  ENGENDER  CHAOS? 


JON  LEE 

Flight  Dynamics  Dir.  (FIB) 
Wright-Patterson  AFB,  OH  45433  USA 


Abstract  -  for  the  2D -Nauier-Stokes  equations  as  a 
specific  model  for  dynamical  systems,  ule  hat/e  found 
that  the  chaotic  transition  is  couched  on  a  2-torus- 
like  manifold  which  is  the  product  space  of  a  circle 
and  multiply-periodic  orbit.  This  is  conceptually 
similar  to  the  unstable  2-torus  of  Ruelle-Takens- 
Newhouse- 

I.  INTRODUCTION 

Although  it  is  agreed  that  the  laminar-to-turbulence 
transition  begins  with  emergence  of  a  periodic  motion 
from  the  fixed  point  (laminar  flow),  there  is  no 
general  agreement  as  to  what  happends  next  to  the 
periodic  motion  as  the  forcing  (Reynolds  number)  is 
further  increased.  Several  scenarios  leading  to  chaos 
have  been  proposed; the  unstable  quasiperiodic  3-torus 
of  Ruelle-Takens-Newhouse[l,2],  period-doubling  of 
Feigenbaum[3] ,  and  intermi ttency  of  Pomeau-Hanneviile 
[4-1  (see,  for  instance,  the  review  article  of  Eckmann 
[5]). We  shall  show  that  the  2D  Navier-Stokes  equations 
In  a  cyclic  domain  follow,  at  least  conceptually,  the 
scenario  of  Ruelle-Takens-Newhouse  closer  than  any 
others,  although  the  actual  state  of  affairs  is  some¬ 
what  more  complicated.  Prior  to  chaos,  there  appears 
a  multiply-periodic  orbit  and  the  chaotic  transition 
takes  place  on  a  2-torus-like  manifold  which  is  the 
product  space  of  a  circle  along  the  longitude  angle 
and  the  multiply-periodic  orbit  in  the  plane  of  lati¬ 
tude  angle.  Instead  of  the  perturbation  of  a  circle 
map(6,7J,  it  therefore  appears  that  the  appropriate 
model  for  chaotic  transition  would  be  the  area¬ 
preserving  map  of  Chirikov(8]  generalized  to  Include 
anharmonicify. 


II.  A  SET  OF  860  EVOLUTION  EQUATIONS 

For  a  2D  periodic  flow  with  no  mean  flow,  it  is 
most  expedient  to  Fourier  analyze  the  velocity  field 

t)(1c)  and  body  forces  in  a  square  region  of  side 

L  by  [!<!]]  =  !  [$[|j)exp(i£-x),  where  3=(2tt/L)^xJ 

(n  ,n  »0,±1 ,±2. . . . )  is  the  wavevector.  By  spanning 
x  y 

incompressible  and  <j(£)  by  the  unit  polarization 

vector  s(ft)  normal  to  the  incompressible  Navier- 
Stokes  equations  give  rise  to  the  so  called  triad- 
interaction  representation  in  spectral  form 

+vk?u$)“-i  2  **(<|p,q  u*(p)u*(q)+gOk) ,  (1) 

&+p+q=0 

where  v  is  the  kinematic  viscosity,  kH&I1^2  and 
*%p  is 

the  symmetrized  coupling  coefficient.  Let  us  label 
the  wavevectors  in  the  successive  k-rings.  There  are 
430  wavevectors  for  isotropic  truncation  of  the  upper 

wavenumber  K=16.  By  abbreviating  u(^/J)=u/J  and  b(&„) 

“Ejj.  enumeration  of  (1)  yields  a  set  of  430  equations 

for  u  with  106.244  triad-interaction  terms  in  the 
n 

right  hand  side. 

For  computation  we  split  up  into  the  real  and  imagi¬ 
nary  parts  by  un=u£*iu*  and,  similarly,  8n=g£*ig^. 
Denote  the  vector  of  u£  and  u*  by  II,  kj;u£  and  kjju*  by 

9  (tl )  ,  the  triad-interactions  by  (U  ,11 ) .  p.p  and  g*  by 

<3.  The  set  of  860  equations  has  the  vector  form 

(I  -  -i/?n (ti )  <■  ^(U.tl)  +  0,  (2) 

similar  to  the  evolution  equation  of  Constantin  et. 
a  1 . [ 9 ] .  The  energy  and  enstrophy  conservations  follow 
from  <u,9  >-<3  ,?  >*0, where  <,>  is  the  scalar  product. 


III.  FIVE  EQUILIBRIUM  STATES 

For  the  present  study,  we  shall  restrict  ourselves 
to  the  single-mode  and  three-mode  forcing 

v  (o  °!* 

Qa=  (o  s26  .g26  .g£7  .g27  >e28  .s20  <  ■  ■  °)> 

where  g's  are  assumed  constant.  For  the  time  indepen¬ 
dent  forcing,  trajectory  behavior  can  best  be  catego¬ 
rized  by  the  amplitude-angle  form  un=Rnexp( ia„) . 

Hence,  the  equations  of  motion  in  Rn  and  vp 

rW-  V  (3) 

represent  an  assembly  of  430  coupled  ufi  oscillators. 
Here.  Vr  and  Vu  are  the  vectors  of  Rfl  and  up,  Hr  and 
Hu  are  the  right-hand  sides  involving  the  forcing 
grFJexp(i6i)  for  26,  27  and  28. 

We  have  found  experimentally  that  (3)  admits  the 
following  equilibrium; 

K  “Const,  R  “periodic,  R  “chaotic,  (4a,b,c) 

n  n  n 

and  ei  “Const,  o  “const  x  t,  S  “periodic, 
n  n  n 

wn“Const  x  t  +  periodic,  on=chaotlc.  (5a-d) 

Only  certain  combinations  of  (4)  and  (5)  give  rise  to 
to  the  equilibrium  states  (ES)  as  follows; 

ES  I:  Fixed  Point  -  eqn  (4a)  &  (5a) 

ES  II:  Circle  -  eqn  (4a)  &  (5b) 

ES  III:  Closed  orbit  -  eqn  { 4b)  &  (5c) 

ES  IV:  Torus  -  eqn  (4b)  &  (5d) 

ES  V:  Chaos  -  eqn  (4c)  &  (5e) 

For  ES  III  the  principal  frequencies  of  Hn  and 

must  be  rationally  related,  otherwise  the  orbit  is 
unclosed.  What  is,  however,  unexpected  is  ES  IV.  Let 
us  denote  the  equilibrium  state  by  X=Rexp(iR)  without 
the  overhead  bar.  The  combination  of  (4b)  and  (5d)  is 
explicitly  given  by 

R=Ro+Arsin(27tfrt«j>r) ,  fi=fl0-*fi't+Aocos(2Tifut+(pt>) .  (6) 

Here,  R  is  modulated  by  a  sine  with  amplitude  Ar,  fre¬ 
quency  fr,  phase  <pr,  and  Ao,  fo,  <fu  are  defined  simi¬ 
larly  for  R .  The  angular  velocity  fi'  is  measured 
positive/negative  for  counter-clockwise/clockwise 
rotation.  Since  R ' T»2n(o. 16)  in  Fig  1(a),  the  phase 

plot  of  Xr  vs  X*  has  rotated  counterclockwise  by  about 
58°  in  Fig  1(b).  Note  that  R“RQ  and  R=R0+R't  is  a 

circle  S1  of  radius  R0(ES  II),  and  R=Arsin(2nfrt-K(>r) 
and  £)»A«cos(2nf(jt-K?4J)  form  a  closed  curve  C1(ES  III). 
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Hence,  (6)  represents  a- 2- torus -like  manifold(ES  IV) 
of  the  product  space  ^xS1.  For  definiteness,  we  shall 
say  latitude  angle. ft,  (=2itf„)  encloses  C1  and  longitude 

angle  ft2(*ft')  revolves  C1  around  the  S1(see,  Fig  165 

of  ArnoldflO]).  By  decoupling  the  two  angles,  one  can 
generate  a  segment  of  2-torus  as  shown  in  Fig  1(c). 


(Fig  4(b)).  Note  that  separation  is  brought  about  by 
the  period-doubling  of  R132  and  u ,  and  the  overlap¬ 
ping  is  due  to  the  longitude  angle.  Finally,  there 
comes  the  climactic  phase  plot  of  Fig  4(c)  which  can 
no  longer  restrain  the  orbit  on  ES  IV,  thereby  thrust¬ 
ing  into  a  strange  attractor. 

V.  Conclusions 


VI.  NUMERICAL  EVIDENCE  FOR  CHAOTIC  TRANSITION 

A  large  v=  0.02  is  used  to  assure  the  validity  of 
isotropic  truncation  for  K=16.  Since  P  «F  *F  «F, 

forcing  amplitude  F  is  the  parameter  for  trajectory 
behavior.  Numerical  experiments  have  shown  that  ES 
III  evolves  into  ES  V  within  a  very  small  range  of  F. 

Since  un-oscillators  are  dynamically  similar,  we  shall 
pick  out  u  -oscillator  and  examine  how  chaos  can 

132 

develop  out  of  a  multiply -periodic  orbit. 

Under  G1  the  chaotic  transition  takes  place  in  F= 

(0.1601,0.162).  First,  we  present  in  Fig  2(a)  the 
phase  plot  at  F=0.1601,  which  is  closed.  Fig  2(b) 
shows  that  R  „  and  a  _  are  periodic.  Now,  as  F  is 

raised  to  0.1615.  we  find  in  Fig  3(a)  that  the  phase 
plot  is  no  longer  closed,  but  appears  rotating  about 
the  origin  of  the  phase  plane.  From  the  angle  of  Fig 
3(b),  one  can  estimate  longitude  angle  ft's: 

-2n(0. 000055)  and  latitude  angle  2nf0&27t( 0.0079)  by 

(6).  Hence,  the  orbit  of  u.  -osci l lator  is  on  a 

132 

2-torus  like  manifold(ES  IV)  which  is  a  wrinkly  dough 
nut  with  contorted  but  smooth  cross  sections.  For  F> 
0.1615,  the  orbit  cannot  remain  on  ES  IV,  hence  is 
attracted  to  a  strange  attractor. 

Similarly,  underG  the  chaotic  transition  takes 

place  in  F=(0. 06722,  0.06729).  Here,  the  existence  of 
ES  IV  is  found  almost  at  a  point  value  of  F.  As  F 
increases  toward  F'  0.06729,  we  shall  come  to  pass  a 
threshold  value  (yet  undetermined),  beyond  which -ui3a* 

oscillator  evolves  continually  from  a  multiply 
periodic  orbit  to  chaos.  To  be  specific,  we  have  shown 
in  Fig  4  a  sequence  of  three  phase  plots  observed: at 
F=0. 06727.  First,  the  orbit  splits  into  two  loops(Fig 
4(a))  and  then  each  loop  overlaps  in  the  phase  plane 


One  can  schematize  the  chaotic  transition  as  shown 
in  Pig  5.  Prior  to  chaos,  a  multiply-per iodic  orbit 
lies  on  the  plane  of  latitude  angle.  However,  with  the 
emergence  of  longitude  angle  there  forms  a  2-torus- 
like  manifold,  similar  to  the  quasiperiodic  2-torus  of 
Ruelle  &  Takens[l)  (see,  Fig  1.14  of  Ref  [11]).  Hence, 
a  generalization  of  Chirikov's[8]  area  preserving  map 
may  be  appropriate  for  ES  IV 

Ri+i”Ri‘2nfsin2n6i+a2sin4T,0i  ei+i'ei+0+Ri+i  •  (7) 

Here,  we  indicate  only  the  second  harmonic  of  strength 
o2<  in  the  absence  of  which  (7)  is  the  original  map  of 

Chirlkov[8].  It  further  reduces  to  the  circle  map  4>(0) 
=0+/?2^sin2n0  that  Shenker[6]  and  Rand  et.al.[7]  have 

investigated  as  a  model  for  chaotic  transition  of 
quasiperiodic  orbit  on  a  2-torus. 
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Fig  2.  The  ui32-oscillator  under  G  with  F=0.1601. 
(a)  Phase  plot;  (b)  Amplitude  and  angle  over  T  660, 


Fig  4. 


Phase  plots  under  (>3  with  !•  0  G727. 
(a)  T  9600;  (b>  T- 108(10.  <c)  T- 12000 


rig  5.  Schematic  view 
ol  chaotic  transition. 
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THE  STABILITY  OF  DIFFERENCE  SCHEMES  OF  A  PARABOLIC  EQUATION 
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Abstract— This  paper  proposes  a  new  melhodtto  improve 
the  stability  condition  of  difference  schemes  of  a  parabolic  equa¬ 
tion.  Necessary  and  sufficient  conditions  of  the  stability  of  this 
new  method' are  given  and  proved.  Some  numerical  examples 
show  that  this  method  has  some  calculation  advantages. 


I.  Introduction 


For  thc.parabolic  equation, 


p  u 


+  —  +  — y)-+  J(x,y,z,t),  (x,y,z)  efl,  o  <7 

ay  »z 


u(x,y,z,t)-  o,  (x,y,z)er,  o<t<iT 
u(x,y,z,o)-<pCt,y,  s),  (x,y,z)cti 


u> 


where 

0-  {  (x,y,e)|0  <  x  <  1,  0<  y<  1,0  <  z  <  1},  r-  afl, 

a  is  a  positive  constant,  many  feasible  difference  schemes  were 
constructed  on  difference  computation  of  the  initial  and  bound¬ 
ary  problenTby  many  authors.  When  we  use  and  explicit  differ¬ 
ence  shcemc  to  computate  the  problem  (1),  the  step  is  limited 
greatly  in  order  to  satisfy  stability  conditions. 

This  paper  proposes  a  new  method  that  a  fixed  space  step 
and  alternative  time  steps  arc  adopted  in  an  arbitray  choosing 
explicit  difference  scheme  to  improve  stability  conditions  for  ex¬ 
plicit  difference  schemes  which  are  used  to  solve  the  parabolic 
equation  (1.1).  According  to  general  idea,  stability  conditions  of 
the  explicit  scheme  should  be  satisfied  on  each  time-level.  As  a 
matter  of  fact,  it  is  not  necessary.  When  we  adopt  suitable  stable 
and  unstable  schemes  alternately,  then  it  finally  leads  to  a  stable 
scheme.  In  this  paper  we  give  and  prove  the  improved  stablity 
conditions  which  are  much  better  than  the  stability  conditions  of 
the  classical  explicit  scheme.  Therefore,  we  can  increase  the  time 
step  in  practical  calulation,  finish  calculation  work  in  less  time 
and  bring  calculation  advantages  of  explicit-schemes  into  full 
play. 


II.  Sufficient  and  Necessary  Condition  of  Stability 

We  can.usc  a  lot  of  kinds  of  explicit  schemes  to  calculate  the 
equation  (1).  Here  we  use  the  simplest  classical  explicit  difference 
scheme  to  calculate  the  problem  (1),  and  then  improve  stability 
conditions  step  by  step. 

The  classical  explicit  difference  scheme  of  the  equation  (1)  is 


c-<r 

+u*  +t/‘  +w‘ 

^ a  '  r*  i.a»  T  T  /.»•  i/  T  /tvi; 

X 

+ UL , +  ul-t~  6ulJ+C  m  A  - 1 

u  u~’r>LJ, 

W-  0.-“,  N 

where  t  is  a  time  step,  h  ■=  1  /  N  is  a  space  step,  N  is  a  positive  l.i 
teger  number,  fj1^, «=  f{ih,jh,!h,ki),  ^jGh.jJi.lh).  Set 

r“at/h’'  >Vc  easily  have  that  the  stability  condition  ol'  the 


scheme  of  (2)  is 


r4 


(3) 


Then  we  consider  alternative  explicit  difference  scheme  of 
the 

problem  (1). 

£/* 

i.tt  u  a  .  *  »  t  ,  i 

~x~  "  ~  ^i*u+  t,i-i.u+  U  u  +  ,-u 

+  UUi  +  t/ui-|-60  +  -C>  i+1+l-odd  number. 


£/  *  * 1  —  tJk 

t.l*  4*1  0  /,,»*!  ,  ,  „**> 

— .. - +  y„.,,+  ult_u 

+  U  w! !  +  V l. j'- 1  ~  6f/ 111 ' >  +  f  +  j+  I-  earn  number. 


(4) 


Set  ^  ^  * c »,r>s  ^  w|)c)1  j+J+j  jia  odd  numbeti 

utiivm^2e  1  J  ’  ,  when  i+j+1  is  an  even  nuber, 
and  use  separated  variable  method  to  find  a  stability  condition 
of  scheme  (4)  The  sufficient  and  necessary  condition  of  scheme 
(4)  is 

1 


'•’S-j 


(5) 


Finally,  in  this  paper  we  adopt  a  Fixed  space  step  h  and  use 
time  steps  TjOnd  T,alternatcly.  If  we  use  r2in  odd  time  levels  and 
t|in  even  time  levels  and  two  levels  arc  considered  as  a  whole,  the 
following  conclusion  for  improving  stability  conditions  can  be 
obtained. 

Theorem  1.  To  the  equation  (1),  when  the  time  steps  t2and 
t|arc  alternately  used  to  difference  scheme  (4),  the  sufficitcnt  and 
necessary  conditions  of  stcability  arc 

R,>6R,  |3/t,  < !»»?,+  I 

and(inlRl5’by!2RJ  (6) 

/?J-  16/?  |  —  576/?  j  ^  U  I/?  j  —  16/?  J  —  576/t]  >  U 


(/> 


/?  J  —  16/?  j  —  576/?]  J 
whcrer)  »  ot,  /  h\  rJaox}/ h’,  R,‘*rl  +  r},  R,  or,  r, 


Proof.  First,  we  prove  that  the  sum  of  the  areas  (1)  and  (II)  is  the 
necessary  stability  conditions. 

When  the  time  steps  i2and  t,arc  alternately  used  to  the 
homogeneous  scheme  of  difference  scheme  (4)  and  two  levels  arc 
combined  into  a  whole,  a  new  augmented  matrix  is 
1  —  6r 


r,  - 


2r,r 


tr  l+iro 

, + 6,  I+v; 


1  —  ftr 

?r  C  1 

5 

l 

°i  d, 

2  r 

1  Mr’c* 

- 

,+6V;(|-^>r 

2+6r( 

Cs 

where 


(7) 
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C  —  cosffji  +  cojjjA  +  cosffjA, 

-,-0VfrI)(l-6r1)+^-a-fci)  , 

4r1rJC!(l  -  6rt>  2r1C( 1  +  4rjc,)0:+  4r‘c’> 

*»"  l_+6r,  +  (1  +  6r-)0’-+  6r?)  1 

2r  ,C(i  -  6r  )(1  -  6r  )  2e  C(1  -  6r.)(l  +  4 r'c’) 

C‘“  I  +  6r,  +  (l4-6r1)(i  +  6r!)  ’ 

l+4r?CJ 

V^cd-er^+ar.c-j-j^- 

Thc  characteristic  equation  of  the  matrix  (7)  is 

A,-(a,  +  61M  +  a16J-cj</J-0  (8) 

The  sufficient  and  necessary  conditions  for  the  roots  of  quadraic 
equation  (8)  to  be  |A|<  1  arc 

aJ4-<-3|<Sl  +  aJ61-cJ</J«2  (9) 


By  considering  the  inequality  of  (9),  the  arcus  which  satisfy 
Von-Neumenn  conditions  is  (6). 

In  the  Foiling  we  will  verify  that  (6)  is  the  sufficient  stability 
condition  of  scheme  (4). 

For  eigenvalue  A, of  the  matrix  G,  there  is  a  corresponding 
unit  eigenvector  C|.  Then  from  c,,  we  can  get  an  orthonomul  ba 
sis  CuCjin  C^space.  Set  U  =  (c,,c2),  it  is  easy  to  know  that  U  is  a 
unitary. 

Since  eigenvalues  of  similar  matrixes  aic-samc,  we  have 

ft  '^(C1  +  eft +•••+*, c’  +  cv 

° 

I  jis  a  uniformly  bounded  nuber  when  R,and  Rjsatisfy 
the  condition  (6).  We  denote  this  bounded  number  by  M„. 

|<1-«ei)(l-6rJ)| 


G‘  ~U\ 


Since  M , 


(14-6rt)(l  +  6r.) 


:  I.  we  have  min 


(9.,  [,  X.  J)sS  v/m,  <1. 


For  any  arbitrary  a.  There  is  a  eigenvalue  whose  absolute 
value  is  less  or  equal  to  the  other  eigenvalue  on  absolute  value, 
we  might  as  well  suppose  that  {,  [<  {2  j  From  above  discus¬ 
sion,  we  get 


3  "  J  a  <2  4- 


l(7*]2isa  uniformly  bounded  nuber  on  a  and  a. 

The  whole  theorem  is  proved. 

Since  the  stability  condition  of  the  implicit-explicit  scheme 
with  explicit  form  is  r<  1  /  3,  we  cun  know  that  it  is  stable  only  it 
r|+r2<2/  3  when  a  uniform  time  step  is  used.  Above  discussion 
shows  if  Rtand  Rjfcorrcspondcnt  r,and  r2)  are  chosen  to  satisfy 
condition  (6),  we  will  get  a  stable  difference  scheme.  From  ((>}, 
2  • — 

we  can  sec  rf  +  r,  <  ~  (2+  v‘  5  )tn  general. 


a  space  step  h=l/20,  mesh  ratios  arc  r,-2.53  and  r2=  0.178, 
time  step  T|  =  2.53h1/  a  and  r20.178  h5/  a(a  isa  positive  constant 
number). 

We  use  difference  scheme  (4)  to  calculate  approximate  solu¬ 
tions.  We  use  the  mesh  ratio  r,when  k  is  a  odd  number  and  we 
use  the  mesh  ratio  r2whcn  k  is  an  even  number. 


Table  1  Values  of  Difference  Solution  uf,  ,c 


X] 

i  \ 

Z  4 

6 

8 

10 

2 

0.415  0.841 

1.167 

1.365 

1.435 

4 

0.841  1.577 

2.189 

2.561 

2.694 

6 

1.167  2.189 

3.304 

3.551 

3.734 

8 

1.365  2.561 

3.551 

4.156 

4.270 

10 

1.435  2.694 

3.734 

4.370 

4.586 

Because  of  the  symmetry  of  the  initial  value  and  calculating 
scheme  in  this  example,  the  difference  solution  is  also  symmetry 
in  x,  y  and  z  directions.  The  table  1  only  shows  a  quarter  of  the 
numerical  values  in  z  —  1 .  „  plane.  From  the  table  1,  we  can  see 
that  the  difference  solutions  arc  convergent. 

In  me  iollowing  we  use  the  alternate  explicit  scheme  (2)  to 
calculate  the  same  example.  We  still  choose  space  slep  hi,  2b 
and  a  mesh  ratio  be  the  uniformly  largest  stable  ratio  r^  I  .  3. 
So  the  time  step  is  t«=h2/  (3a).  The  computational  results  arc 
show  oil  table  2. 

Table  2  Values  of  Difference  solution  u^m 
Nsl  Z  4  6  8  iu 

2  U.487  0.922  1.262  1.476  1.549 

4  0.922  1.745  2.388  2.795  2.933 

6  1.262  2.388  3.268  3.824  4.104 

8  1.476  2  795  3.82d  4  *74  4.696 

10  1  549  2.933  4.104  4.696  4  029 


By  the  comparison  ol  Fable  1  ano  tattle  i.  we  xuovv.  the  dif- 
fcicncc  solutions  of  the  eighth  level  in  time  direction  which  arc 
solved  by  the  method  proposed  h*  'his  papoer  have  fastci 
convergence  than  the  aifteicncc  solutions  of  the  thirty-second 
level  in  time  direction  which  arc  solved  by  the  alternate  c-.plict 
scheme  (2).  i.c..  the  lime  step  of  the  mew  method  can  be  chosen 
lout  limes  mou-  than  the  largest  stability  lime  step  ol  the  old 
method.  So  we  only  spent  one-fourth  the  computational 
amount  ns  before  to  get  the  same  result  in  ihe  situation  of  no 
raising  Conipualioua!  complexity. 

Remark.  The  method  proposed  in  this  papci  can  be  used  to 
any  explicit  scheme  to  improve  stability  conditions. 


111. Numerical  Example 


Example:  Consider  the  homogeneous  problem  of  initial  and 
boundnrv  value  proMepi  (1). 

V tx.y.z) * 640xyzU  x)vi  -ylil  - /./, 
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Abstract;  To  design  an  hypersonic  aircraft  by 
experimental  way  only,  would  be  unacceptable 
because  of  the  difficulties  and  so  of  the 
induced  cost.  We  have  to  rely  on  a  mix  of 
theoretical  (CFD)  and  experimental 
approaches.  The  methodology  of  design  with  CFD 
rely  on  check-points  based  on  levels  of 
software  and  on  levels  of  validation  of  the 
codes  used  in  design,  major  targets  of 
preliminary  CFD  effort  is  to  demonstrate  to 
the  customer  that  one  has  confidence  in 
computertools  and,  so,  in  the  results  of 
computation.  Actually  CFD  is  the  only  way 
to  build  complete  engine  integration,  to  share 
responsabilities  between  cooperants  and  to 
clarify  interface  problems.  On  air  intakes 
the  effort  has  to  cover  performance 

evaluation;  prediction  of  flow  field  quality 
(steady  and  unsteady) ,  and  effects  of  start 
and  unstart  of  supercritical  flows. 

Introduction 

The  higher  the  Mach  number  is,  the  higher 
will  be  the  necessity  of  integration  of  the 
shapes  due  to  the  smaller  area  between  the 
bow  shock-wave  and  the  vehicle.  The  use  of 
CFD  may  afford  a  decisive  progress  if  its 
analysis  capabilities  are  sufficient. 

It  is  only  with  such  a  CFD  integration  that 
hypersonic  air  intakes  can  be 

efficiently  designed1?1 

On  one  hand  we  will  present  CFD  requirement^1 
to  better  understand  the  air  intake/air 
frame  interactions,  on  the  other  hand  we  will 
propose  a  methodology  of  air  intake 

integration  by  CFD,  supporting  by  an  example. 

CFD  Requirements  and  checking 

A  complete  capability  is  required  for 
global  evaluation  of  performance  and  for 
analysis.  Such  an  analysis  is  better  done  with 
reduced  CFD  effort  on  not  too  complex 
configuration  and  on  elementary  box  devoted 

to  some  phenomena  that  have  to  be  mastered. 
But  for  global  evaluation,  we  need  the 
complete,  hence  highly  complex  geometry  and 
the  ability  to  cope  with  the  more  complex 
physical  modelling  (turbulence  +  real  gases^J 
The  requirements  can  be  summarized  in  the 
following  table  : 

Table  I  Requirements  for  CFD W 
A  -  Physical  modelling  level  required 

-  real  gases  +  chemistry 

-  laminar-transitional-turbulent  flows 

B  -  Basic  phenomena  to  be  included 
with  accuracy 

-  shock-boundary  layer  interaction 
problems 

-  shock-shock  crossing  and  shock  impingement 

-  turbulent  viscous  interactions  problems 

-  unsteadiness  of  flow  with  separation 

-  reattaching  flows 

-  vortical  flows 

C  -  Basic  geometry/boundary  conditions  to  be 
handled 

-  rou..Jed  nose,  complex  topology  of  fuselage, 
wing,  air  intakes 


-  lips  and  boundary  layer  diverters,  corner 
flows 

-  airflows  at  entrance  of  engines  and/or 
thermal  blocage 

-  bleed  and  succion  devices 

-  variable  geometry  devices. 

Concerning  the  complex  configurations,  we 
have  to  check  a  minimum  number  of  mesh 
points,  required  for  the  correct  rebuilding 
of  the  flow-field. 

One  can  validate  the  code  by  using  it  on 
elementary  problems,  as  it  is  used  in 
.industrial  application-  or  by  using  it  on 
generic  shapes  that  do  not  include  the 
maximum  complexity  of  real  geometry,  but 
include  all  the  ingredients  of  the  complexity 
of  the  flow  one  by  one,  at  least  in  one  of 
the  subdomains. 

For  the  global  validation,  the  direct 
analysis  of  the  flow  field  has  to  check  that 
all  the  features  of  the  flows  are  present, 
as  it  is  in  experimental  tests  and  that 
the  induced  level  of  pressure  or  heat  fluxes 
is  inside  experimental  scatter  of  data. 

The  requirement  for  efficient  CFD 
code  has  to  cover  the  items  listed  in 
following  table  : 

Table  2  Requirements  for  code  assessment 

-  multidomain  approach,  including  analytical 
regular  domains  compatible  with  validation  of 
fluid  problems. 

-  multigrid  and  ability  to  check  convergence 
with  mesh  size 

-  automatic  mesh  refinement  for  complex  flow 
and  geometry 

-  alternative  physical  modelling  (physical 
properties  as  state  equation,  viscosity  ...) 

unsteady  Navier-Stokes  with  alternative 
average  turbulence  modelling  when  needed  but 
able  to  return  to  Prandtl  assumption 
boundary  layers  Euler  flow  on  subdomains  as 
numerous  as  possible. 

-  interface  with  geometrical  definition  to 
check  the  accuracy  of  geometrical  modelling 

-  portability  on  various  computers 

Methodology  of  air  intake  integration 

Taking  into  account  the  flight  envelope  in 
Mach  number,  angle  of  attack  and  sideslip, 
it  is  clear  that  massflow  adjustement,  to 
avoid  any  external  perturbation  becomes  an 
untractable  task.  The  major  part  of  CFD 
effort  will  be  devoted  to  out  of  adaptation 
computations. 

However  the  basic  adaptation  remains  a 
design  way  to  reduce  the  bad  interactions. 
So  the  current  methodology  will  go  from 
fitting  the  geometrical  shapes  to  some 
design  points  to  making  an  evaluation  of  an 
operation  out  of  adaptation. 

An  efficient  way  of  making  analysis  of  the 
forces  building  is  to  deduce  from  the  area 
distribution  along  X-axis  and  from  the  drag 
distribution  an  equivalent  Cp  ratio  (the  drag 
variation  to  the  section  variation  ratio) .  The 
integral  of  this  curve  (  CpdA)  gives  the 
evaluation  of  the  thrust  or  drag  of  a  given 
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configuration,  if  we  know  the  pressure 
everywhere  thanks  to  CFD.  It  is  convenient  to 
part  external  and  internal  flows  in  such  an 
analysis.  External  flows  give  contribution  to 
drag  including  lift-induced  drag;  internal 
flows  must  follow  Cp  versus  A  (Area)  curves 
not  far  from  the  monodimensional  isentropic 
or  poly tropic  flows  in  air  intake.  Three 
dimensional  losses  appear  as  a  loss  against 
optimum  monodimensionnal  flows. 

So  we  get  an  exact  evaluation  of  all  the 
contributions  to  the  propulsive  loop  if  we 
get  the  pressure  everywhere  on  the  complete 
aircraft.  Such  a  set  of  data  is  clearly  the 
necessary  base  for  final  integration 
evaluation.  It  comes  directly  from 
CFD  capability  on  complex  configurations 
to  rebuild  the  complete  pressure  distribution 
including  the  lips  with  the  boundary  layer 
region  where  measurements  are  scanty. 

Example 

As  an  example  of  such  an  approach,  some 
results  obtained  from  EULER  and  boundary  layer 
computations,  on  Star^l vehicule  (hypersonic 
aircraft)  are  presented  on  the  following 
figures.  Fig.l  presents  the  initial  mesh 
before  refinements,  on  Fig. 2  is  presented  a 
cut  into  the  symmetry  plane,  showing  the 
different  shocks.  From  the  pressure 
distribution  given  by  computations,  we  deduce 
the  evolution  of  the  equivalent  Cp  versus  the 
area  for  the  internal  and  external  flow  (see 
Fig. 3).  These  curves,  which  the  integral  gives 
the  total  drag  or  thrust,  show  how  the  air 
intake  integration  has  to  be  done  with  the 
best  accuracy. 

Concluding  remarks 

Integration  of  air  intake  by  CFD  is 
the  only  way  to  improve  thrust  minus  drag 
and  selecting  of  viable  candidates  to 
detailed  experimental  analysis  in  wind  tunnel 
and  after  that  in  flight.  From  now  an 
efficient  methodology  seems  possible  if  a  CFD 
capability  of  taking  into  account  accurate 
complete  geometry  is  available.  It  has  been 
fixed  that  at  present  state  of  the  art, 
progresses  have  to  be  done  on  two  directions  : 

-physical  modelling  improvement  by  carefull 
evaluation  of  experimental  tests,  done  or 
to  be  done.  For  advanced  workshops,  a  main 
emphasis  is  on  carefull  experimental  test 
with  better  and  more  complete  set  of  data. 
-  first  reference  tests  to  improve  or  extend 
CFDW  capabilities  to  identify  unsteadiness 
or  transitional  flows  in  air  intake,  in  order 
to  predict  the  boundaries  of  correct 
operation  and  the  margins  associated  with 
the  catastrophic  degradation  of  the  flow 
quality.  Furthermore  the  flow  unsteadiness  has 
to  be  clearly  evaluated  at  the  edge  of 
present  CFD.  However  transition  phasis 
in  the  flow  building  around  the 
configuration  can  be  obtained  by  CFD  and  its 
validation  is  a  major  challenge  at  the 
present  time.  Unsteadiness  evaluation  and 
validation  remain  a  target  for  the  near 
futur^?* 
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Abstract  A  comparative  numcncalstudy  of  two-dimensional  wake 
dynamics  is  presented.  An  application  to  the  free  wake  motion  behind  an 
elliptical  loaded  wing  on  the  Tkefltz  plane  is  considered  first.  The  wake 
motion  is  approximated  cither  by  the  dynamics  of  a  set  of  vortices  (vortex 
method)  or  by  the  dynamics  of  a  piecewise  linear  curve  (boundary  element 
technique).  In  both  approaches  some  considerations  about:  the  time  inte¬ 
gration  accuracy  control  are  made  in  terms  of  the  most  sensitive  flow  first 
integral:  the  Hamiltonian.  Two  types  of  the  vorticity  generation  mecha¬ 
nism  are'tested  in  the  second  part  of  the: paper  where  the,  application  to 
the  flow  around  a  lentil  at  large  incidence  in  an  uniform  stream  is  analyzed. 
Some  aspects  of  the  coupling  between  the  vorticity  production  and  the  wake 
interaction  are  discussed  in  order  to  explain  the  periodic  vorticity  shedding. 

1  Introduction 

In  the  present  paper  we  perform  a  comparative  analysis  between 
two  different  discretization  techniques  for  the  wake  dynamics,  the 
vortex  method  and  the  boundary  element  method.  In  particular  we 
consider  a  free  wake  as  well  as  the  two  wakes  generated  by  a  lentil 
in  an  uniform  stream  at  large  incidence.  The  latter  case  gives  the 
opportunity  to  investigate  the  interaction  mechanism  between  the 
wakes. 

As  a  preliminar  case  we  take  into  consideration  the  dynamics  of  a 
free  wake.  In  particular  we  develop  a  numerical  study  for  the  motion 
of  a  vortex  sheet  behind  an  elliptically  loaded  wing  on  the  Trclftz 
plane.  A  large  emphasis  is  placed  on  the  time  integration  accuracy 
control. 

A  study  of  the  wake  motion  behind  a  lentil  at  large  incidence  is 
carried  out  in  the  second  part  of  the  paper.  This  case  is  complicated 
by  the  coupling  with  the  vorticity  production  whose  model  is,  in  turn, 
strongly  dependent  on  the  wake  dynamics.  Typically  the  interaction 
between  the  upper  and  lower  wakes  leads  to  a  periodic  vorticity  shed¬ 
ding.  We  have  adopted  two  discrete  approaches  in  order  to  study  the 
kinematic  of  the  flow  field  about  the  body.  i.c.  conformal  mapping 
and  boundary  elements. 

2  Erce  wake  dynamics 

The  vorticity  field  of  a  2 D  wake  is  given  by 
rlt 

w(z,t)=  /  7((o-«)S  {pc  -  xe(t,<rt))  dir i 

Jo 

in  which  71  is  the  derivative  with  respect  to  the  current  natural  pa¬ 
rameter  St  of  the  circulation  rj(sj)  on  each  circuit  around  the  wake 


arc  C,  1(0,,,)  and  8  is  the  Dirac  measure  on  £s.  This  vorticity  field 
induces  the  velocity 

(L, 

VxtfCt  :  ti(r,  t)  =  /  7i(<7()A  (x~xe(t,<rt))d<rt 
Jo 

where  K  =  V^G  is  the  Biot-Savart  kernel  and  G( x)  =  —  /o<7|i|. 

*JT' 

This  field  has  a  jump  across  the  wake  given  by 
(«]  =  ItT  , 


and  the  use  of  the  tangential  wake  velocity. definition 

+  V) 

leads  to  the  classical  Birkhoff  initial  value  problem  for  the. wake  mo¬ 
tion  [4].  Its  numerical  integration  is  carried  out  employing  a  prelim¬ 
inary  kernel  treatment  that,  avoiding  the  computation  of  a  Cauchy 
integral,  simplifies  the  overall  discrete  representation  of  the  wake.  If 
K *  is  the  new  kernel  we  consider  the  “treated”  initial  value  problem 

(  dj^-  =  j[Vw(*,«o) -*?(*, «tt))ibM<fatt  (1) 

i  *1(0,  So)  =  z°(so)  . 


Following  the  classical  vortex  method  approach  we  make  here  a 
convolution  of  the  physical  kernel  with  a  suitable  cutoff  function  in 
order  to  remove  its  non-integrablc  singularity  in  zero.  We  consider 
two  forms  of  treatment  which  lead  to  the  desingularizcd  kernel 


t€je+  ,K?:'(x)  = 


2*  |x|J  +  e‘ 


=  K{x) 


1- 


and  to  the  regularized  (by  gaussian  functions)  kernel  (1) 

SeZ*  ,  Krsei‘n(x)  =  K(x)(  I  -  £  bke-'tl$)  with  £>  =  1  . 

\  fc=i  /  fc=i 

In  the  following  we  indicate  by  K?  both  the  desingularizcd  and 
the  regularized  kernel,  where  p  identifies  with  t  and  6  respectively. 

The  wake  is  approximated  with  a  set  of  vortices  (Vorticity  Blobs 
method)  or  with  a  straight  panel  representation  (Boundary  Elements 
technique).  In  the  former  case  we  study  the  vortex  dynamics  by  per¬ 
forming  an  approximate  integration  of  the  following  ordinary  differ¬ 
ential  system  of  A Tvb  equations 


dxY° 

dt 


Nvd 

£r /*;(*r*-zP) 


j=t 


*rB(o)  =  *°(4) 
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where  P  is  the  circulation  around  the  j  —  th  vortex.  In  the  second 
approach  we  study  the  evolution  of  the  piecewise  linear  curve  approx¬ 
imating  the  wake  by  following  the  motion  of  its  vertices.  This  leads 
to  the  system  of  Nbe  equations 


where  It  is  assumed  constant  along  any  panel. 

A  direct  evaluation  of  the  numerical  time-integration  accuracy  in 
both  VB  and  BE  discrete  approaches  is  possible  computing  suitable 
quantities  related  at  some  flow  first  integrals.  From  our  numerical 
experience  we  deduce  that  the  most  sensitive  flow  invariant  is  the 
Hamiltonian  defined  by 

K  e  f0L,do,ltV) ['do"it{o")G'f  (*;(t,V)  -  x'c[t,o»))  (2) 

in  which  for  the  two  above  choices  of  Kp  the  smoothed  Green’s  func¬ 
tions  are 


It  worths  to  point  out  that  HpD'4  is  also  a  first  integral  for  the 
discrete  vortex  model  whereas  MfE''  is  not  a  stationary  quantity.  In 
fact  the  flow  maps  a  set  of  point  in  a  set  of  points  but  it  does  not 
transform  a  set  of  straight  segments  in  a  set  of  straight  segments. 
Hence 


daPE‘' 

where  up  is  the  approximate  self-induced  velocity  field,  while  — - — 

ot 

is  its  linear  interpolation  given  by  the  BE  description  of  the  wake 
motion.  The  numerical  integration  of  the  above  equation  allows  for 
a  control  of  consistency  between  the  wake  velocity  field  and  its  dis¬ 
placement  by  comparing  with  the  numerical  vaiucs  obtained  by  th-. 
corresponding  discretized  form  of  (2). 


Fig.l  Wake  configuration  os  interpolating  curve  of 
the  vortex-blob  positions  (e  —  0.05) 


3  Wake  dynamics  past  a  lentil 

The  above  numerical  techniques  are  applied  to  the  simulation  of 
the  flow  around  a  lentil  placed  in  an  uniform  stream  at  large  inci¬ 
dence.  To  this  aim  we  have  to  introduce  models  for  the  velocity  field 
about  the  body  and  for  the  vorticity  production  at  the  sharp  edges 
where  the  separation  occurs. 


Wc  apply  the  previous  techniques  to  the  numerical  simulation  of 
a  wake  shedded  from  an  elliptically  loaded  wing  on  the  TrcffU  plane 
(see  ftg.l).  As  already  described  in  t4j  (where  a  VB  approach  with  a 
dcsingularization  of  the  Biot-Savart  kernel  was  used),  both  discrete 
approaches  for  a  fixed  smoothing  parameter  p  lead  to  a  converge..!, 
numerical  solution  of  equation  (1)  with  respect  to  the  refinement  of 
both  the  initial  space  discretization  and  the  time  integration  step. 
Then  it  is  possible  to  find  for  any  p  a  well  defined  limit  solution,  but 
unfortunately  the  resulting  sequence  for  p  — *  0+  docs  not  converge. 
However,  as  shown  in  [4j,  the  loss  of  convergence  appears  confined  in 
a  smaller  and  smaller  neighbourhood  of  the  sheet  tips.  These  calcula¬ 
tions  show  that  the  time  integration  accuracy  control  requires  a  very 
large  computational  effort  for  the  BE  approach,  whereas  it  results 
simple  and  fast  for  the  VB  formulation  In  fact  the  VB  approach 
appears  faster  than  the  BE  formulation  even  if  the  time  integration 
accuracy  control  is  neglected. 


Velocity  field  representation 

The  first  task  is  reached  by  folluwing  two  different  paths,  the  confor¬ 
mal  mapping  analysis  [2]  and  the  Poincare  representation  [3j. 

In  the  former  way  the  field  external  to  the  body  (z  plane )  is 
mapped  m  the  exterior  of  a  unit  circle^  plane)  by  the  Karman- 
Trcfftz  transformation.  The  wakes  arc  discretized  with  a  suitable  set 
of  vortices  (to  be  considered  points  out  of  the  flow  field)  and  the  mo¬ 
tion  of  the  k  th  vortex  is  obtained  by  a  numerical  integration  of  the 
equation 

rk  1  \ds\  IT kd  / «ff \ I 

dl  d{\  2xi !  ik)  dz\tl  22xidg  \dsj\fk 
together  with  the  smoothing  procedure  joj  for  the  vortex  interactions. 

Using  the  Poincare  representation  we  decompose  the  velocity  field 
in  the  sum  of  a  uniform  translational  flow  u-o  plus  a  pcrtubation  field 
u  generated  by  the  presence  of  the  body.  The  limit  of  this  field  on 
the  body  is  obtained  by  solving  the  integral  equation 
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iUr(0  -  f  u,b)K(S  -  n)  ■  r^)d>{ri)  = 

«  JdCio 

/  t»co  •  ^(<?)^(?  -  !j)  • 

n=l  •,W"(I) 

where  (r,r/)  is  the  intrinsic  reference  system  on  the  body  boundary 
(Sflfl)  and  IVi.iCt)  is  the  configuration  of  the  wake  X  and  2  respec¬ 
tively.  In  the  computational  procedure  the  two  issuing  wakes  may  be 
discretized  either  by  VB  or  by  BE  technique. 

Production  of  vorticity 

When  a  vortex  discretization  of  the  wake  is  adopted,  we  consider 
two  different  schemes  for  the  production  of  vorticity.  In  the  first 
one  (used  only  in  the  conformal  approach)  the  nascent  vortices  are 
placed  on  the  symmetry  plane  of  the  body  at  a  small  distance  from 
the  corresponding  edge  and  their  intensity  is  fixed  by  imposing  a 
finite  velocity  at  the  lentil  edges.  In  the  second  one  (adopted  also  in 
the  Poincare  formulation)  we  follow  the  motion  of  a  neutral  particle 
which  starts  from  the  body  edges  with  velocity 

u,=  ±(u(P+)-fu(p-)) 

(where  P*>_  are  points  near  the  edge  on  opposite  sides  of  the  wake) 
during  a  suitable  time  interval.  Hence  we  assign  a  circulation  around 
the  particle  obtained  by  integrating  the  vorticity  generated  in  that 
time  interval.  A  similar  approach  is  adopted  also  with  a  panel  dis¬ 
cretization  of  the  wake,  but  the  amount  of  shedded  vorticity  is  scat¬ 
tered  along  the  nascent  panel. 

In  the  present  numerical  simulations  we  assume  the  incidence  of 
the  lentil  sufficiently  large  to  have  two  separation  points  located  on 
the  body  edges.  Two  wakes  arc  produced  behind  the  body  and  their 
interaction  plays  an  essential  role  in  the  flow  field  development:  the 
main  effect  is  a  periodic  wake  detachment  that  leads  to  the  formation 
of  the  typical  vortex  street  shown  in  fig. 2. 

The  comparison  between  the  conformal  mapping  and  the  Poincare 

description  of  the  velocity  field  gives  a  good  agreement  with  respect 

to  certain  global  flow  quantities  such  as  the  body  circulation  T  or 

the  time  history  of  — ,  even  by  assuming  different  vorticity  pro- 
at 

duction  mechanisms.  From  this  comparative  analysis  the  method  of 
the  neutral  particles  appears  more  sensitive  to  the  velocity  pertur¬ 
bations  near  the  edges  than  the  finite  velocity  approach.  Moreover 
the  comparison  between,  the  two  wake  disretizations  has  shown  an 
equal  mean  behaviour  with  some  superposed  oscillations  that  appear 
more  persistent  for  the  BB  technique,  owing  to  the  wake  continuity 
constraint. 

The  flow  resulting  from  an  impulsive  starting  evolves  towards  a 
periodical  one  after  a  short  initial  transient.  This  periodicity  is  forced 
by  the  process  of  interaction  between  the  wakes,  shown  in  fig. 2,  that 
can  be  summarized  as  follows.  Alternatively  one  wake  (say  1)  rolls  up, 
and  leaves  the  generating  edge  inducing  the  convection  of  the  other 
wake  (say  2)  into  the  region  between  the  first  one  and  the  body.  The 
motion  of  the  wake  2  leads  to  a  strong  local  stretching  of  the  wake  I  up 


to  its  breaking  in  a  region  close  to  the  edge.  When  the  velocity  field 
induced  by  the  lower  wake  (see  fig. 2b)  is  sufficiently  high  to  detach 
one  or  more  elements  from  the  upper  wake  the  above  phenomenon 
is  accompanied  by  the  convection  of  these  elements  up  to  the  lower 
edge.  This  kind  of  interaction  leads  to  the  formation  of  several  small 
clusters  in  which  the  elements  coining  from  the  upper  wake  couple 
with  some  elements  of  the  lower  wake.  The  presence  of  these  clusters 
in  the  neighbourhood  cf  the  edge  influences  the  local  velocity  field 
and  delays  the  new  formation  of  the  lower  wake.  Moreover  their 
effect  on  the  vorticity  production  mechanism  enhances  the  oscillatory 


behaviour  of  — ,  even  if  a  separation  of  this  effect  from  the  self- 
dt  j 

induced  one  is  difficult.  We  observe  this  mechanism  only  for  the 

lower  edge,  while  it  may  occur  also  at  the  upper  edge  only  for  large 

incidence  of  the  lentil. 

In  order  to  reduce  the  CPU  time  we  adopt  a  coalescence  pro¬ 
cedure  of  the  far  wake  regions  replacing  a  duster  of  wake  elements 
with  a  single  vortex.  At  the  present  time  the  effects  of  this  approx¬ 
imation  are  not  completely  understood:  it  seems  that  this  causes  a 
little  reduction  of  the  drculation  rclased  and  a  short  delay  in  the 
time  history  of  the  circulation  around  the  body.  Also  the  choice  of 
the  coalescence  parameters  (and  obviously  the  choice  of  the  proce¬ 
dure  itself)  is  very  critic  because  wc  have  experimented  that  this  can 
influence  the  vortidty  production  in  a  very  subtle  way. 


b)Circulotion  shedded  cl  the  leading-edge  (dotted  line), 
trailing- edge  (solid  fine)  end  global  circulation  around  the 
wakes  (dash-dot  line) 
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Finally  carrying  out  several  other  calculations  with  different  in¬ 
cidences  it  appears  a  monotonic  decrease  of  the  vorticity  shedding 
frequency  for  growing  incidence  which  obviously  vanishes  when  the 
lentil  is  normal  to  uw.  We  have  also  analyzed  the  flow  field; for  dif¬ 
ferent  values  of  the  lentil  thickness  at  a  fixed  incidence  of  60°:  the 
shedding  frequency  decreases  monotonically  with  the  lentil  thickness 
up  to  reaching  the  flat  plate  frequency.  This  behaviour  appears  es¬ 
sentially  due  to  the  increasing  distance  between  the  wakes  that  slows 
down  their  interaction. 
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Abstract-Analytic  solution  for  forced  convection  heat 
transfer  from  an  impulsively  started  heated  sphere  is 
investigated.  Because  of  the  impulsive  start,  there 
is  a  singularity  at  the  very  beginning  of  the  motion. 
The  accurate  analytic  solution  for  the  initial 
temperature  field  is  obtained  by  solving  the  non¬ 
linear  energy  equation  using  the  method  of  matched 
asymptotic  expansion  to  the  third  order.  The 
solution  is  in  terms  of  exponential  function  and  error 
function.  The  time  development  of  the  temperature 
field  is  plotted  and  investigated.  The  local 
Nusselt  number  over  the  sphere  surface  and  the 
progress  of  minimum  Nusselt  number  point  with  time 
are  obtained. 

I.  INTRODUCTION 

The  problem  of  incompressible  viscous  flow  over 
an  impulsively  started  sphere  has  been  studied  by 
many  investigators  (Bentwich  and  Miloh,  1978).  The 
extension  of  the  problem  to  the  heat  transfer  has  also 
been  the  popular  subject  of  numerous  analytical 
and  experimental  investigations  (Chen  and  Mucoglu, 
1977).  Several  theoretical  investigations  have  been 
reported  centering  around  the  classical  problems 
of  heat  and  mass  transfer  from  a  solid  sphere  into  a 
low  Reynolds  number  velocity  field.  Sano  (1981), 
Bentwich  and  Miloh  (1978)  obtained  the  asymptotic 
solutions  for  Stokes-Oseen  flow  using  the  method 
of  matched  asymptotic  expansions.  Acrivos  and 
Taylor  (1962)  used  singular  perturbation  technique 
expressed  the  Nusselt  number  in  terms  of  Peclet 
number,  and  yielded  a-1  accurate  expression  for  the 
rate  of  transfer  of  energy  for  small  Reynolds 
number.  Hieber  and  Gebhart  (1969)  studied  mixed 
convection  from  a  heated  sphere  for  Stokes  flow. 

Chen  and  Mucoglu  (1977)  solved  the  conservation 
equations  of  the  non-similar  boundary  layer 
using  finite  difference  method  to  study  the 
combination  forced  and  free  convection  about  a 
sphere  for  small  Reynolds  number. 

In  this  study,  we  try  to  employ  the  inner-outer 
expansion  method  to  solve  the  axisymmetrical  unsteady 
Navier-Stokes  and  energy  equations  in  an  attempt  to 
ex*---'d  the  boundary  layer  theory  to  larger  Reynolds 
numbe’-.  The  stream  function  for  the  initial  flow 
obta  .ned  by  the  matched  asymptotic  expansion  to  the 
l hi- i  order  (Chien  and  Chen,  1984)  is  used  to  solve 
the  energy  equation.  The  analytic  solution  to  the 
third  order  for  the  temperature  distribution 
corresponding  to  the  initial  flow  field  is  treated 
with  great  care  because  of  the  complicated 
mathematical  operation.  The  temperature  field  is 
thus  obtained  in  terms  of  exponential  and  error 
function.  The  time  development  of  the  temperature 
field  properties  such  as  the  local  Nusselt  number 
over  the  sphere  surface,  and  the  progress  of  minimum 
Nusselt  number  point  with  time  is  investigated. 

II.  BASIC  EQUATIONS 

Consider  a  solid  sphere  of  radius  rg  which  is 
started  impulsively  from  rest  and  subsequently  moves 
with  constant  velocity  U.  The  origin  of  the  spherical 
coordinate  system  is  fixed  at  the  center  of  the 
sphere  with  the  axis  0=0  in  the  direction  opposite 
to  the  motion  of  the  sphere.  Assume  that  the  fluid 


is  an  incompressible  viscous  continuum  with  constant 
properties,  and  that  the  effects  of  the  heating  of 
the  fluid  by  viscous  dissipation  from  sphere  surface 
is  neglected.  With  the  foregoing  assumption,  the 
Navier-Stokes  equation  for  the  fluid  motion  can  be 
expressed  in  the  form  (Chien  and  Chen,  1984)  as 

3  e  3<Ji  3  3ty  3  3^-2  3t(i 

[ - _( - +2cot0 - )  ]  V2i|< 

3t  r2sin0  30  3r  3r  30  3r  r  30 

=  ae27l,i!>  (1) 

where  t  is  non-dimensionalized  by  the  characteristic 
time  t0,  radial  coordinate  r  by  the  radius  of  the 
sphere  ro,  stream  function  by  CqU.  The  parameters 
are  defined  by  e=Uto/r0,  a=  l/(eRe),  where  Reynolds 
number  is  based  on  radius.  For  the  problem  of  initial 
flow,  c  Is  a  small  eqantity  much  less  than  1  and  u 
is  order  1.  The  boundary  conditions  are  non-slip 
at  the  surface  of  the  sphere,  and  the  uniform 
free  stream  conditions  far  from  the  sphere. 

The  flow  field  is  divided  into  two  regions. 

One  is  the  inner  region  close  to  the  sphere  surface 
and  the  outer  is  the  outer  inviscid  region,  i.e. 

<■  qjO  +  .  The  outer  solution  to  the  third  order 

for  the  stream  function  is  obtained  by  Wang  (1969). 

The  inner  solution  to  the  third  order  by  the  melnod 
of  inner-outer  expansion  is  given  by  Chien  and  Chen 
(1984).  The  composition  stream  function  is 

11  T  1  3t  _  2 

ip=  — (r2 — )  sin2  6+3 - [ - 1 - (/2-1+-— )cos0 
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- +( — e  n  -qerfcn)+ — [  (n2+~ )erfcq-  e  J 

2r  /Re  /5T  /Re  2  ™ 


3  +  v/? 

+—  S(n)cosO)  sin20  +  2( — •) 
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n  5  3  T 

[/  f]  (-n)drr(2n3 —  n2-*— n)J  sin20+18 
o  /^  2  Re 


n  l  t  i 

If  g3(n)dn (1-/2- — )njsin20  cos0+27t2-— 

0  /f  9t  /Re 


n  n 

[2/  f3(n)d  sin20cos2  +  f  ^  F3(n)dnsin40) ,  (2) 

where  n  is  defined  by  (r-l)/2/oF,  T  is  dimensionless 
time  and  S(n)  is 

3  _  a  2/2  1  7 

S» — e"n  erfcn - erfc/3i-i)erfc3ry— —  (-+ 

/7  /?  /T3 
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And  fj,  f3,  F3  and  g3  are  polynomials  o£  tha  similar 
forms. 

In  order  to  solve  the  energy  equation  to  obtain 
the  temperature  field  for  the  convection  problem 
considered,  the  equation  is  written  as  (Chien  and 
Kung,  1982) 

3  e  3ifi  3  3ij  3 

H-- - ( - - )]T 

3t  r2sinO  36  3r  3r  30 

ae2  32  cotO  3  1  32 

Pr  3r2  r2  36  r2  302  ^  ^ 

where  dimensionless  temperature  T  is  (T‘  -  Tm)/(Tw/T  ), 

T'  is  dimensional  temperature,  and  T„,  T  are  the 

w  <» 

temperature  on  the  sphere  surface  and  at  infinite 
respectively.  When  Che  sphere  is  impulsively  started 
to  move  with  a  constant  velocity,  a  constant 
temperature  difference  between  the  solid  sphere  and 
the  fluid  is  suddenly  imposed.  The  initial  and 
boundary  conditions  are 

T  ”  0  for  t  <  0  (4a) 

T  =  1  at  r  =  1  for  t  >  0  (4b) 

and  T  +  0  at  r  +  »  for  t  >  0  (4c) 

III.  ANALYTIC  SOLUTION  FOR  THE  TEMPERATURE  FIELD 

Similar  to  the  problem  of  convective  heat 
transfer  over  an  impulsively  started  circular 
cylinder  (Chien  and  Kung,  1982),  we  construct  the 
,  solution  for  the  temperature  field  by  the  method  of 
additive  composition.  Sano  (1978)  has  shown  that 
the  outer  solution  for  the  energy  equation  vanishes 
concerning  the  heat  transfer  for  the  flow  over  an 
impulsively  started  cylinder.  The  conclusion  is 
also  valid  for  the  sphere  problem  considered  in  this 
investigation. 

It  can  be  shown  that  the  inner  solution  is  of 
the  form. 

T1  =  Tj  (R,  0,  t)  +  eT2(R,  6,  t)+e2T3(R,  0,  t) 

where  R  is  the  stretched  radial  coordinate  and 
defined  by  R  =  (R-l)/e.  Substituting  the  above 
expression  into  (3)  and  collecting  the  terms  of  Che 
same  order  e,  we  have  the  equations. 


Tit  -  T1RR  =  0 

T2t  "  T2RR  -  < 


T2e  "  T2RR  “  ^10TlR+,;'lRT10)sit10 

T3t  "  (a/Pr)  T3RR  “  “ (T109-cot6TlO5/Pr+ 


(*20^K-2k4Tn^>2R-4rie+ 

2K'f'lRTl0"*lRT20^sin6‘ 

for  the  first,  the  second  and  the  third  order 
respectively. 

And  the  boundary  conditions  for  the  above 
equations  are 

T  (R,0,c)  =  1  at  R  =  0 

Tn(R,0,t)  *  0  at  R  »  0  for  n  »  2,3, 

T  (R,6,t)  ♦  0  at  R  +  *  for  n  =  1,2,3. 


that  obtained  by  Sano  (1978)  solving  the  convection  of 
cylinder  problem, 

Ti  =  erf  p  (9) 

where  p  is  /Pt"  n  and  n  is  the  inner  stretched  variable 
n  =  R/(2/at).  Substituting  the  first  order  solution 
(9)  and  the  inner  stream  function  into  the  right  hand 
side  of  the  second  order  equation  (6),  one  has 

_  _  2 

T2t-aT2RR/Pr  =  -6/Pr[ (p-l/n)e  n  erfcn 


+  e  ^  //tT ) //rT 


where  f  =  /Pr+lp .  Assume  the  solution  for  T  be  of 
the  form  T2  =  tF2(p)cos0.  Then  the  equation  (10) 
becomes 

F2,,(n)+2PrF2,-4PrF2  =  24Pr  [  (n-l/5T)e“n2 
2  *  ^ 

-ne”11  erfcn+e  n  / /rT ]  /Pr/71 .  (11) 

The  homogeneous  part  of  equation  (11)  is  of  the  form 

f"(n)+2n£'-2n£  =  0.  (12) 

The  solution  may  be  in  terms  of  error  function  and 
Hermlte  polynomial  (courant  and  Hibert,  1953,  p.90). 

The  particular  integral  for  (11)  is  obtained  by  the 
method  of  undetermined  coefficients.  Then  we  have 
the  complete  solution. 

6(2Pr+l)/Pr  __ 
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(3Pr+l) 

2  2 
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(13) 

where  C2  =  12(Pr+l)2Pr/[it(3P+l)]  and  l(n)  0 

•n  -u2 

I(q)  =  /  e  erfcndn. 

0 


The  right  hand  side  of  equation  (7)  is  function 
of  derivatives  of  the  first  and  the  second  order 
expansion.  Substituting  (9)  and  (13)  into  the  right 
hand  side  of  equation  (7),  we  have 

T3t-(xT3RR^Pr  “  (M31(n)+M32(Il))cos0 
+[M33(n)+M3^(n)Jcos0 
+tM34(n)+M35(n)]sin0  (14) 

where  the  coefficients  of  the  triangular  functions 
are  polynomial  of  error  and  exponential  function. 

We  assume  the  solution  of  Equation  (14)  be  of  the 
form 

T3  =  3>,atPr/H8F3^(n)ifr32(n))tcos0+[9/Pr/TtF33(n) 

+  3F36(n)]t2cosz6+[-9>/Pr/t!F3i;.(n) 

+  F35(n)/2)Jt2sin20.  (15) 

Substituting  the  above  expression  into  equation 
(14),  it  gives  set  of  six  equations  in  of  the  form 


The  solution  for  the  first  order  is  similar  to 
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F"(n)+2PrqF'-2nPrF 

■  GH(er£cn,  exp(-n2),  exp(-p2)) 


(16) 


The  completementary  solution  o£  (16)  is  able  to  be 
expressed  in  terms  of  error  function  and  Hermite 
polynomial.  And  the  particular  integrals  are  obtained 
by  the  method  of  undetermined  coefficient.  The 
complicated  mathematical  operation  is  repeated  with 
great  care. 

To  sum  up,  the  solution  of  the  energy  equation  is 

T  =  erfcp+rF2(n)cos8 

+  [F31(n)+3x/TPr/(iiRe)  F32(n)]cos6 
+r2[9t/Pr/aF33(n)+F36(n)]cos29 
+T2[-9/P?/7!F3A(n)+F35(n)/2]sin26.  (17) 

where  F2(n),  F3^  to  F3(-  are  polynomial  of  error 
function  and  exponential  function 

IV.  RESULTS 

The  temperature  fielf  (17)  is  plotted  in  Figure  1 
for  Re  •*  100,  Pr  °  0.7.  At  short  time  after  the 
impulsively  start,  the  isotherms  in  the  front  half 
part  are  almost  parallel  to  the  surface  of  the  sphere. 
As  time  goes  on,  at  t  =  0.6,  the  isotherms  displaced 
away  from  the  sphere  as  the  viscous  layer  thickens. 
Similar  phenomenon  is  shown  in  Figure  2  for  Re  =  500, 
Pr  <=•  0.7  at  t  =  0.6.  the  higher  the  Reynolds 
number,  the  thinner  the  thermal  boundary  layer 
because  the  convection,  becomes  more  effective  in 
displacing  the  streamlines  downstream  away  from 
the  sphere. 

Having  computed  the  temperature  field,  we  can 
estimate  the  heat  transfer  between  the  sphere 
and  the  surrounding  fluid. 

Nu  -  -KOT/3r)r=1. 

The  local  Nusselt  number  distribution  around  the 
surface  of  the  sphere  for  Pr  =  0.7  at  Re  =  100 
and  500  is  shown  in  Figure  3.  Because  no  existing 
investigation  is  available  for  comparison,  we 
compare  the  trends  of  this  solution  with  those 
obtained  in  studying  cylinder  by  Sano  (1978) ,  Chien 
and  Rung  (1982).  The  similar  results  are  obtained. 

We  differentiate  the  Nusselt  number  distribution 
function,  set  it  equal  to  zero,  and  find  the  minimum 
Nusselt  number  point.  By  Newton's  method,  we  can 
obtain  the  progress  of  minimum  Nusselt  number  point 
at  the  sphere  surface  with  respect  to  time.  Figure  4. 

V.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  major  objective  of  the  present  investigation 
has  been  to  work  out  the  short  time  solution  for 
unsteady  forced  convection  heat  transfer  from  an 
impulsively  started  sphere.  Because  of  the 
impulsive  start,  there  is  a  singularity  behavior 
of  the  flow  field  at  the  very  beginning  of  the 
motion.  An  accurate  solution  is  obtained  by  the 
method  of  asymptotic  expansion  to  the  third  order. 

The  expansion  is  valid  for  the  short  time  only,  r  <  1. 
The  viscous  layer  considered  flow  field  (Chien  and 
Chen,  1984)  and  temperature  field  obtained  in  this 
investigation  can  be  used  as  initial  conditions  for 
numerical  computation.  And  the  solution  can  be 
continued  by  numerical  integration  to  obtain  the 
larger  time  solution  (Schlichting,  1979,  p.  149). 
Using  the  accurate  stable  numerical  method  to  solve 
Che  governing  equations,  we  can  depict  the  time 
history  of  the  flow  patterns  and  the  temperature 
fields. 
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Figure  2.  Isothermal  for  Pr=0.7  at  Re=500> 
Time=0.6. 
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Figure  3(b).  Nusselt  number  distribution  on  sphere 
surface  for  Pr=0.7  at  Re=500. 
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Figure  3(a).  Nusselt  number  distribution  on  sphere 
surface  for  Pr“0.7  at  Re=100. 
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Figure  4.  Progression  of  minimum  Nusselt  number 
point  with  time. 


NUMERICAL  SIMULATION  OF  THREE-DIMENSIONAL  LAMINAR  AND 
TURBULENT  FLOWS  OVER  BODIES  OF  ARBITRARY  SHAPE 
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117526  Moscow,  USSR. 

Abstract-  The  analysis  and  generalization  of 
known  algebraic  models  of  turbulence  have 
been  caried  out  for  three-dimensional 
boundary  layer  computations  the  supersonic 
flow  over  finite,  twisted  wings,  taking 
into  account  the  effects  of  aerodynamic 
heating  and  heat  radiation.  The  results  of 
heat-transfer  prediction  are  in  good 
agreement  with  experimental  data. 

Supersonic  laminar  flows  at  moderate 
Reynolds  numbers  have  been  simulated  on  the 
basis  simplified  Navier-Stokes  equations  by 
space-marching  method,  combined  with  global 
pressure  itarations.  The  generalization  of 
known  parabolization  technique  for  equations 
in  subsonic  regions  of  the  flow  and  new 
algorithms  of  relaxation  of  the  pressure  are 
suggested.  The  results  of  three-dimensional 
shock  layer  computations  over  blunt  bodies 
are  presented. 


I .  INTRODUCTION 

In  recent  papers  on  numerical  computation 
of  viscous  gas  flows  it  has  been  shown  that 
the  calculation  efficiency  may  be  enhanced 
by  using  the  boundary-layer  methods  and  app¬ 
ropriate  scales  both  in  complete  Navier- 
Stokes  (N.-S.)  equation  and  simplified  N.-S. 
composite  asymptotic  equations,  namely  vis¬ 
cous  layer  (VL)  and  viscous  layer  with  azi¬ 
muth  diffusion  (VLAD)  equations  . 

The  application  of  boundary  layer  (BL), 
VL  and  VLAD  equations  and  space-marching 
algorithm  along  the  dominant  direction  of 
the  flow,  combined  with  the  global  pressure 
iteration  allows  a  tremendous  reduction  in 
necessary  computing  time  and  storage 
requirements  over  that  required  for  time  - 
dependent  approach  for  N.-S.  equations. 

II.  LAMINAR  FLOWS 

We  shall  write  the  simplified  Navier  - 
Stokes  equations  in  arbitrary  curvalinear 
coordinate  system  in  strictly  conservative 
form. 

Let  Y  ,  Y  ,  Y  be  Cartasian  coordinates; 

1  2  3  2  3 

X  ,  X  ,  X  2  x,  Y,  Z  -  curvalinear  coordina¬ 
tes  of  a  point  M.  Let( us  introduce  covariant 
a  and  contravariant  a1  basisies: 


3y  3y  3y 

a  -  f  -1-1  -12  1 
a,  -  '  .>  T'  i  >  > 


3x*  3x*  3x* 


a’  = 


3x*  3x*  3x* 

{  ) 

3y2  3/3 


than  components  g  ,  9* 5  of  metric  tensor 

can  be  expressed  as  follows: 
g(j  =  aj  •  aj  ;  g  3  =  a  •  aJ 
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RIZHOV  YU. A.,  SCHEKIN  G.A. 

Moscow  Aviation  Institute 
Volokolamskoe  highway  4 
125871  Moscow,  USSR. 

Let  us  denote  g  =  detl  I  g(jll  and  consider 
vectors  a*  ,  a^  at  two  points  M  and  Mq, 
employing  index  zero  for  point  M  . 

°  J 

We  shall  introduce  the  coefficients  Gk 

G^(M,Mo).  =  a^  •  ak  ,  than  gJ(Mo,Mq)  =  5^ 
We  shall  use  operators  Lyl  and  LvUD  for 
LVL(f)  =  0  ,  byLAD(f)  =  0  ,  where  f  =  (u1, 
u2,  u3,  p,  h)T,  velocity  vector  $  =  u'e^  + 

u2a  +  u3a  =  u'a  =  u  a 1 .  The  summation  on 

2  3  11 

repeated  indexes  is  usualy  assumed,  if 

exception  is  not  noted. 

L(f)  =  —  (AJ(f)  -  - - 2-  (4JS  ~  +  ¥J)) 

3xJ  Re  dxl  dx 

Here  j=s=3  for  VL  and  j,s=1,2,3;  s=*j  *  .1  for 
VLAD  equations.  Components  of  vectors  K  -  ( 
A'  )T  and  matrices  1 1  $Jsl  I  for  the 

point  M0can  be  written  as  follows  : 

(index  zero  is  omited),  u  s  u,  u  s  v,  u  s  w; 

A*2  A,  A2s  B,  A33  C,  x‘s  X,  X2a  y,  x3s  z; 

A^=g‘ (pgJk+puJuk)v/g,  1,  j,k=1 ,2,3,  p=~^-ph 
h^pu'i/g,  A^puJH^g,  H=h+E,  E=  -j-g^u1^ 

( $ Js )  =v/gG‘  ( ;? gJk5s+pg J 3Gk-pg J 3Sk+pgks ( GJ-5 J ) ) 

Id  k  D  D  D  n  D 


($JS),  =($JS),  =($JS)  =0,l,m=1,2,3,  N=1 ,  . 

14  15  4N 

($jB)  =  v/g(pg  gj3u1(Gk-Sk)+pu3(GJ-SJ)  + 

bO  Kl  Q  d  -DO 


($JS)S5  “  ^  fr  gJ5; 


5J=^gG*  ( p'  g J  V^^5+pg  Jsu‘ — -+pgk3u‘ — -) 
1  k  3x”  3x*  3xs 


,3GJ 


5 


3Gk  ,  3GJ 

$J=0,  =v/g(g  g^u'u1  — -  +pu3u  — -  )■ 

4  _ 5  kl  3xs  3xs 

here  p'  is  second  viscosity  coefficient. 

We  use  approximate  formulae  for  compo¬ 
nents  a| ,  A*of  vector  A1  as  follows  : 

Ai  =  ^G*  (pu1uk+gkl^r1p+gkl  (l-Zj  )Pg)  0> 

A*  =  vyg(pu1(h^2+E)+  -j-  u1  (I-^JP^) ,  (2) 

where  X2  are  special  functions  discussed 

below  and  P  is  a  part  of  pressure,  that 
i  .  . 

is  assumed  to  be  known  from  previous  glo¬ 
bal  iteration.  If  xl=X2=  1 ,  or  p  =  P  ,  than 

formulae  become  exact.  For  stability  of 
space-marching  algorithm  is  sufficient,  that 
u*  >  0  and  *,=  uiFi(Mi,M2,z2);  Uj<  ' ,  Xz>  0 
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Here  F  =  1 ,  if  >  1  +  e  and 
+  (y-1)b  (M.-MJ 

F  = - - - - - - — - — ,  if  Hs1«,  0<e«1 

1  X2  +  (Vi  )  b  )  1 

bi  =gi2MiMj+gj3MjM3v/g33gJ  i '  I’5J=VuJuJ/ (c2gJ  - ) 
j=1,2,3  without  summation. 

The  method  in  question  has  been  tested  on 
computations  viscous  shock  layer  over  blunt 
cones  and  swept  infinite  wings.  The  results 
are  in  good  agreement  with  known  data. 

Fig.  1  shows  the  distributions  of  shock 
layer  thickness  (x)  and  thermal  flux 
coefficient  Ch(x)  along  infinite  swept  wing 
R(x)  =  V2x7TT+xJ  at  swept  angle  60°  for  flow 
M  =  10,  Re  =  50.  The  results  are  presented 
for  global  iterations  of  number  N  =  1 ,  N  =  5 
(curve  2)  and  N  =  10  (dots).  It  is 

sufficient  at  average  N  =  10  to  obtain  the 
convergence  to  10“3. 

Figures  2-3  refer  to  the  flow  M  =  6; 

CO 

Re  =  3500,  Hh=0.35.  Fig.  2  shows  the  distri¬ 
butions  of  thermal  flux  Ch(  xjr  y  )  and 
azimuth  skin  friction  coefficient  C  (x  ,  y) 

r  2  J 

for  sections  xs=  0.83,  x2=  3.43,  X3=  5.19 

(  lines  1,  2,  3  respectively  )  along  the 
azimuth  coordinate  y:  0  s  y  s  jr.  Dash  line 
and  dots  are  presented  Cn  and  C F2  at  x  =  0.8 

for  bielliptic  cone  \  =  0.1,  where  surface 
of  blunt  cone  has  been  done  by  the  equation: 

z  =  R(x,y);  R(x, y )  =  VA2sin2y  +  B2cos2y 
A  =  cos  ac+  (x-xQ)tgo<c,  xQ  =  1  -  sin  a<. 

B  =  cos  ac+  (x-xQ)tg  /3cl(y), 
l(y)  =  1  for  Oiysrr/2,  l(y)  =  X  for  n/zsysn 
III .  TURBULENT  FLOWS 

The  computations  on  windward  side, 
slender  plane  delta  wing  65-sweep,  sharp 
leading  edges  have  been  carried  our  for  BL 
equations,  including  laminar,  turbulence 
transition  and  turbulent  regions  of  flow. 
The  solution  of  Euler  equations  has  been 
obtained  by  Godunov  method. 

Effects  of  turbulence  are  incorporated  by 
specifying  viscosity  coefficient  according 
to  three  turbulence  closure  models  by 
Spalding,  Pletcher  and  Cebeci  with  some 
corrections,  that  have  been  found  in 
accordance  with  experimental  data  for  heat 
transfer  coefficient.  The  anisotropy  of  eddy 
viscosity  investigation  for  Rotta  model  has 
been  developed,  using  Klebanoff  correction 
for  intermittency  at  outer  vorticity  layer 
and  correction  for  turbulent  Prandtl  number 
variation  across  the  boundary  layer. 

The  heat  flux  distribution  over  delta 
wing  surface  is  compared  with  experimental 
data2  Q  in  Fig.  3.  The  windward  side  heat 
transfer  distributions  are  shown  for  section 
z  =0.25  (z  =  z/1;  1  is  semi-span  wing  size). 


Experimental  data  have  been  obtained  in 
TzAGI . 


The  computations  were  made  using  turbulence 
models  by  Pletcher  and  Cebeci,  including 
corrections .  The  results  are  given  at  attack 
angle  of_  15  for  section  x  =  0.33,  0.6,  0.9 
(where  x  =  x/c,  c  is  local  wing  chord) . 
These  sections  correspond  to  region  of 
fully-developed  turbulence  flow. 

The  computed  q  at  section  x  =  0.33  is 
approximately  on  5  per  cent  over  and  at 
x  =  0.9  on  5  per  cent  lower  the 
corresponding  values  of  Q. 

The  computed  values  of  q  for  Cebeci  model 
without  correction_is  on  7  per  cent  lower, 
than  Q  at_section  x  =  0.33,  but  at  sections 
x  =  0.6,  x  =  0.9  the  values  q  and  Q  are  al¬ 
most  the  same.  The  addition  Klebanoff  and 
Rotta  corrections  to  Cebeci  model  has  not 
changed  essentially  the  values  of  q.  The  use 
Cebeci  model  with  correction  of  local  turbu¬ 
lent  Prandtl  number  gives  increasing  of  q  on 

2-4  per  cent.  The  results  of  q  computa¬ 
tion,  using.  Spalding  model  are  approximately 
on  200  per  cent  over,  than  Q. 

The  analysis  of  computed  results  allows 
us  to  modify  Cebeci  model  of  turbulence. 
Instead  of  Clauser  formula  for  outer 
vorticity  layer  the  following  approximation 
is  suggested 

\i  =  k  p  u  6*  , 

.  t  o  K  tl  3-A 

where  is  boundary  layer  displacement 

thickness,  kQ  is  dimensional  constant,  that 

depends  on  kinematic  viscosity  coefficient 
Pj.  The  value  of  varries  along  the  wing 

surface,  but  this  variation  is  not  large  so 
approximation  kQ  =  const  has  been  used. 


Fig.  3. 
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THE  OPTIMUM  SHARE  OF  HYDROFOIL  BENEATH  A  FREE 
SURFACE 


A.H.  Essawy  and  A.Y.Al-Hawaj 


Abstract 

The  usual  assumptions  in  problems  of  the  obstacle  beneath  a  free 
surface  are  taken  as  a  basis:  namely,  the  liquid  is  non-viscous  and 
moving  two-dimcnsionally,  steadily  and  without  voracity,  the  only 
force  acting  on  it  is  gravity.  With  theses  assumptions  together  with  a 
linearization  assumption  we  determine  the  forces,  due  to  the 
hydrofoil  to  obtain  the  optimum  shape  so  that  the  drag  is  minimum. 
Analytical  solutions  by  a  singular  integral  equation  method, 
Duhamel's  method  and  some  approximate  methods  are  discussed  for 
the  linearized  theory. 

I.  Introduction: 

There  is  an  extensive  literature  connected  with  wave  resistance  due 
to  a  submerged  obstacle  [see,  e.g.,  Havelock,  T.H.  (1),  (2). 
Kochin,  N.E.  (3),  Kothcin,  N.E.  (4),  Wehascn,  J.V.  and  LKaition. 
E.V.  (7),  Kreisel,  G.  (5)  and  Riabouchinsky,  D.  (6)]  but  the  three 
papers  which  are  most  relevant  to  present  work  are  those  to  Kochin 
,  N.E.  Kibel,  I.A.  and  Rozc,  N.V.  (3)  and  Wu,  T.Y.  and  Whitney, 
A.K.  (8)  and  Essawy,  A.H.  (9)]. 

A  singular  integral  equation  of  the  boundary  value  problem  is 
obtained  and  can  be  solved  to  yield  expressions  for  the  lift  and  drag 
as  functions  of  the  unknown  singularity  distribution,  y  being  the 
vortex  strength  together  with  the  known  shape,  z  (hydrofoil  slope), 
thesp  expressions  are  given  for  a  hydrofoil  of  arbitrary  shape. 

We  use  variational  calculus  technique  to  evaluate  the  optimum  shape 
of  a  two-dimensional  hydrofoil  of  given  length  and  prescribed  mean 
curvature  which  produces  minimum  drag. 

II.  The  Hydrofoil  Beneath  a  Free  Surface 

A  hydrofoil  of  arbitrary  shape  is  in  steady,  rectilinear  motion  at  a 
depth  h  beneath  the  free  surface  of  a  uniform  liquid  flow  with  speed 
U  in  the  x-positive  direction. 

We  assume  the  liquid  is  non-viscous  and  moving  two-dimensionally 
and  without  vorticity,  the  only  force  acting  on  it  is  gravity. 

The  problem  will  be  solved  on  the  basis  of  linearized  theory  and  for 
this  purpose  we  introduce  the  following  vortex  distribution  on  the  x- 
axis: 


Vortices  of  strength  y(E,)  per  unit  length  in  0<^<a,  y=-h,  (y>0, 
clockwise) 


The  complex  potential  due  to  a  single  vortex  at  (^,-h)  as  follows: 
w(z)  =  -#[ log(££)  +  2civz  J c—  1  ,  [v=g/U2, c  =  ^-ihj.  [2,1] 

Z-C  03  l-C 

The  complex  potential  due  to  a  the  complete  distribution  of  vortices 
as  described  above  will  be 

aY(Py  7.c  °°e''Vsd  s 

w(z)  = .  r  ( iog(L2} .  2  f e— H  )dF  [2.2] 

0  2tu  z-c  0  z+s  -c 


Denoting  the  potential  of  this  steady  motion  by 

W^  +  i'F  [2.3] 

Let  the  x-  and  y-  components  if  the  hydrodynamic  forces  acting  on 
the  hydrofoil  be  denoted  by  drag  D  and  lift  L,  then  the  complex 
forces  acting  on  a  hydrofoil  calculated  within  the  linearized  theory 
arc  given  by 

D+iL  =  J<Ply=o--ply=o+) idz  t2-4i 

a  a 

L-pUJ 

The  boundary  condiuon  on  the  hydrofoil  it  can  be  approximate  to 
z(x)  =  U+u  “  U  v=  '  l-TlTy  ly=-h 


Y(x)dx  ,  D  =  pUj  y(x)z(x)  dx  [2.5] 


where  u,v  arc  the  components  of  liquid  velocity  as  follows: 
-  5<j)  3<I>_  d(f 

U  dx  dx  ,V  dy  dy 


[2.7] 


Using  [2.2]  we  can  write  [2.6]  in  the  form 


with 

t./..  (x’^)  „..  TtCK+s)  sinvs  +  2hcosvs]  ds  „ 

I2'»l 

III.  The  Optimum  Shape  of  Hydrofoil  of  Minimum  Drag 
We  pose  the  problem  of  minimizing  die  drag  coefficient  subject  to  a 
constraint  on  curvature  K,  together  with  a  constraint  on  the  length  of 
the  hydrofoil  1  as  following 

a 

IfrW.iW.z'W.xJ  -  D  1  ?.|1  +  X2K  =  J  Flylxj.nxwtxj.x,  A I  ,X-2i  clx  [3.3J 

with  the  function  F[y(x),z(x),z'(x),x]  given  by 


F[y(x)/(x),z'(x),x,  ?.1>A2]  =  Q  z(xJYtx)  +  >.1V7+z2(x;  +  [3.4] 


where  y,  z  are  related  by  [2.8]  and,  are  Lagrange  multipliers. 
We  define  an  admissible  function  as  any  function  y(xj  which 
satisfies  the  Holder  condition  (pel)  and  we  define  the  optimal 
function  as  an  admissible  function  which  minimize  I[y,z,z,x] 

The  Necessary  Condition  Of  Optimality.  8I[y,4J=0,  [3.5J 

which  yields: 


z(x)  = 


Yfsy  + 


A-izfs) 
V  l+z2(s) 


.-  Tky.  (sjJ  t~ -  +  kts-xjj  ds  =  0  [3.6] 


Tliis  equation  is  a  necessary  condition  for  th  existence  of  an  external 
I[y],  combines  with  the  integral  equation,  [2,8],  to  give  a  pair  of 
singular  integral  equations  which  are  to  be  solved  for  y,z  subject  to 
appropriate  conditions  and  constraints. 


Substituting  from  [2.8]  in 


3.6],  we  obtain 


a 


Us)  (k(s-x)  +  k(x 


-s)]ds  +  J 


k]z(s) 


Vl+7.2(x) 


t2X2z"(s)j  [~+  k(s-x)J  ds 


=  0 


We  consider  the  solution  of  [3.7]  for  the  slope  z(x)  only  in  the  case 
of  small  slope,  and  we  approximate  to  [3.7]  as  follows: 

Now,  we  use  the  method  of  iteration  to  solve  equation  [3.8]  as 
follows: 

We  introduce  function  sequences  of  die  form 


zo.zi.z2 . .Yo.Yl.72 .  [3-9] 

and  the  stages  in  the  iteration  procedure  would  be  as  fllows: 

(a)  First  we  solve 


a  a 

J  U^zijfsl-MotsM^O  .  lo<x)B5^JJj|Yo(*)^  (0<x<a)  [3.10] 


for  y0,z<)  which  gives 


Zo(x)  =  -  F0m0sin  m0x  + 


Co  xsin  m0(x-T) 
2k>(0)mo  0  yj x(a-x) 


[3.11] 


«fE.  s  Zp(s)ds 
11  x  (j  V  a-s  s-x 


[3.12] 


where  F0j  Co  is  an  arbitrary  constants  and  m0  - 


X,<°) 

2h(0) 


(b)  Secondly,  we  solve 
a  a 

J  (27.2z],(s)  -  2.lZ|(s)]|| = g  J  y0(s)  (k(s-x)  -1-  k(x-s)]  ds  - 

a 

J  [2^2Zq(s)  -  X0Z|(s)]k(s-x)  dx, 
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(0<x<s) 

[3.13] 

First  wc  write  the  inversion  of  the  first  equation  in  [3.13]  as 
follows: 

where  cx  is  an  arbitrary  constant  and 


4(s)=f  J  (k(x-s)  +  k(s-x)l  "\J  Ydt  J  \  irt  K-Fonlosinmot  > 

E„  ,lsinm„(t^)d§.  ,  di  f  k(T-S)dT  c  C0 

+m°i  °< 2^(0) 

[3.15] 

Equation  [3.14]  can  be  written  as  follows: 

X,0> 

z]’(x)  +  mfzi(x)  =  F(x),  [m?  =  -  —  —  ,(0<x<a)],  [3.16] 

where 

X  (!) 

it  is  assumed  at  this  stage——  <0  and  we  show  later  that  X/^cO, 

^^>0  are  sufficient  conditions  for  a  minimization  of  the  drag  D. 
Tlte  boundary  conditions  to  be  satisfied  by  zj(x)  arc 

zl(o)  =yi(°)  =  °-  zl(a)  =  yJ(a)=P.  zl(0)  =  0, 
yi(0)=0,  yi(a)=y0,  [p,  y0  prescribed]  [3.18] 

The  solution  of  the  non-homogeneous  differential  equation  in  [3.16] 
which  satisfying  the  boundary  condition  (3.18)  is 


zi(x)  =  yj(x)  =  J  F^lsinm^-xld^  + 


Sk.|^)sinmKVa)d^  P£g  (0<x<a)  [3.19] 

The  function  zj(x)  in  [3.19]  should  satisy  the  constraints,  and  the 
boundary  conditions  zj(o)  =0  and  yi(a)  =y0 ;  in  this  way  we  obtain 
four  unknowns  mj,  Ej,  D0,  and  C0,  which  have  to  b4e  evaluated 
numericaliy.  This  problem  is  resolved  numerically  in  case 
1=4.02  ft,  a=4  ft,  k  =0.0148  ff 1  h=16  ft,  v=0.0093  ft'1 
A  sufficient  condition  for  the  extremum  to  be  a  minimum  is  derived 
from  consideration  of  the  second  variation  of  I  is  52I>0  which  it  can 
be  written  in  the  form 


a  /fit  a  4s  r 

+  —  (  J 


n  .  ns 
“sin—  ds 
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A  DIRECT  SIMULATION  OF  THE.FLOW  AROUND  A  CIRCULAR  CYLINDER 
SINUSOIDALLY  OSCILLATING  ATLOW  KEULEGAN-CARPENTER  NUMBERS 


Papolu  Manikyala  Raoj  Kunio  Kuwahara  and 
The  Institute  of  Space  and  Astronautical  Science, 
Sagamihara-Shi, Kan  aga\va,229,  Japan, 

ABSTRACT-  A  finite  difference  simulation  method  is  pre¬ 
sented  fox  the  viscous  flow  field  around  an  arbitrarily  moving 
boundary.Numerical  solutions  are  obtained  by  directly  integrat¬ 
ing  the  incompressible  Navier-Stokes  equations  of  finite  difference 
form  by-adopting  a  moving  grid  system, based  on  a  time  depen¬ 
dent  coordinate  transformation. Evolution  with  time  of  the  flow 
structures  induced  by  axircular  cylinder  performing  sinusoidal 
oscillation  in  a  fluid  at  rest, by  means  of  vortex  shedding, is  stud¬ 
ied  at  Keulegan-Carpenter  number, AT— 9. 4. The  time  dependent 
drag  and  lift  are  also  explained. 

INTRODUCTION 

The  study  of  two  dimensional  oscillatory  flows  is  of  great  ini 
portance  in  the  design  of  cylindrical  structures  such  as  offshore 
platforms.  Information  about  the  fluctuating  forces  on  an  oscilla¬ 
tory  cylinder  is  of  special  interest  to  fluid  dynamicisls  and  offshore 
engineers.  Several  experimental  investigations  has  been  carried 
out  on  fluid  structure  interaction  problems,  a  good  accounts  of 
which- are  available  in  Bearman,  et.al(1985),  Williamson(1985), 
Sarpkaya(1986)  and  Tatsuno  and  Bearman(1990). 

BASIC  EQUATIONS  AND  NUMERICAL  METHODS 


Kazuhiro  Tsuboi 

Institute  of  Computational  Fluid  Dynamics,  1-22-3, 
Haramac  hi, Meguro-Ku, Tokyo,  Japan. 

The  reference  scales  for  non  dimensionalizations  were 
d,  1  mj  dJ\'mj for  the  length,  velocity,  time  and  pressure,  re¬ 
spectively.  Dimensionless  parameters  are  Reynolds  number  Rt  — 
ImJ/i.  and  Kc  =  VmTfd.  Primitive  variables  are  contravariant 
components  u,  of  the  flow  velocity  vector  relative  to  the  circular 
cylinder  and  pressure  P.  A  subscript  with  (,)  denotes  covariant 
derivative.  The  last  term  in  the  momentum  equation(S)  repre¬ 
sents  oscillatory  acceleration  in  the  x  direction,  in  which  T'  is  the 
transformation  matrix  and  g,}  is  the  metric  tensor. 

The  numerical  techniques  adopted  here  are  based  on  the  well 
known  MAC  method, which  was  orginally  developed  by  Harlow 
and  Welch(1965).  The  Poisson  equation  for  pressure  can  be  de¬ 
rived  on  the  basis  ofMAC  method.The  nonlinear  terms  are  repre¬ 
sented  by  means  of  a.  third-order  upwind  scheme(Kawamura  and 
Kuwahara, 1984), e.g., 

\  _  ^i(/;+2  —  2/;+i  +  9/,-  —  10/;_1  +  2/;_2)/6/l  (Ui  >  0 
1  dx  >'  ~  I/,(-2/;+2  +  10/;+1  -  9/;  +  2 -  /,_2)/6/l  (U;  <  0 

(7) 

The  poisson  equation  for  the  pressure  is  solved  iteratively  by 
employing  a  modified  SOR  method. 

RESULTS  AND  DISCUSSION 


In  the  present  study, we  introduced  the  following  generalized 
transformations  of  coordinates, which  includes  the  time  variables, 
in  order  to  deal  with  moving  boundary  effectively, 

?=?(x,y,t),i  =  1.2,3  (1) 

where  x,y,t  are  the  variables  in  the  physical  domain  and  (£‘,  i  = 
1,2,3)  are  the  variables  in  the  computational  domain.  The  trans¬ 
formation  of  coordinates  and  matrix  are  written  as 

*-  x(e,e,e),z}=^jj=dzi(T;)  (2) 

where  J  is  the  Jacobian.The  metric  tensor  g”  is  given  by 

g„  =7?T;6kh  g  =  det(g<J),  g*  =  (1  /2)*-VmV”Wn,  (3) 

where  S  and  e  denote  the  Kronecker  delta  and  the  Eddington 
permutation  symbol, respectively. 

Consider  a  circular  cylinder  oscillates  in  a  viscous  incompress¬ 
ible  fluid, in  the  direction  parallel  to  x-axis.Instantancous  velocity 
of  oscillation  is  given  by 

K  =  Kmsin(2  ffi/T)  (4) 

where  Vm  is  amplitude  of  oscillatory  velocity, J  period  of  oscil¬ 
lation  and  t  time.The  N-S  equations  for  the  sinusuidal  flow  is 
written  as 


-g'’P,  +  ±/kv:]k-£ccos(2xt)g'>T} 

=  o 


(5) 

(6) 
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The  computations  were  performed  by  a  super  computer  NEC 
SX  2  (1  3  G  flops).  The  epu  time  for  a  single  case  ranged  from  6 
to  10  hs,  depending  on  the  value  of  Re  and  Kc.  The  time  stepping 
interval  was  At  =0.001.  The  motions  of  vortices  around  a  circular 
cylinder  in  relative  sinusoidal  flow  are  very  complicated  and  the 
pattern  of  vortex  shedding  varies  depending  on  the  Kc  number 
and  Stokes  number ,0.  Here  0  =  Re/ Kc.  Contour  maps  of  vortic- 
ity  for  the  case  of  Re=300,1000;Kc=9.4  are  shown  m  figures(l-2). 
It  may  be  noted  that  a  pair  of  small  attached  vortices  are  formed 
behind  a  cylinder  in  a  starting  flow.  When  the  cylinder  reverses 
direction,  the  attached  vortices  split  up  and  pair  with  new  vor¬ 
tices  in  the  new  half  cycle, thus  convecting  away  from  the  local 
flow  region  around  the  cylinder.This  pairing  of  attached  vortices 
occurs  only  at  the  time  of  flow  reversal  between  small  vortices 
which  were  still  attached  to  the  cylinder  just  prior  to  flow  rever¬ 
sal.  Such  a  process  is  shown  in  figure.l  soon  after  the  begining  of 
cylinder  oscillation.  The  attached  eddies  are  split  up  as  the  cylin¬ 
der  moves  downwards, and  they  each  form  a  small  vortex  pair  with 
a  new  small  vortices.  These  small  vortex  pairs  formed  at  flow  re¬ 
versal, where  the  cylinder  reverses  again  and  this  eddy  pairing  re¬ 
peats  itself.  The  pairing  is  resonably  symmetric  initially  (Fig.la) 
and  the  attached  vortices  become  unequal  in  strength  and  the 
vortex  pairs  do  not  form  simultaneously  (fig.lb,2)  upon  flow  re¬ 
versal, giving  rise  to  a  lift  force  of  low  amplitude  fluctuating  at  the 
oscillation  frequency  .This  situation  is  similar  to  the  experimental 
visulisation  of  Tatasuno  and  Berman(1990).The  lime  dependent 
drag  and  lift  for  two  different  Reynolds  numbers  are  shown  in 
figure.3. 
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ABSTRACT 

The  A-formulation  for  compressible  flows  is  extended  to  gas  flows 
with  specific  heat  varying  as  a  function  of  the  temperature.  The  pro¬ 
posed  formulation  is  based  on  a  suitably  specified  function  of  the  tem¬ 
perature,  which  allows  defining  the  Riemann  variables  as  linear  com¬ 
binations,  with  constant  coefficients,  of  the  dependent  quantities.  The 
resulting  equations  are  solved  via  a  fast  solution  algorithm.  A  test 
case  is  worked  out  of  a  nozzle  flow,  evidentiating  the  differences  with 
respect  to  the  solution  for  constant  specific  heat. 

I.  INTRODUCTION 

The  A-formulation  (Moretti  1979, 1987)  has  proved  to  be  a  powerful 
tool  for  the  numerical  solution  of  compressible  flows  of  perfect  gas.  For 
‘perfect’  we  mean  that  the  gas  is  assumed  to  be  both  thermically  and 
calorically  perfect.  The  first  attribute  refers  to  its  obeying  the  perfect 
gas  law,  while  the  latter  denotes  that  its  specific  heat  cp  is  taken  as  a 
constant. 

This  formulation  has  been  successfully  extended  to  finite-rate  chemi¬ 
cally  reacting  flows  (Lcntini  and  Onofri  1986,  1987  A  and  B),  but  still 
with  the  limitation  that  the  component  gases  of  the  reacting  mixture 
are  perfect. 

While  the  assumption  of  thermally  perfect  gas  is  closely  approximated 
in  virtually  all  cases  of  practical  interest,  the  requirement  that  the  gas 
(or  the  component  gases)  are  calorically  perfect  may  be  unsatisfactory 
to  describe  flows  subjected  to  large  temperature  excursions.  Indeed, 
cp  exhibits  a  fairly  large  variation  with  temperature.  For  example,  the 
specific  heat  at  constant  pressure  of  air  varies  by  about  25%  in  the 
temperature  range  300  —  2000°ff . 

In  this  paper  we  extend  the  A-formulation  to  (inert)  flows  of  ther¬ 
mally  perfect  gas  with  cp  varying  as  a  function  of  the  temperature  T. 
Such  gases  arc  sometimes  referred  to  as  imperfect  gases.  The  resulting 
formulation  is  extremely  simple  and  involves  a  limited  computational 
overhead  over  the  perfect  gas  case. 

It  is  applied  here  to  the  computation  of  the  flow  in  a  quasi  one¬ 
dimensional  nozzle  in  order  to  prove  the  workability  of  this  approach 
and  to  cvidcntiatc  the  differences  with  respect  to  a  perfect  gas  com¬ 
putation.  However,  it  will  be  apparent  that  the  range  of  application 
of  the  present  formulation  is  completely  general. 

II.  FORMULATION 

The  formulation  is  presented  here  for  simplicity  for  a  quasi  one- 
dimcnsional  flow. 

We  assume  as  state  variables  the  speed  of  sound  a  and  the  entropy  s, 
and  the  velocity  u  as  the  motion  variable.  Consequently,  the  continuity 
and  momentum  equations,  which  we  write  for  convenience  in  the  form 


Pi  "f"  up*  Az 

a  l£-Z — -f ■  auz  -  -au~ 

P  A 

(i) 

I 

Uf  +  u  Mz  -  px  =  o 

P 

(2) 

will  be  recast  in  terms  of  the  variables  u,  o,  s.  To  this  end,  we  ob¬ 
serve  that  the  speed  of  sound  is  related  to  the  temperature  T  via  the 
relationship 


a*  =  iRT  (3) 

■j  being  the  gas  specific  heats  ratio  and  R  its  constant  Upon  logarith¬ 
mic  differentiation  we  obtain 


a 


111)  1 
'I  )  T 


(4) 


Here  the  prime  denutes  differentiation  with  respect  to  Cither  t  or  zt 
7r  is  the  derivative  of  7  with  respect  to  T.  From  the  first  principle  of 
thermodynamics,  written  for  adiabatic  flows  with  pressure  work  only 


cuT’  =  RT  —  (5) 

P 

one  gets,  in  view  of  (4) 

p<  1  a! 

P  ~  5  (l  +  *2.)  o 

with  the  position  b  —  (7  —  l)/2.  This  expression  will  be  substituted 
in  the  continuity  equation. 

The  pressure  gradient  term  in  the  momentum  equation  can  be  ex¬ 
pressed  by  means  of  the  thermodinamic  relationship 


-p'  =  h'-Ts' 
P 


where  h  is  the  enthalpy;  then,  after  cq.  (4),  with  h'  =  cpT' 


PPZ  ^(ld-2^) 
The  set  of  cqs.  (1,  2)  can  then  be  recast  as 
1 


1 


aaz  -  Tsz 


S{  1+3?) 

U(  +  UUj  + 


/  \  Aj 

(di  d-  uaz )  +  auz  =  -au  — 

1 


aaz  -  Tsz  =  0 


(6) 

(7) 


At  this  juncture,  we  make  the  crucial  remarks  that  the  terms  o'  can 
be  expressed  as  aj  T',  being  a  a  function  of  the  temperature  T,  and 
that  the  term 


1  r/R  cp 

aT  =  —ii~f  =  i 


S  (ld-2^) 


is  solely  a  function  of  the  temperature  as  well.  We  can  thus  define  the 
function 


FV)  =  CC7d0  « 

where  0  is  the  temperature  as  a  running  integration  variable,  and  T° 
is  an  arbitrary  reference  temperature.  Notice  that  the  integrand  is  al¬ 
ways  positive  so  that  the  function  F(T)  is  monotonic  and  can  easily  be 
inverted.  This  definition  allows  expressing  the  terms  in  the  derivative 
of  a  in  cqs.  (6,7)  as 


at 


=  Ft 
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and  similarly  for  the  derivative  with  respect  to  x.  We  can  then  recast 
cqs.  (6,7)  in  terms  of  the  new  variable 


Ft  +  uFx  +  auz  =  fi 

(9) 

u«  +  «ux  +  aFx  -  Tsz  =  0 

(10) 

with  fi  =  -auAz/A.  By  summing  and  subtracting  cqs. 
with 

(9,10),  and 

Ai  =  u  +  a  A2  =  u  —  a 

we  get  the  final  form 

Rit  +  AiAis  —  T  st  =  fi 

(U) 

Rit  +  A2  R2z  +  T  =  fi 

(12) 

having  defined  the  Riemann  variables  as 

Ri  “  F  4*  u  R2  =  F  —  u 

Thus,  the  new  variable  F  allows  the  definition  of  Riemann  variables 
for  imperfect  gas  flows  as  linear  combinations,  with  constant  coeffi¬ 
cients,  of  the  dependent  quantities,  in  analogy  with  the  formulation 
for  perfect  gas.  In  the  case  of  isentropic,  strictly  one-dimensional  flow, 
such  variables  represent  true  Riemann  invariants. 

Further,  the  imperfect  gas  formulation  becomes  formally  identical  to 
the  perfect  gas  one. 

It  is  apparent  that  the  present  formulation  can  be  extended  without 
any  difficulty  to  multidimensional' flows,  by  redefining  the  Riemann 
variables  in  a  similar  fashion. 


with 

T  _  ^2,n  +  ^2,n+l  3  _  At  +  Ai-t-1 

2  2  P  2 

Astride  the  sonic  line  the  accuracy  of  the  algorithm  is  reducedto  first- 
order,  by  setting 

M  -  Ai,n  A2  =  A2>„  fi  =  An 

in  order  not  to  violate  the  domains  of  dcpendance  of  the  variables. 
The  eq.  in  Ri  is  integrated  by  sweeping  in  the  positive  i-direction, 
whereas  the  one  in  R2  is  integrated  by  sweeping  from  the  sonic  line 
to  the  exit  (supersonic  region)  and  from  the  sonic  line  to  the  inlet 
(subsonic  region).  This  algorithm  gives  a  very  fast  convergence  to  the 
steady  solution. 

For  the  case  of  imperfect  gas,  the  procedure  is  initialized  by  first  guess¬ 
ing  the  temperature  field,  and  accordingly  estimating  F  via  the  rela¬ 
tionship 

F  =  F(T)  (13) 

is  in  (8).  The  a  field  is  analogously  initialized  by  means  of  the  rela¬ 
tionship 

a  =  a(T)  (14) 

as  in  (3).  This  allows  computing  Ai  and  A2. 

Then,  at  each  iteration  step  the  new  values  of  Rt  and  R2  arc  computed, 
and  u  and  F  are  updated  as 

Rl  ~  Rt  ri  Ri  +  A2 

u  =  * — -  r  — - ~ - 

2  2 

The  speed  of  sound  is  then  recomputed  as 


III.  SOLUTION  ALGORITHM 

As  an  example  of  the  present  formulation,  here  we  apply  it  to 
the  flow  in  a  converging-diverging  nozzle.  We  limit  our  analysis  to 
the  isentropic  case  for  the  sake  of  simplicity,  and  further  consider  the 
steady  state  solution  only. 

A  semi-implicit  algorithm,  developed  along  the  guidelines  of  Morctti’s 
(1983)  fast  solver,  is  used.  In  this  iterative  technique  cqs.  (11,12)  are 
integrated  separately,  at  each  step,  by  successive  sweeps  all  over  the 
computational  domain. 

The  discretized  form  of  eq.  (11)  is,  with  second-order  upwind  differ¬ 
encing: 


Rl.n  -  Rl.n  .  T  Rl.n  -  Rl.n-l  -3 
~At - +  Al - Tx - =  P 


being  Aj  always  positive  in  the  flow  under  consideration;  the  averages 
arc  defined  as 


T  _  Aj.n  +  Al,n_i  -  fin+fin- 1 

A,_ — - —  fi  =  - 

The  caret  denotes  the  previous  iteration  level. 

As  far  as  cq.  (12)  is  concerned,  we  have  to  make  a  distinction  between 
the  cases  A2  >  0  and  A2  <  0.  In  the  former  case  (supersonic  flow)  the 
discretization  is  analogous  to  that  for  Rf. 


Rl.n  ~  Rl.n  .  V  Rl.n  ~  Rl.n— 1  — 

___  +  AJ - — - =  0 


with 


A2  = 


Az,n  +  A2,n-i 
2 


S  _  A,  +  fin- 1 

0=  - j - 


whereas  for  A2  <  0  (subsonic  flow)  we  get 


a  —  a[F)  (15) 

where  the  argument  of  (14)  has  been  transformed  into  F  by  inverting 
eq.  (13).  Aj  and  A2  can  then  be  recomputed  and  a  new  iteration  cycle 
started,  until  convergence  is  attained. 

The  boundary  condition  at  the  inlet  involves  matching  the  total  en¬ 
thalpy 

•  *  u* 

ho  =  h  +  j 

where  h  is  recovered  as 


h  =  h[F) 


with  the  stagnation  enthalpy  hc,  i.c.: 


(16) 


u* 

he  =  h(R2  +  u)  +  — 

where  F  is  expressed  via  the  value  of  R2,  computed  from  downstream. 
The  above  nonlinear  relationship  i3  iterated  to  get  the  value  of  u  at 
the  inlet. 

Once  the  converged  solution  is  obtained,  the  density  can  be  recovered 
as  a  function  of  F,  via  cq.  (5): 


=  !/r 
R  ho 


m  (17) 


the  pressure  is  then  computed  by  means  of  the  (thermal)  equation  of 
state. 

In  the  present  implementation  the  functions  defined  by  cqs.  (13-17) 
arc  computed  ofT-line  and  approximated  by  4th-order  fits  obtained  by 
means  of  orthogonal  polynomials,  in  order  to  make  the  computational 
procedure  as  straightforward  as  possible. 


Rl.n  ~  Rl.n  ^  j  Rl.n^l  ~  Rl.n  _ 


A! 


Az 


0 
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Fig.  1.  Axis!  profiles  of  velocity  u  (made  dimensionless  with  the 
reference  value  i/RTc)-  Dash-dotted  line,  perfect  gas,  dashed  line, 
imperfect  gas;  solid  line,  nozzle  contour. 


Fig.  3.  Axial  profiles  of  temperature  T  (made  dimensionless  with 
the  reference  value  Tc).  Dash-dotted  line,  perfect  gas,  dashed  line, 
imperfect  gas;  solid  line,  nozzle  contour. 


x/L 


Fig.  2.  Axial  profiles  of  Mach  number  Af.  Dash-dotted  iine,  perfect  Fig.  4.  Decay  of  the  residual  of  the  computation.  Dash  dotted  line, 
gas;  dashed  line,  imperfect  gas;  solid  line,  nozzle  contour.  perfect  gas;  dashed  line,  imperfect  gas. 


IV.  RESULTS 

We  show  here  a  comparison  between  a  calculation  performed  for 
perfect  gas  (with  7  —  lAj  and  the  present  approach  foi  imperfect  gas, 
for  a  critical  flow  m  a  converging-diverging  nozzle.  The  working  fluid 
is  assumed  to  be  ait,  with  caloric  properties  as  a  function  of  the  tem¬ 
perature  accounted  for  by  means  of  the  so-caned  NASA  polynomials 
(e.g.  sec  Gardiner  1984). 

A  nozzle  with  conical  converging  (scmt-angic  4Z" j  and  diverging  (scmi- 
anglc  15  )  sections,  matched  by  a  throat  section  with  a  c  rculai  profile. 

Is  considered.  The  inlet  and  throat  radii  are  0.19  and  w.12,  respectively , 
the  radius  of  curvature  of  the  throat  is  cquai  to  the  trhoat  radius,  and 
the  geometric  expansion  ratio  (exit  to  throat  arcaj  is  5.  The  stagna¬ 
tion  temperature  7)  is  assumed  to  be  2000^ K  ^nutc  that  fut  imperfect 

653 


gases  results  do  not  scale  with  temperature).  Although  at  this  high 
temperature  some  molecular  dissociation  and  formation  of  nitric  ox¬ 
ides  do  occur,  a  chemical  equilibrium  computation  (performed  with 
the  code  by  Reynolds  1381)  shows  that  the  cumulative  mass  fraction 
of  the  ensuing  products  is  less  than  i%,  and  accordingly  in  this  study 
we  negicct  effects  related  to  the  varying  composition.  In  particular,  the 
variation  ■■■  the  average  molecular  weight  turns  out  to  be  absolutely 
negligible. 

A  computational  grid  with  40  nodes  is  chosen  as,  for  perfect  gas,  it 
gives  a  relative  discrepancy  between  the  Mach  number  computed  an 
aiyticaily  and  by  the  numerical  soluviuo  at  convergence  limited  to  a 
maximum  (all  over  the  computational  domain)  of  Z.“%. 

Figure  1  compares  axial  profiles  of  velocity  ufor  the  two  cases  of  perfect 
and  imperfect  gas.  The  nozzle  profile  is  superimposed  on  the  figure. 


In  the  same  fashion  Fig,  2  compares  axis,  profiles  of  Mach  number, 
and  Fig.  3  profiles  of  temperature. 

It  can  be  observed  that  whilr-n  and  M  are  affected  to  a  limited  extent 
by  the  varying  cp,  the  temperature  computed  with  the  imperfect  gas 
model  exhibits  a  much  slower  decay  than  the  perfect  gas  solution, 
owing  to  the  higher  specific  heat.  In  particular,  the  gap  between  the 
two  cautions  at  the  outlet  is  about  200°  K,  thus  underlining  the  need 
to  account  correctly  for  the  caloric  properties  of  the  gas. 

Further,  neglecting  the  effccts  of  temperature  on  cp  leads  to  oversti- 
mating  the  mass  flow  rate  by  4.1%,  and  the  velocity  thrust  by  1.5%; 
accordingly,  the  specific  impulsa  is  understimated  by  2.5%. 

Fig.  4  compares  the  convcrveni'clhistory  of  the  computations  for  per¬ 
fect  and  imperfect  gas.  The  solution  _ I  ...escribing  the 

same  (arbitrary)  Mach  number  distribution  in  both  cases.  It  is  ap¬ 
parent  that  the  solution  algorithm  described  in  Sect.  Ill  gives  an 
extremely  fast  converg  n-e  rate,  with  the  steady  state  reached  in  as 
few  as  30  iterations. 


V.  CONCLUSIONS 

A  simple  formulation  to  effectively  extend  the  A-formulation  to 
imperfect  gas  flows  is  presented  and  tested. 
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The  perfect-absorbing  boundary  conditions 
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The  construction  method  of  the 
perfect-absorbing  boundary  conditions  on  two 
domains  boundary,  on  one  of  which  the  fluid 
motion  is  described  by  linear,  arid  in  .  nother 
one-by  nonlinear  shallow  water  equations, 
have  been  described.  The  approach  proposed 
also  permitts  to  solve  the  problem  on  a  free 
wave  pass  through  the  outer  boundary  out  of 
the  domain  and  the  problem  on  the  reflected 
waves  outgoing  from  the  domain  through  the 
boundary,  on  which  the  disturbances  are 
preset  as  boundary  conditions. 

1 .  With  numerical  simulating  of  long 
waves  propagation  in  water  areas  one  often 
deals  with  the  following,  at  the  first  sight 
"different"  problems: 

Pi’oblem  1 .  let '  s  describe  the  long  waves 
propagation  from  the  source  to  the  shore. 
It's  known,  that  non-collapsing  wave  motion 
along  the  deep  ocean  is  rather  well  described 
by  the  linear  shallow  water  equatioris, 
whereas  at  the  wave  outgoing  to  the  shallows, 
where  non-linearity  effects  become 
significant,  the  non-linear  equations  should 
be  applied.  While  solving  this  problem  it's 
expedient  to  divide  all  the  flow  region  into 
two  subregions  and  on  the  line,  dividing 
them,  to  preset  the  boundary  conditions, 
passing  the  wave  from  the  "deepwater"  region 
to  the  "coastal"  one  without  reflection.  It's 
clear,  that  the  question  is  only  about 
non-physical  reflections,  caused  by 
different  models  "Joint". 


In  spite  of  the  fact,  that  any  computer 
algorithm  for  hydrodynamics  problems  solution 
includes  the  conditions  on  one  or  another 
"transparent"  boundaries,  these  questions  are 
poorly  treated  in  literature. 

The  most  classical  is  the  problem  3. 
The  approaches  to  its  solution  are  cosiaered 
in  the  works  [1],  [2],  [3]  and  in  the  number 
of  others.  The  Sommerfeld  condition  ic 
generally  applied  [13.  The  most  close  to 
ours  is  the  approach,  represented  in  [2], 
[33,  devoted  to  the  conditions  on  the 
outer  boundaries  in  gas-dynamics  problems. 

In  the  present  paper  the  'approach, 
equally  applicable  for  the  problems  1-3 
solution,  has  been  proposed.  This  approach 
works  in  the  oases,  when  one  successes  in 
paravariables  introduction,  which, firstly, are 
perfectly  connected  with  the  medium  physical 
meters,  and,  secondly,  describe  the 
disturbances,  moving  in  the  definite 
direction.  In  the  case  of  one-dimensional 
hyperbolic  equations  set  Riman  invariants  are 
the  best  for  such  an  aim.  The  arises  the 
problem  on  the  complete  outgoing  of 
one -dimensional  and  two-dimensional  problems. 

2.  We  describe  the  obtained  boundary 
conditions,  illustrating,  for  convenience, 
the  problem  geometry  and  shallow  water 
equations  by  the  fig.  1 . 

Riman  invariants  continuity  requirement 
at  the  point  x=x*  can  be  written  as  the 

following  conditions  on  the  boundary  X=X  : 


Problem  2.  Let's  describe  the  wave 
motion  in  the  bay,  caused  by  the  fact,  that 
on  the  boundary,  faced  to  the  sea, 
the  wave  train  is  preset  as  the  boundary 
condition.  Suppose,  that  the  bay  bottom  is 
such,  that  the  reflected  wave,  going  to  meet 
the  bay  entering  one,  begins  to  form  rather 
early.  Thus,  here  the  reflected  wave  out  of 
the  region  through  the  boundary,  on  which  the 
disturbance  is  assigned. 

Problem  3.  With  the  application  of 
finite-difference  methods  for  the  wave 
processes  simulation  in  the  open  water 
reservoirs  the  calculation  is  performed  in 
the  finite  region.  Thus,  here  occurs  the 
problem  on  the  free  pass  of  the  waves,  coming 
to  the  calculated  region  boundary.  The 
boundaries,  possessing  the  property  to  pass 
any  disturbances  wuthout  reflection,  we 
should  call  "transparent"  or  "absorbing". 
These  boundaries  have  no  physical  essence 
and  their  consideration  is  connected  with 
the  method  of  the  numerical  calculations 
performance . 


C,=2[d;(d2+C2)J,/2-2(d2Q?),/2, 


C  1 j  t  linear  eq . 
Ct+(du)a,=0 


X^;  nonlinear  eq. 

!  ut+uV8^=0 

Ct+t(d+C)ula,=0 
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These  formulas  are  considered  to  be  the 
basis  for  finite-difference  algorithms 
construction  while  solving  the  problem  about 
the  solution  joint  on  two  mediums  boundary. 
To  construct  the  boundary  conditions  for  the 
problems  of  the  complete  wave  outgoing 
through  the  outer  boundary  the  auxiliary 
technique  has  been  applied.  Its  main  point  is 
the  extension  of  the  water  filled  domain  by 
the  channel  with  oonstant  depth  bottom,  where 
the  flow  is  described  by  linear  shallow  water 
equations.  This  procedure  results  in  the 
following  boundary  conditions  at  the  point 
x=x^,  where  X=X)t  is  the  left  domain  boundary: 


KVltAUtt* 


ui. -*=*,=  1/2 (r+s)  , 

q x=x*=  Cr-s+4(gd<t),/2  ]2/(i6g)  -  d„  ,  Pig.  2 

* 


£~C(t)  “is  the  height  of  the  v/ave,  given  on 
the  input,  s=s(x<(,t)-is  the  value  of  the 

S- invariant  ,  describing  the  reflected  wave, 
at  worked  out  approach  allows  to  solve  both 
the  point  X=X!f.  Por  the  case  of  the  free 

pass  problem  the  boundary  conditions  on  the 
boundary  x=Xk  situated  on  the  right  of 

domain, assume  the  form: 


*  ‘*.y.G/*C0  y.y^ 

'>»x,y,0/»v(x.y.C>;«  o 


u! 

I  X’-CC 


* 


<1 


x-x 

* 


=  r/2, 

=  Cr+4(gdJJ/2]2/(16g)-d^.d=<i!ix!=a  , 


Pig.  3 


where  r=r(x^,t)  is  r-invariant, describing  the 
wave,  which  will  outgo  out  of  domain  bounds. 

The  main  point  in  the  corresponding 
numerical  algorithms  is  v-  and  s-invariants 
approximate  construction  in  boundaries 
neighborhood. 

During  the  construction  of  analogous 
boundary  conditions  for  the  two-dimensional 
problem  the  assumption  of  the  possibility  of 
such  approximate  flow  description, that  in  the 
limits  of  the  small  discrete  time  intervals 
the  wave  "front"  should  be  straight  and  keep 
its  motion  direction,  was  made.  Por  this  case 
the  application  of  one-dimensional  algorithm, 
worked  out  without  difficulties,  for  the 
two-dimensional  problems  was  a  success. 

The  series  test  calculations, 
demonstrating  the  workability  of  the  method 
proposed  and  a  good  accuracy  of  the  numerical 
algorithms,  has  been  performed.  Pig. 2, 3 
illustrate  the  solutions  of  the  problem  on 
the  wave  outgoing  out  of  the  domain.  The 
waves  surfaoes  for  the  sequential  time 
moments  have  been  shown. 
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A  VORTEX  METHOD  FOR  BLUFF  BODY  FLOWS  AT  LOW  REYNOLDS  NUMBER 
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Abstract-The  impulsively  started  flow  past  a 
circular  cylinder  in  a  uniform  freestream  for 
Reynolds  numbers.  Re  from  200  to  500  is 
computed  by  a  time  splitting  method  to  get 
the  lift.  drag,  and  strouhal  number. 

1. INTRODUCTION 

The  discrete  vortex  method  is  a  long 
established  approach  for  modelling  the 
convection  of  vorticit .y  in  two-dimensional 
problems  of  separated  flow  past  bluff  bodies. 
See  GerrardCll  and  SarpkayaC23.  This  method, 
which  can  now  also  take  diffusion  into 
account.  has  recently  been  extensively 
reviewed  by  Sarpkayat33-  In  the  time¬ 
splitting  method,  the  processes  of  convection 
and  diffusion  are  treated  separately.  Whereas 
Chorine1*!-  and  Smith  and  Stansb.vCS!  use 
random  walk  methods  to  model  the  diffusion, 
Benson  et  al .  C6J  Introduced  and  Burrows  173 
developed  a  vortlcity  re-distribution  method 
in  an  attempt  to  reduce  the  number  of 
discrete  vortices  required  by  the  model  and 
hence  reduce  the  magnitude  of  the 
computational  task.  In  C63 .  after  extensively 
testing  the  parameters  of  the  model  at  Re=U0 
(based  on  diameter),  the  method  was  applied 
to  flow  past  circular  cylinders  for  Re=»20. 
do.  100.  and  200.  The  present  work  describes 
further  development  and  validation  of  this 
approach  for  Re  up  to  500. 

2. MATHEMATICAL  AND  COMPUTATIONAL  FORMULATION. 


The  Navier-Stokes  equations  for  an 
incompressible  fluid  are  expressed  in  non- 
dimensional  form  in  terms  of  the  vortlcity. 
"'S  .  and  the  stream  function. Y  .as  follows 

Re  (1) 


H  +  =  ik  v5 


(2) 


where  t  is  the  time  and  u-(u.v)  are  the 
velocity  components  in  lx.y)  Cartesian 
coordinates  with  origin  at  the  centre  of  the 
cylinder  and  the  x-axis  in  the  freestream 
direction.  Assuming  ?  is  known  at  a  typical 
Instant.  equation  (2)  is  solved  for  <+'  as 
follows.  A  radially  expanding  cylindrical 
polar  mesh  (P.lJ).TK(l))  about  the  cylinder  is 
transformed  into  a  uniform  rectangular  mesh 
(TH( i) , RD( $-) )  by  the  equation 

R(d  )-exp(Cl.RD(,1  )/DRD)  (3) 

where  RD(1>«0. 

RD(d)=P.D(.1-l)*DRD  l  d  =  2 .  3 . NP. )  (8) 

There  are  also  NP.  mesh  points  in  the 

i-direction  of  length  DTH .  where 

DTH»2"rr  / (  NP.-l  > .  (  S) 

Then  the  transformed  equation  (2)  is  sol /ed 
for  on  the  rectangular  mesh  using  the 
Poisson  solver  of  Le  BallC83.  which  requires 
that  NR  is  of  the  form  21'-1 .  NP.-129  is  found 
to  be  a  good  compromise  between  resolution 
and  economy.  After  choosing  the  radial  extent 
of  the  flowfield.  R!NF.)-30.  say.  (3)  gi/es 
Cl-0. 03(123.  R(NP.)  must  be  sufficiently  large 
to  ensure  that  the  grid  always  contains  all 


the  vortlcity  for  the  duration  of  the 
computation.  DRD  is  a  constant  chosen  to  be 
the  same  order  as  DTH.  Next,  the  velocity 
field  Is  computed.  Then  the  known  vortlcity 
field  is  discretlsed  onto  point  vortices 
which  are  convected  by  Eulerian  integration 
for  a  small  convection  timestep.  DTT .  This 
procedure  is  Reynolds  number  independent  and 
so  the  mesh  and  other  computational 
parameters  should  be  Invariant  as  Re  cnanges. 

While  convecting.  it  is  assumed  that  these 
point  vortices  are  diffusing  as  Oseen 
vortices.  After  a  time  t.  a  zero  age  Oseen 
vortex  will  diffuse  a  radial  distance 
(1 .  US36/2t/Re.  (see  SlaoutiC93)  and  so  as  the 
vortex  spreads.  each  part  of  it  will  move 
with  an  increasingly  different  velocity  and 
so  become  distorted.  To  overcome  this  problem 
the  diffused  vortlcity  of  each  vortex  is 
re-discretlsed  onto  new  zero-age  point 
vortices  every  timestep.  DTR.  The  validity  of 
this  approach  was  appraised  in  test  cases 
described  in  [63  and  is  satisfactory  if  DTR 
is  large  enough  to  allow  vortlcity  to  diffuse 
at  least  two  mesh  lengths.  For  a  square  mesh 
of  length  GS,  this  gives 

DTR  >  0.0995. Re. GS2  (6) 
where  Slaouti’ s  result  above  has  been  used. 

The  vortlcity  in  the  flowfield  is  located 
in  two  main  areas.  Firstly,  a  wake  region 
extends  downstream  of  the  cylinder.  This  is 
conveniently  embraced  within  a  grid  of  width 
-5<y<5.  length  -3<x<R(NR>  with  square  mesh  of 
length  GS.  Here.  GS-o.2.  If.  for  example. 
Re-200.  then  (6)  Implies  a  minimum  diffusion 
timestep  of  0.8  in  this  mesh. 

Secondly,  there  is  a  boundary  layer  region 
of  high  vortlcity  around  the  cylinder  of 
approximate  thickness  BL.  say  at  the 
shoulders  of  the  cylinder  where 

BL  «.  3.82/yRe  (7) 
(See  C73  ) .  When,  for  example,  Re-200.  BL-0.27 
and  when  p.e=500.  BL  decreases  to  0.17. 
Although  this  region  is  contained  within  the 
rectangular  mesh.  a  finer  body  fitted  mesh 
allowing  more  resolution  of  the  diffusion 
near  the  surface  and  a  diffusion  timestep, 
DTI  say.  lower  than  for  the  rectangular  mesh 
is  required  in  order  to  calculate  the 
aerodynamic  forces  on  the  cylinder.  In  C63 . 
the  polar  mesh  defined  for  the  convection  is 
also  used  to  apply  the  redistribution 
algorithm  near  the  body.  This  grid  has  mesh 
size  0.03a  X  0.0(19  on  the  body  expanding  to 
0.082  X  0.062  at  radius  1.27.  Now  in  timestep 
DTR.  vortices  in  the  courser  rectangular  mesh 
may  diffuse  through  the  finer  polar  mesh  to 
the  surface  of  the  body.  To  prevent  this,  all 
vortices  within  radius  1.8  are  diffused  using 
the  fine  polar  mesh.  Since  for  P,e<200  there 
are  at  least  8  mesh  points  within  BL.  the 
convection  mesh  satisfactorily  duplicates  to 
treat  the  diffusion.  For  p.e  =  500.  however, 
there  are  only  5  mesh  points  within  BL  and  so 
a  new  and  separate  polar  mesh  for  diffusion 
near  the  body  is  now  introduced.  It  has  the 
same  form  as  equations  (3.8.5)  but  with  DTH 
halted.  For  equal  mesh  lengths  in  the  radial 
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and  circumferential  directions.  Cl  is  reduced 
to  ci=0. 028038.  This  gives  more  mesh  points 
within  BL.  Then  for  Re<500  there  are  at  least 
8  mesh  points  within  BL.  Then  DTI  has  a 
minimum  value  of  Re/lO*.  This  is  calculated 
from  (6)  based  on  the  maximum  mesh  length  at 
radius  l.tt  in  the  polar  grid. 

Now  the  cost  of  the  diffusion  algorithm 
increases  as  the  square  of  the  number  of  mesh 
points  a  vortex  diffuses  in  a  timestep.  For  a 
fixed  mesh,  this  limits  the  magnitude  of  the 
timestep.  For  the  rectangular  mesh.  DTR  is 
chosen  so  that  a  vortex  diffuses  through  no 
more  than  3  mesh  lengths.  Then 

DTR  <  0. 2239. Re.GS2  (8) 
Similarly,  for  the  polar  diffusion  mesh,  the 
timestep  is  limited  so  that  vortices  diffuse 
through  no  more  than  3  mesh  lengths  at  radius 
X.U.  Now  the  mesh  length  is  smaller  on  the 
cylinder  surface  and  so  for  the  above 
restricted  timestep,  the  algorithm  must 
actually  allow  diffusion  over  5  mesh  lengths 
near  the  surface. 

Methods  of  satisfying  the  no-slip  condition 
on  the  boundary,  relecting  vorticity  from  the 
surface  of  the  cylinder,  calculating  the  lift 
and  drag  coefficients  and  other  details  are 
described  in  C63  and  C73 • 

3. VALIDATION  AND  DISCUSSION  OF  THE  RESULTS. 

Table  1  shows  6  different  sets  of  parameters 
for  which  the  computer  code  was  run  for 
Re=200.  Their  choice  was  guided  by  the  above 
considerations.  NTH2  is  the  number  of  mesh 
points  in  the  circumferential  direction  for 
the  inner  polar  diffusion  mesh. 


TABLE  1.  PARAMETERS  OF  THE  MODEL 


Version 

DTT 

DTI 

DTR 

NTH2 

R200V1 

0.2 

0.2 

1.0 

257 

R200V2 

0.075 

0.075 

0.975 

257 

R200V3 

0.1 

0.2 

1.0 

129 

R200VO 

0.075 

0.075 

1.95 

257 

R200V5 

0.05 

0.1 

1.  0 

129 

R200V6 

0.05 

0.1 

2.0 

129 

R250 

0.05 

0.15 

1.95 

129 

R000 

0.075 

0.075 

1.95 

257 

R500 

0.075 

0.075 

2.875 

257 

The  diffusion  in  the  inner  polar  mo3h  takes 
place  every  one  or  two  convection  timesteps 
whereas  the  diffusion  in  the  outer 
rectangular  mesh  is  much  less  frequent  due  to 
the  larger  mesh  length.  For  the  range  of 
Reynolds  number  investigated,  periodic 
oscillating  wakes  are  obtained.  The  Strouhal 
number,  St,  average  drag  coefficient ,  Cd(av) 
and  range  (twice  the  amplitude)  of  the  drag, 
Cd(ra)  and  lift  Cl(ra)  coefficients  are 


computed. 

These  are  shown  in 

Table 

2,  with 

results  of 

’  Brazer 

et  al.  Cl 03 

for  Re» 

200. 

TABLE  2. 

COMPUTED 

RESULTS 

Version 

Cd(av) 

Cd(ra) 

Cl(ra) 

St 

R200V1 

1.85 

0.10 

1.86 

0.198 

R200V2 

1.37 

0.13 

1.  58 

0.190 

R200V3 

1.  38 

0. 11 

1.55 

0.190 

R200V8 

1.37 

0.13 

1.  58 

0.191 

R200V5 

1.37 

0.12 

1.57 

0.191 

R200V6 

1.36 

0.13 

1.55 

0.191 

Braza 

1.38 

0.12 

1.60 

0.190 

R250 

1.36 

0.21 

1.81 

0.198 

RilOO 

1.  36 

0.22 

2.  26 

0.206 

R500 

1.36 

0.32 

2.60 

0.205 

In  C63  .  for  Re<200,  good  agreement  was  found 
with  other  published  results,  which  the 
present  investigation  also  confirmed  but  the 
results  of  C63  were  not  so  good  at  Re=200. 
The  parameters  of  R200V1  correspond  to  those 
used  in  c6l  and  the  present  work  suggests 
that  the  convection  timestep  is  too  large. 
This  results  in  too  large  an  average  Cd  and 
too  small  values  of  the  ranges.  When  DTT<0.1. 
however,  variation  of  the  parameters  subject 
to  the  earlier  described  limitations  does  not 
seem  to  cause  significant  changes  in  the 
results.  Tables  1  and  2  also  show  typical 
values  of  parameters  and  results  for  Re  up  to 
500.  Figures  1  and  2  show  the  lift  and  drag 
versus  time  and  streamlines  at  t=U0  for 
R200V5  and  R500  respectively. 


Fig . 1 .  Lift,  drag  and  streamlines  at  Re=200. 
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Abstract-It  is  proposed  method  for  discavering 
separation  regions  of  viscous  fluid  in  bent 
pipes. That  method  is  based  on  decomposition  of 
full  system  equations  of  hydrodynami cs  of  vis¬ 
cous  fluid  and  consits  in  three  stages.  On  the 
first  stage  the  equations  of  streamlines  are 
obtained  and  time-  and  space-average  length 
streamline  for  given  pipeline  is  calculated. 
Stagnating  zones  and  reverse  motions  are  obta¬ 
ined  as  well.  On  the  second  stage  we  construct 
one-dimensional  equivalent  model  of  viscous 
fluid  motion  along  streamlines  which  takes  in¬ 
to  consideration  the  narrowing  of  area  of  tra¬ 
nsversal  section  by  stagnating  zones  and  reve¬ 
rse  motionsiSol ving  the  initial-boundary  value 
problem  for  equations  one-dimensional  equiva¬ 
lent  model  we  obtain  the  subdomains  of  the  pi¬ 
peline  at  which  are  valid  the  necessary  condi¬ 
tions  for  separation  of  flow. 

The  aim  of  third  stage  is  the  control  of  suf¬ 
ficient  conditions  for  separation  of  flow.  For 
that  purpose  the  system  equations  of  hydrody¬ 
namics  for  boundary  layer  of  bent  P.pes  the 
transversal  section  of  which  is  near  to  circle 
is  derived.  For  that  system  we  solve  initial- 
boundary  value  problem  only  in  those  subdoma¬ 
ins  of  the  pipeline  at  which  are  valid  the  ne¬ 
cessary  conditions  for  separation  of  flow  and 
thus  check  sufficient  conditions  for  separati¬ 
on  of  flow. 

The  application  of  described  method  permits 
to  construct  the  pipelines  with  small  energy 
losses  because  it  is  possible  to  prevent  sepa¬ 
ration  of  flow. The  decomposition  of  separation 
of  flow  problem  decreases  considerably  the  ex¬ 
penditures  of  computing  time. 

I.  INTRODUCTION 

Under  some  circumstances  of  the  motion  of 
fluid  in  the  pipes  can  occur  separation  of 
flow  and  that  phenomenon  leads  to  sharp  change 
of  pressure,  speed  and  temperature  of  fluid 
compared  with  their  values  without  separation. 
Most  essential  cause  which  leads  to  separation 
of  flow  is  the  form  of  channel  especially 
sharp  change  of  its  transversal  section  C13. 

The  separation  of  flow  leads  to  essential  in¬ 
crease  of  the  resistance  of  fluid  motion  in 
the  pipes.  Therefore  constructing  pipelines 
with  small  energy  losses  it  is  necessary  to 
create  such  form  of  channel  that  separation  of 
flow  should  not  occur. 

To  solve  the  problem  of  creatign  pipelines  in 
which  the  motion  of  fluid  occurs  without  sepa¬ 
ration  of  flow  it  is  not  necessary  at  full  me¬ 
asure  to  elaborate  mathematical  mod'rl  o+  sepa¬ 
ration  of  flow.  In  that  case  is  necessary  only 
to  answer  the  question:  occurs  or  does  not  oc¬ 
cur  separation  of  flow  in  given  pipeline  under 
given  parameters  of  fluid  which  flows  in  pipe. 
Last  problem  is  essentially  simpler  and  its 
solution  can  be  obtaind  by  methods  of  hydrody¬ 
namics.  At  present  paper  is  suggeted  the  met¬ 
hod  for  solution  such  problem. 


From  the  point  of  view  hydrodynamics  for  ari¬ 
sing  separation  of  flow  two  factors  are  neces¬ 
sary:  positive  gradient  of  pressure  and  vis¬ 

cosity  of  fluid  [13. It  is  known  that  in  three- 
dimensional  space  separation  of  flow  arises  in 
boundary  layer  11,23.  Exactly,  the  separation 
of  flow  occurs  when  nearest  to  wall  of  channel 
the  streamline  cames  off  wall.  Therefore  the 
necessary  condition  for  separation  of  flow  is 

If  I  s~°  ’  _  (1> 

where  S  is  contour  of  pipeline,  n  -unit  vector 
of  external  normal  to  surface  S,  q-normal  to  S 
component  of  fluid  velocity.  The  necessary  co¬ 
ndition  (!)  can  lead  to  separation  of  flow  if 
in  the  same  region  pressure  p  increases  to¬ 
wards  the  flow,  i.e.  is  valid  condition 

M\ 

<?X  I s'u  • 

condition  for  separation 


The  sufficient 
flow  is 


(2) 

of 


M. 

dn 


^ 0 


(3) 

where  u  is  longitudinal  component  of  fluid  ve¬ 
locity. 

From  (l)-<3>  it  can  be  seen  that  to  find  the 
sections  of  pipeline  in  which  are  valid  the 
necessary  and  sufficient  conditions  for  sepa¬ 
ration  of  flow  it  is  necessary  to  know  the  ve¬ 
locity  and  pressure  fields  in  the  pipe.  To  ob¬ 
tain  those  fields  we  have  to  solve  the  initi¬ 
al-boundary  value  problem  for  the  full  system 
of  hydrodynamic  differential  equations  C33. Ho¬ 
wever  obtaining  exact  solutions  of  such  prob¬ 
lems  is  impossible.  Numerical  integration  of 
those  problems  even  for  simple  regions  demands 
so  much  computing  time  that  the  obtained  re¬ 
sults  become  insufficiently  reliable  in  const  - 
quence  of  the  accu.nul ation  of  errors  of  calcu¬ 
lations.  This  situation  becomes  more  complica¬ 
ted  if  it  is  necessary  to  optimize  system  pa¬ 
rameters  because  it  demands  multiple  computa¬ 
tions  for  initial-boundary  value  problems. 

So  to  solve  separation  of  flow  problem  we 
propose  a  method  of  decomposition  which  con¬ 
sists  in  three  stages.  Main  idea  of  the  first 
two  stages  is  to  represent  outside  to  boundary 
layer  flow  as  one-dimensional  one  along  stre¬ 
amlines  and  with  the  help  of  such  conception 
to  find  the  parameters  of  outside  flow.  For 
that  purpose  we  construct  one-dimensional  equ¬ 
ivalent  model  or  the  motion  of  viscous  fluid 
in  pipe  [43. 


H.  FIRST  STAGE 

It  is  known  that  equations  of  motion  of  per¬ 
fect  fluid  are  one-dimesional  towards  stream¬ 
lines.  In  case  of  viscous  fluid  the  equations 
of  motion  are  one-dimensional  towards  stream¬ 
lines  accurate  to  term  whi-h  takes  into  consi¬ 
deration  the  rotation  of  velocity  field  C43. 
The  full  system  equations  of  hydrodynamics  of 
viscous  fluid  \s  singularly  perturbed  one  and 
if  ^=p=0,  where  /)  and  ^  are  constants  of  Lame, 
becomes  full  system  equations  of  hydrodynamics 
of  perfect  fluid.  It  is  known, in  the  theory  of 
singularly  perturbed  boundary  value  problems, 
the  differens  between  solutions  of  perturbed 
and  non-perturbed  problems  has  order  0 '/f )  or 
0(,*J  everywhere  with  the  exeption  of  boundary 
layer  which  thickness  has  the  same  order. 
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On  the  first  stage  of  decomposition  we  find 
equations  of  streamlines  for  three-dimensional 
motion  of  fluid  in  pipe.  Above  considerations 
permit  to  find  those  equations  by  means  of  so¬ 
lving  initial -boundary  value  problem  for  pel — 
feet  fluid.  After  the  velocity  field  for  per — 
feet  fluid  is  obtained  we  average  that  one  for 
time  of  activity  of  pipline,  calculate  length 
of  every  average  streamline  and  calculate  ave¬ 
rage  length  of  streamlines  in  pipeline. 

Ul.  SECOND  STAGE 

On  the  second  stage  there  we  construct  one¬ 
dimensional  equivalent  model  of  viscous  fluid 
motion  in  the  pipeline.  The  length  of  one-di¬ 
mensional  region  of  motion  is  equal  to  average 
length  of  streamlines.  The  main  task  for  crea¬ 
ting  the  one-dimensional  model  is  to  take  into 
consideration  the  influence  of  the  forces  of 
friction  on  the  motion  of  fluid  in  pipeline. 
That  model  is  not  ordinary  consequence  of 
three-dimensional  motion  of  viscous  fluid  un¬ 
der  only  assumption  that  all  functions  which 
are  inserted  into  equations  depend  on  one  spa¬ 
ce  variable  but  is  more  complite  one.  It  takes 
into  account,  in  particular^  the  change  of  the 
area  of  transversal  section  and  perimeter  of 
pipelines  towards  the  flow  (along  x-axis)  and 
the  heat  exchange  with  the  walls  of  pipeline 
and  is  described  by  following  equations  C43 

¥>*%  v‘a-o 

hW+kWs>*0 

*iJ>V‘a/Hk(T-T„)8=0 

p-j>TR/^  ,  (4) 

It  should  be  noted  that  in  one-dimensional 
model  there  are  taken  into  consideration  addi¬ 
tionally  the  results  of  solving  of  three-dime¬ 
nsional  problem  on  the  f'rst  stage. By  means  of 
analysis  of  velocity  field  in  the  pipeline,  in 
particular,  we  discover  stagnating  zones  and 
reverse  motions  and  using  those  results  make 
correction  of  geometrical  values  of  area  of 
transversal  section  and  perimeter  of  the  boun¬ 
dary  contour  of  pipeline. 

As  the  result  of  solving  initial-boundary  va¬ 
lue  problem  for  system  (4)  we  obtain  the  valu¬ 
es  which  characterise  motion  of  viscous  fluid 
in  pipeline.  In  particular,  with  the  help  of 
function  of  pressure  p(x,t)  we  can  discover 
sections  of  pipeline  in  which  condition  (2)  is 
valid,  i.e.  such  sections  where  separation  of 
flow  may  occur  in  principle. 

IV.  THIRD  STAGE 


transformation  f=R^ -r. We  introduce  as  well  the 
transf ormation  to  undimensional  variables 
(with  asterisk)  with  the  help  of  scaling 

*=i of;  ;  vx=v>;  5  v,=v;v*  ; 

and  conditions  of  connection 

V1  °/yjl  5  MXVA  ;  1o/&v*/V1 

%'%  =v;/l0  =V*/<ra  ;  ^  =  ;  k^R^A*.  (6) 

Executing  in  full  system  of  hydrodynamic  dif¬ 
ferential  equations  all  of  these  transformati¬ 
ons,  evaluating  every  term  and  neglecting  the 
terms  which  are  sufficiently  small  compared 
with  unity,  we  derive  system  equations  for  bo¬ 
undary  layer  (again  in  dimensional  variables) 

LdJZ^o 

it  v*dZ  3-f  v*  a* 

££  i/  M.*e2!k +\f 
dt  V*W  A  ./*  3*  ,  S  ax  J>  "aft 
3p  3(j>h)  i  dtfVf),  f) 

dr-ar*%-9f  U 


Now  for  the  solution  of  separation  of  flow 
problem  we  have  to  solve  initial-boundary  va¬ 
lue  problem  for  system  (7)  in  boundary  layer. 
The  motion  of  fluid  oitside  boundary  layer 
with  the  high  degree  of  accyracy  can  be  desc¬ 
ribed  by  parameters  of  Dne-dimensional  equiva¬ 
lent  flow.  After  solving  such  problem  we  can 
verify  the  satisfaction  of  conditions  (1)  and 
(3).  If  those  conditions  are  valid  it  means 
that  form  of  pipeline  have  to  be  changed  and 
for  new  form  we  have  to  solve  again  the  same 
problem. 

This  technique  can  be  applied  as  well  for 
bent  pipelines  with  near  to  circle  cross-sec¬ 
tion.  To  take  into  consideration  of  centrifugal 
forces  the  first  equation  (7)  has  to  be  writ¬ 
ten  as  SVjcoS'f’ 


and  to  right-hand  side 
must  be  added  the  term 


of  second  equation  (7) 

V'/f/rt'S _ 


where 


The  method  which  has  been  proposed  permits  to 
create  packaged  programs  for  analysis  separa¬ 
tion  of  flow  in  the  pipes.  Using  that  programs 
we  can  design  pipelines  with  small  losses  of 
energy  because  of  that  phenomenon  there  do  not 
occur. 


To  answer  the  question  whether  separation  of 
flow  really  occurs  we  have  to  solve  three-di¬ 
mensional  initial -boundary  value  problem  for 
full  system  of  hydrodynamic  differential  equa¬ 
tions.  However,  taking  into  consideration  that 
separation  of  flow  occurs  only  in  boundary  la¬ 
yer,  it  is  sufficient  to  consider  that  problem 
only  there, moreover  only  in  those  parts  of  bo¬ 
undary  layer  where  condition  (2)  is  valid.  In 
its  turn  the  small  thickness  of  boundary  layer 
permits  to  simplify  equations  of  motion  in  it. 

Let  us  consider  equations  of  hydrodynamics  of 
viscous  fluid  in  cylindrical  channel  with  cir¬ 
cular  cross-section  of  radius  R,  .  Let  us  int¬ 
roduce  cilindrical  polar  coordinates  r, y^x  and 
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ABSTRACT : 

The  topic  of  this  paper  is  the  prediction  of 
three-dimensional  flows  and  the  analysis  of  shock 
wave/turbulent  boundary  layer  interaction.  For  these,  a 
two-step  method  based  on  the  MacCormack  scheme  has 
been  used.  The  averaged  Navier-Stokes  equations  with 
turbulence  model  (Baldwin-Lomax  )  were  solved  numeri¬ 
cally  in  a  general  coordinate  system  for  three  dimensional 
turbulent  flows.  The  numerical  computation  was  per¬ 
formed  for  a  3D  channel  flow.  The  configuration  is  the 
same  as  the  one  studied  experimentally  at  ONERA  [1], 
[2]  in  a  wind  tunnel.  It  consists  of  a  bump  mounted  in 
the  lower  wall.  The  countoured  portion  of  the  bump  is 
at  an.  angle  of  60°  with  the  upstream  flow.  The  flow  is 
then  highly  three-dimensional.  The  features  of  this  flow 
are  predicted.  A  detailed  description  of  a.3D  interaction 
and  a  complete  analysis  of  the  physical  phenomena  and 
the  comparison  with  the  experimental  results  are  done. 

■  I.  INTRODUCTION 

Several  Navier-Stokes  codes  have  been  developped  in 
order  to  calculate  two  or  three  dimensional  viscous  com¬ 
pressible  flows,  the  three  dimensional  code  is  needed  when 
we  have  to  analyze  complex  fluid  flows.  The  study  of  three 
dimensional  flow  has  become  a  subject  of  significant  im¬ 
portance  in  the  aerodynamic. 

The  purpose  of  this  investigation  is  to  develop  a  code 
based  on  a  MacCormack  method  for  solving  the  compress¬ 
ible  Navier-Stokes  equations  to  solve  three  dimensional 
turbulent  flows. 

The  aim  of  this  study  is  to  test  the  capability  of  this 
code  to  simulate  3D  shock  wave/turbulent  boundary  layer 
interaction.  This  phenomena  is  one  of  the  interest  gaz  dy¬ 
namic  problems.  The  effects  of  such  interaction  are  the  in¬ 
crease  of  the  aerodynamic  drag  and  the  possibility  of  buf¬ 
fet  onset.  The  natural  consequence  of  this  interaction  is 
the  separation.  Hence,  experimental  investigations^, 2,3] 
were  done  to  provide  a  set  of  data  and  to  analyse  this 
interaction. 

In  our  case,  the  numerical  computation  was  per¬ 
formed  for  a  3D  transonic  channel  flow.  The  configuration 
is  the  same  as  one  studied  experimentally  by  BENAY  ct  al 
[1]  in  a  wind  tunnel.  The  flow  is  highly  three  dimensional 
with  the  strong  shock  wave/boundary  layer  interaction. 


II.  GOVERNING  EQUATIONS 

If  we  consider  the  case  of  homogeneous  flow  exclud¬ 
ing  chemical  reactions  or  very  high  temperature  effects, 
the  fulf  Navier-Stokes  equations  constitute  a  good  physi¬ 
cal  model.  This  model  describes  conservation  of  mass,  mo¬ 
mentum  and  total  energy.  With  the  mass-weighted  aver¬ 
aged  Navier-Stokes  equations,  a  turbulence  model  is  used 
to  relate  the  turbulent  flux  terms  to  the  mean  flow  pa¬ 
rameters,  through  the  use  of  an  eddy  viscosity  coefficient. 
The  turbulent  viscosity  is  obtained  by  the  Baldwin-Lomax 
model  [4]. 

III.  NUMERICAL  METHOD 

The  numerical  method  is  an  explicit  version  of  a  Mac¬ 
Cormack  scheme  [5,  6].  The  predictor  and  corrector  struc¬ 
ture  is  used.  For  each  time  step,  an  explicit  increment  is 
evaluated  by  using  the  forward  or  backward  approxima¬ 
tions  for  the  inviscid  part  and  the  central  difference  for 
the  viscous  terms.The  scheme  is  a  finite  volume,  cell  cen¬ 
tre  method. 

In  order  to  improve  numerical  efficiency,  the  sec¬ 
ond  order  accurate  flux  splitting  has  been  included  in 
the  method.  The  flux  splitting  was  motivated  by  one 
need  for  a  better  description  of  discontinuities  and  a  more 
rigourous  treatment  of  the  boundary  conditions.  The  flux 
splitting  used  here  is  close  to  the  one  developed  by  Steger 
and  Warming  [6,  7]. 

IV.  RESULTS 

The  numerical  method,  described  above,  has  been  ap¬ 
plied  to  the  calculation  of  the  transonic  flow  in  a  three  di¬ 
mensional  channel.  The  forth  boundaries  are  treated  as  a 
no  slip  boundaries.  Given  the  total  pressure  and  total  tem¬ 
perature,  the  inlet  flow  angle  and  the  outlet  downstream 
static  pressure,  calculations  are  performed.  The  same  con¬ 
ditions  used  in  the  experimental  study  were  implemented. 
The  total  pressure  is  92  kPa,  the  total  temperature  is  300 
K  and  the  Reynolds  number  at  the  sonic  state  with  the 
throat  width  as  length  scale  is  1,13  *  106. 

The  features  of  this  flow  are  predicted.  Figures  (1) 
and  (2)  show  iso-Mach  lines  in  the  longitudinal  vertical 
planes,  at  two  different  sections.  These  plots  reveal  the  ex¬ 
istence  of  the  lambda  shock  comprising  of  a  front  oblique 
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shock  and  a  quasi  normal  rear  shock.  The  second  foot  of 
the  lambda  shock  is  not  very  intense  as  it  is  in  a  two  di¬ 
mensional  configuration.  The  system  of  the  shocks  is  gen¬ 
erally  associated  with  a  strong  interaction  entailing  sep¬ 
aration.  The  length  of  the  separation  zone  in  this  case 
is  smaller  than  in  a  two  diemensional  configuration.  The 
results  are  in  good  agreement  with  the  experimental  data. 
The  main  difference  with  a  2D  shock-wave/boundary-laycr 
interaction  is  that  in  a  3D  situation,  the  flow  can  take  a 
transverse  or  cross wize  direction,  and  consequently  when 
separation  occurs  we  generally  do  not  observe  recirculat¬ 
ing  bubble  in  the  streamwise  direction. 

Isobar  lines  on  the  bump  are  shown  in  figure  (3).  It 
reveals  a  nearly  two  dimensional  incoming  (low  which  is 
turned  by  a  shock  forming  slightly  downstream  of  the  top 
of  the  bump.  In  this  figure  the  shock  foot  is  observed. 
At  the  shock  foot,  interaction  with  the  boundary  layer 
takes  place  entailing  separation.  The  three  dimensional 
Character  of  the  flow  can  also  be  observed  downstream  of 
the  top  of  the  bump. 

Comparison  to  experimental  data  is  given  in  figure 

(4).  In  this  figure  we  plot  the  Mach  number  profile  in  one 
section  before  the  shock.  The  agreement  seems  to  be  good 
in  the  external  inviscid  flow.  In  the  near  wall  regions,  the 
calculation  overestimates  the  thickness  of  the  boundary 
layers.  This  is  due  to  the  overestimation  of  the  turbulence 
viscosity  and  perhaps  to  the  coarse  mesh  used. 

V.  CONCLUSIONS 

A  three  dimensional  code  based  on  a  Mac  Cormack 
scheme  has  been  developed.  It  has  been  applied  to  the 
calculation  of  transonic  turbulent  channel  flow.  The  fea¬ 
tures  of  this  three  dimensional  flow  were  predicted  and 
the  shock-wave/boundary-layer  interaction  was  analysed. 
Due  to  the  calculation  of  turbulent  viscosity,  the  thickness 
of  the  boundary  layers  is  larger  than  the  experimental  one. 
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Figure  (1):  Mach  number  contours  Y=27.mm 


Figure  (2).  Mach  number  eontours  Y=S9.mm 


Figure  (3):  Pressure  contours  at  the  lower  wall 
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Figure  (4):  Mach  number  profile  Y=27.mm 
—  exp. 
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Abstract: In  this  paper, the  expressions  of  the  second  o 
order  water  wave  forces  upon  a  2-D  floating  body  are 
derived  with  the  perturbation  method, and  the  numerical 
computations  are  carried  out  with  the  boundary  element 
method  at  the  same  time.  Compared  with  the  results  of 
the  experiments  and  of  the  calculations  done  by  other 
researchers,  the  present  results  are  more  resonable 
and  accurate. 

I.  Introduction 

These  years,  with  the  rapid  development  of  the 
ocean  engineering, much  attention  was  paid  to  the 
nonlinear  water  wave  theory.  This  is  because  that  the 
water  wave  forces  are  the  most  important  loading  to 
many  marine  structures  such  as  ships  and  drug  platform 
as  well  as  some  offshore  structures.  It  is  known  that 
a  body  will  be  subjected  to  linearand  nonlinear  force. 
In  regular  waves, we  call  the  latter  second-order 
wave  forces  which  include  two  parts, the  steady 
drifting  forces  with  frequency  equal  to  zero  and  the 
biharmonic  oscillating  ones  with  twice  of  the 

incident  wave  frequency.  Both  are  veryimportant 
factors  and  need  fully  consideration. 

Early  in  1960,tiaruo,n[l]  obtained  a  general 
expression  for  tne  honzental  steady  drifting  force  of 
a  2-D  body, which  is  proportional  to  the  square  of  the 
reflected  wave  amplitude  of  the  linear  solution.  His 
work  was  generalized  later  by  Newman [2]  and  Faltinsen 

(3],  It  is  reported  that  there  is  a  good  agreement 

between  the  results  of  experiments  and  of  calculations 
with  this  method.  But  it  cannot  predict  the  biharmonic 
wave  force  which  also  covers  a  considerate  proportion 
in  the  total  second-order  wave  forces. 

In  1980s,  a  more  direct  investigation  was  carried 
out  by  Kyozuka[4).  With  the  boundary  element  method, 
he  had  obtained  the  solution  of  tne  diffractional  and 
radiational  problems  in  regular  waves.  Recently, the 
problem  of  a  fixed  2-D  body  in  regular  waves  was 

studied  by  Liu  &  Miao[5],they  introduced  the  Dirac 

function  to  the  inhomogenous  free  surface  condition 
and  found  a  complete  and  consistent  solution  for  the 
second-order  diffraction  potential. 

In  this  paper,  the  problem  of  a  free  body 
floating  in  regular  waves  is  investigated.  It  is  an 
pofound  research  which  is  an  extension  of  the  previous 
work.  The  problems  are  solved  respectively, which 
include  the  secona-orderdiffraction  of  incident  waves 
and  the  coupled  effects  of  the  first  order  motions  of 
the  floating  body  on  second-order  wave  forces. 

II.  The  Governing  Equation  and  Boundary  Conditions 

As  depicted  in  Fig. 1, the  two  Cartesian  coordinate 
systems  are  related  each  other  by  the  following 
expressions: 

X=Sl+Xcos(S3)-Ysin(S3) 

Y=S2+Xsin(S3)-Ycos(S3) 

where  S1,S2,S3  are, respectively,  the  excursions  in  X 
and  Y  directions  and  rotation  of  tne  body  about  the 
origin  0. 

We  assumed  that  the  fluid  is  incompressible  and 
invicid,  the  flow  irrotational;  thus  the  motion  of  the 
fluid  can  be  described  by  a  velocity  potential  n,and 
tne  governing  equation  is  the  Laplace  equation: 

H(x,y,t)=0 


Since  the  floating  body  is  impermeable,  we  have 

Hn=Vn,on  the  surface  of  the  body 

Through  analysis,  we  obtain  the  general  free 
surface  condition 

Ht+gHy+2HxHxt+2HyHyt+i&lxx+HyIIyy+2HxyHxlIy  =  0 
At  the  bottom  of  infinity,  we  have 
Lim  Hy  =  0 

Besides,  a  radiation  condition  should  be  imposed 
at  infinity, i.e.  the  diffraction  waves  must  be 
propogating  outward  from  the  body. 

III.  Perturbation  Analysis 

For  infinite  deep  water,  the  potential  of 
incident  wave  H*,  can  be  expressed  as 

Hj=  ga/(iw)*exp(ky+ikx-iwt) 

in  which  w,k,a  are  wave  frequency, wave  number  and 
wave  amplitude  respectively. 

Let  e=ka  be  the  small  wave  slope,  by  means  of 
perturbation  technique,  the  potential  II  has  the  form 
H(x,y,t) =Re  [  eHsexp(  -  iwt )  +e*e]Icexp(  -i2w  t )  ] 

Since  the  amplitude  of  Si(i=l,2,3)  are  also  very 
small, so  we  have 

sin(S3)=S3+  0(e*e*e) 
cos(S3)=l-0.5S3*S3+  0(e*e*e) 

Thus, 

X  =  Sl+X-YS3-XS3*S3/2+0(e*e*e) 

Y  =  S2+Y+XS3-YS3*S3/2+0(e*e*e) 

Similarly 

n,=  nrQS3-n,S3*S3/2 
n,  =  n+rj,S3-i£3*S3/2 

Since  ?n=Sln,  +S2n1+S3(xn1-yn, ) 

(  where  tne  overdot  denotes  the  derivation  about  the 
time  t.),Let  the  instantaneously  wetted  contour  of 
the  body  be  C(x,y,t)  and  in  still  water  it  takes  tne 
form  of  Co(x,£).  Following  the  same  procedure,  the 
free  surface  condition  can  De  written  as 
[Ili:1c=(ILxn  +Hyn  )c  ,i.e., 

(Hn  ;cy=Qi  ni  (|I  U1 

(riff  )qfQ3[lfi<(x,jy  nx-Hy  n,  j-(Ql-Q3  Yll.Ixx  nl+rixy  n2j 
-(Q2+Q3  X)TiSy  nl+iiyy  n2)=fTx,£) 

where  Si=e  Qi(x.y)  exp(-iwt) 

Let  rf ’=Hx+Qi*oi ,  (i=l,2,3.i  ,in  addition  it  must 
include  first  order  diffractional  potential  Hcl. 

The  equations  of  different  orders  are 

1st:  vHd=Q,in  fluid  domain 

lldy-klk!=0,  at  y=0 

lSn=-iIm,  on  Co(x,y) 

Lim  Hciy=0 

lim  (Hdx+iklld)=0 
and 

xzlJi=0,  in  fluid  domain 


663 


Jiy-ikJi=0,  at  y=0 
Jin=ni,  on  Co(x,y) 

Lim  Jiy  =  0 

Lim  (Jix  t  i  k  Ji)  =0 

The  first  order  problem  can  be  solved  with  the 
Frank  method  numerically. 


AYb=jc,  x  ydy,  A  is  the  submergerd  area  of  the  body 
and  jfa’is  the  moment  of  inertial  of  wetted  section 
about  the  x  axis.  „,  1%J 

Since  F  =Re[  e  F  exp(-iwt)+e*e(F  +F  exp(-i2wt)] 
and  F  =  -pj  c  (H  +gy)nidl,  so  the  expressions  of 
forces  with  different  order  will  be  derived  easily 
and  is  not  listed  here, readers  may  be  referred  to 
17]. 


2nd  order: 

\flfl.  =0,  in  fluid  domain 
Hly  -  4k  HI  =  0,  at  y=0 
[Hln  Jc  =f(x,y)-H2n-!Dn,  on  Co(x,y) 

Lim  Hly  =  0 

Lim  (Hlx  i  4k  HI)  =  0 

VH2  =  0,  in  fluid  domain 
H2y  -  4kII2  =  Pl(x),  at  y=0 
Lim  H2y  =  0,  y  approaches  infinity 
Outgoing  waves  at  infinity 

V*H3  =  0  ,  in  fluid  domain 
H3y  -  4kH3  =  P2(x),  at  y=0 
lim  H3y  =  0,  y  approaches  infinity 
Outgoing  waves  at  infinity 

where  P=(iw/2g)(2(rix*  +Hy  J-rf^iijry-kHy  )]  ,  and 

Pl=  -4ik*kaJc[Iln  -l("d/dn]exp(ky+ikx)- dl,  X--B/2 
pl=  0,  xr  -B/2 

and 

p2=p-pl 

It  is  clear  that  HI  will  be  found  out  with  the  same 
process  used  in  1st  order  once  the  potential  112  and  113 
has  been  solved.  Here  are  the  solutions  of  112  and  113 
(The  process  was  omitted  for  brevity) 

112  =  -sgn(x+B/2)  (Pl/4k)exp(4ky+i4k  x+B/2  )-rPl/4k 
+sgn(x+B/2)  (Pl/3.1416) 

I  [mcos(my)+4ksin(my)]/(m  +16mk)  exp(-mx+B/2)*dm 

where  sgn(x+B/2)=-l,r=l,  when  x—B/2 
sgn(x+B/2)=l,  r=0,  when  x*-B/2 

112  approaches  -Pl/8/3. 14156  when  x  approaches  0. 

IB  =  Re(-(l/3.14l6)|iJ>2(s)-ds  PV.J  exp(-jvztjvs) 

/(v-4k)>  dv  -i Q?2(s)exp(-4 jkz+4jks)>  ds] 

where  z=x+jy  and  PV.  denotes  Cauchy  principle 
integrates. 

IV.  Equation  of  1st  order  hotions 

According  to  theorem  of  Newton,  we  have 
M  (SI  -Yg  S3)"  e  FI 
M  S2  =  e  F2+  pgA  -  Mg 
I  S3  -Mg  Yg  S3  +M(gSl-  Yg  SI)  =  e  F3 

where  M  and  Yg  are  mass  and  coordinate  of  the  center 
of  gravity  in  Yaxis  and  I=Jc. (x  +y  )dH  of  the  body  _ 

In  still  watwr.the  body  is  in  equilibrium, that 
means  ri  g  =pgA.  where  p  is  the  density  of  fluid.  By 
using  pressure  equation  we  finally  obtained 

-w  (M+DlD-iwGU,  0,  -w  (D3l-IiYg)-iwG31 
0,  -w  (M+D22)+pgB-iwG22,0 

-w  ( D13-MYg) -ivGl 3 ,  0,  -w  (I+D33)-iwG33+pgIw-pg(Yb>Y£) 

*(Q1,Q2,Q3]t=  P(T1,T2,T3]t 

where  Dij+(i/w)Gij=pJcJinjdl  ,(i,j=l,2,3) 

Tj=|c.  (Hj+itS  )(iw)njdl,DTj  and  Gij  are  called  the 
added  masses  and  coefficients  of  damping. 


V.  Results  and  Conclusion 


As  depicted  in  Fig. 2,  B=2.0(m),  h=0.8(m),  A=0.76 
Yg— 0 .031 , lw=0 . 667 ,1=108 . 30 , k=l . 0(l/m) ,M=77 . 52(Kg/m) 
p=102,g  =9.81,Yb=0.829. 

The  computation  results  are  showed  in  Fig. 3  and 
Fig. 4.  It  was  .carried  out  on  the  vax-11/750  digital 
computer  in  Shanghai. 

From  these  computation, we  may  clearly  found  out 
that  the  present  results  seem  agree  rather  well  with 
the  experimental  ones.  Thus, we  may  conclude  that 

1.  The  magnitude  of  biharmonic  forces  have  the  same 
order  compared  with  the  steady  drifting 
forces, further  more,  they  reveal  the  oscillating 
nature  of  high  order  forces. 

2.  The  presen  theory  can  be  used  to  predict  the  wave 
forces  in  irregular  waves  combined  with  Fourier 
analysis  and  application  may  also  be  found  in  3-D 
calculation  by  means  of  method  of  stripping  in 
seakeeping  theory. 


Fig. 3  2nd  order  drifting 
force(  Steady  ) 


Fig.  2 


ing  force  (bihar.) 
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Abstract-This  work  is  based  on  the  constructive  exist¬ 
ence  proof  of  solutions  of  a  comprehensive  class  of 
nonlinear  free  boundary  value  problems  of  plane  hydro¬ 
dynamics  by  E.  Zeidler  [5]  and  a  general  computational 
method  for  constructing  the  solutions  numerically  given 
by  the  author  [3],  The  case  of  permanent  capillar- 
heavy  waves  in  finite  channels  will  be  considered. 

INTRODUCTION  AND  NOTATIONS 

After  formulating  the  boundary  value  problem  in  the 
stream  plane  in  section  1,  we  apply  Levi-Civita  confor¬ 
mal  mapping  to  get  a  nonlinear  boundary  value  problem 
on  the  circular  ring  and  transform  the  problem  to  an 
operator  equation  in  the  Banach  space  Cv  in  section  2. 
In  section  3  we  formulate  the  statement  of  existence 
and  uniqueness.  The  general  computational  method  for 
constructing  the  solutions  will  be  used  in  section  4 
and  in  section  5  the  solutions  in  different  orders  will 
be  computed. 

For  the  function  f(p,o)  defined  in  the  open  circular 
ring  Eqi={t:q<|tl<l :t=  pe10},  the  symmetry  behaviour 
will  be  denoted  by 

feC:f(p,-o)  =  f(p,o);  feU:f(p,-a)  =  -f(p,o) 
with  f ( 1 ,o )  =  f  (a) . 

For  the  Fourier  series  of  f(o) 

CO 

f  =  a0  +  ^  (ak  cos  ka  +  bk  sin  ko) 
we  have  the  closure  condition 

a0(f)  ■  ^  / f  do  =  0 

-IT 

Further  we  define  the  following  operators  (see  [1]): 

Tf  =  f  -  aQ(f)  ;  Jf  =  T  /  Tf  da  ; 


v  f  -  2  “  qK 
q  11  k=l  1  -  q* 


W  f  =  -  —  Z 


S  sin  k(o  -  o^fto'Jda’ 


f  sin  x(a  -  a,)f{a,)da' 


Xqf  =  Kf  +  Wqf  ;  0  <  q  <  1 

and  the  following  Stoke' s  parameters 

sk  =  q"k  +  qk  ;  dk  =  q'k  -  qk 

tk(q)  =  ^ =  :  *k(q)  =  k  tk(q) 

0r(9,x)  will  denote  regular  power  series  with  power 
greater  or  equal  to  r  in  o. 

1.  Problem  Formulation 

To  describe  permanent  capillar-heavy  waves  of  an  ideal 
homogeneous  incompressible  liquid  in  a  finite  channel, 
we  follow  the  method  of  Levi-Civita  (2]  by  considering 
the  two  systems  of  coordinates: 

(i )  The  moving  x-y  system  in  which  the  surface  seems 
to  rest; 

(ii)  The  X-Y  rest  system  in  which  the  liquid  is  rest¬ 
ing  on  the  ground  (see  Figure  1). 


-k  k 

q  +  q 

St, 


We  have  x=X+ct,  y- Y  with  c  the  speed  of  propagation  of 
the  wave  in  the  sense  of  Levi-Civita.  The  free  surface 
y0(x)  satisfies 

(1)  y0(-x)  =  y0(><);  yo(x+*)  =  yo(x); 

X/2 

(2)  /  y0(x)dx  =  0 
-X/2 

The  flow  potential  W(z)=$+ii^  in  x-y  system  will  be 
norroed  through 

(3)  W(iyo(0))  =  0 

As  the  free  surface  and  the  channel  ground  are  flow 
lines,  then 

(4)  <J-(x,y0(x))  =  0;  «(x,-h)  =  -<P0  <  0 

with  ipQ  .>  0  the  flow  in  the  moving  system. 

For  the  velocity  W'=u+iv  let  us  assume,  as  Levi-Civita 
proposed,  that 

(5)  W(z)  =  c  e"iw  ,  w  =  e  +  it,  a0(x(p,o))  =  0 

where  ,  , 

c  =  c  a0(e-T(p’a})  =  c(l+02(t)) 

(6)  w  =  i  tn(W‘(z)/c) 

6  =  arg(utiv),  c  eT  =  /u2  +  v2 

Consequently,  we  have  the  following  boundary  value 
problem: 

Find  y0(x)  satisfying  (1)  and  (2)  such  that  in  the  flow 
region  G={z:-h<y<y0(x)}  there  exists  a  holomorphic  func¬ 
tion  W(z)  =  $  +  i^  satisfying  (3)  and  (4).  This  func¬ 
tion  satisfies  also 

(7)  y  =  -h:  Im  W(z)  =  0,  i.e.,  e  =  0 
on  the  ground. 

Along  the  free  surface  the  Bernoulli's  equation 
y  =  y0(x):guy0(x)  +  }u|w'(z)|2  +  p.  =  k 
(S)  0  d0 

pi  =  po  ’  B  is 

is  satisfied,  where  u  is  the  density,  B  is  the  surface 
tension  constant,  p^  and  pQ  are  internal  and  external 
pressures  respectively. 

2.  Conformal  Mapping  and  Back  Transformation 
Due  to  periodicity  of  W(z)  we  consider  the  strip 


V ' I- x -7 


It  follows  that 


r  ■  CX  ,  .  ,  cx 
GW  T^-T 


-h  £  y  <  y0(x) 


-•x0  <  t  <  o 


is  the  conformal  mapping  using  W(z). 

Then  we  map  the  strip  Gy,  using 

jr  =  eio  =  e-2niW/cx 

to  the  circular  ring  q  =  e2nv0/cX  with  a  cut  on 

the  negative  real  axis  (see  Figure  1)7 
The  back  transformation  will  yield  the  free  surface 

x  =  -  4:  c/c  f  e_T^  coso(a)da 
0 


y  =  -  ^  c/c  /  e"MU/  sino(a)da  +  y0(0) 
vihere  yo(0)  is  to  be  determined  using  (2). 
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The  Bernoulli's  equation  (8)  will  be  transformed  in 
^-plane  to 

(10)  0»(yo(0)-  ^  S°  e'T^>sine(o)do)+Juc2e2T(aUPi=K0 
which  is  equivalent  to 

S](|z|=l):-b  =J(eT+ae"T)-pe'T/  e‘T  sino  da 

(11)  Sq(  I zl=cl)  ;g(q>°)  =  0 

2110^  y  cr  Xjicc 

As  9eU,  xeC,  we  apply  the  operator  T  to  the  integrand 
and  get 

S-| :  -  ^  -  ^(e1  +  a'e‘T)  -  be'T  Je'T  sine 
Sq:  e(q,o)  s  0 

(12)  with 

p  =  >  a'  =  a-2p  aQ(  /  T  e  T  sino  do) 

b  =  (gx2y/4i728)(c2/c2) 

The  transformed  boundary  value  problem  will  then  be: 
Find  a  function  w(t)  =  e  +  ixeCv(G)  with  8eU,  xeC  and 
the  norm  condition  ao(x)=0  which  satisfies  (12)  on  S] 
and  Sq. 

A  necessary  condition  for  the  solution  of  this  bound¬ 
ary  value  problem  is 

0  =  a0{-2(eT  +  a'e-T)  -  b  e_T  J  e“T  sine) 
which  yields  2b  (e-x  j  e-t  S1.  .  {eT} 

(13)  a'  =  - 2 - - - 2 - 

P  a0(e  T) 

Replacing  the  constant  a’  in  (12)  by  the  functional 
a'(e,x)  and  integrating  using  the  operators  T  and  J,  we 
get  the  operator  equation 

(14)  e  =  pJXqO  +  bj2e  +  JN(0jt  =  -Xqe) 

where  N(e,x)  is  an  expression  of  the  form  02(0, t). 

The  linearized  problem 

(15)  0  =  pJXq0  +  bj2e 
has  the  solution  2 

(16>  P  =  Pn,b,q  5  ’  0  =  °'n  =  sin  no>  n=1»2’-" 

3.  Statement  of  Existence  and  Uniqueness 


Given  n,q,b  with  0  <;  q  ^  1  and  b  / 


exist  numbers  r0,s0,e  >0  such  that  for  given  s  with 
|s|<s0  exactly  one  solution  9eCv(U)  of  (14)  exists 
which  satisfies  the  condition 

lf0Mviro»  bn(°)=s»  IP'Pn.b.q1  i’-o 

2+b 

For  SrO,  p  is  uniquely  determined:  p=p„  .  — r-, 

n,o,q  ?in(qj 

while  for  s=0  only  the  trivial  solution  9  =  0  exists. 
The  solution  can  be  given  as  an  absolutely  convergent 
series  in  CV(U) 

(17)  0  =  s  sin  no  +  z  $l  e, 

z= 2  1 

As  1,  =  -X  „e.  the  series 

4  q  l  ^ 

(18)  t  =  -  ^2  $  cos  na  +  r.  s ,  t  ; 

un  i-2 

converges  absolutely  in  C„(C).  Also 

CS)  "  “ 

is  absolutely  convergent  with  '2mV^  (for  the  proof 


see  [5]). 

4.  Construction  of  the  Solutions 

Using  the  method  of  Zeidler  [5]  we  apply  the  operators 
T  and  J  to  the  functional  a' (0,1)  to  get 

(20)  a'=  -1  +  a  £  -1  +  z  s*  a 

t= 1  * 

Our  problem  can  then  be  formulated  as: 

e  =  pdX.e  +  bj2e  +  jN*(e,x);  an(N*)  =  0 

(21)  with  q 

N*(e,x)=p(x-sinhx)-  ^ ^e‘T  +  b(e’TJe‘Tsine  -  Jo) 

Let  p=pn  b  q+e.  The  pseudoresolvent  Rn  b  will  then 
be  given  as’ 

R  .  =(I  -  p  ,  JX„  -  bJ2  -  Pf,)"1 

n,b,q  11  Kn,b,q  unq  nl 

(22)  with 

Pn0  =  bn(e)sin  ns 

It  follows  that 

e  =  k  „  Jf 

n,b,q 

(23)  with 

f  =  -cx  +  N  (0>x) 

We  set  (20)  in  (23)  to  get 

(24)  f  =  s  s*  f 

and  T1 

<25>  0*  “  Rn,b,q  JV  2  =  2,3,... 

5.  Computation  of  the  Solutions 

We  consider  the  case  n=l  of  primitive  waves,  from 
which  we  can  calculate  the  non-primitive  waves  n--l . 

From  (22)  we  have 

k<dk+l  +  dk-l>ak<f) 

k’1:¥Rl,b,q  Jf>=  <fk+1  ( k-V) (k-b)+dk  ^ (fc+TJ fk+b'J 

(26)  .  K+l  K  1 
and  bl(Rl  >b  qJf)  =  -a](f) 

The  algorithm  consists  of  two  steps: 

(i)  As  ao(N*(e,x))=0  and  ao(x)=0,  it  follows  from 
(23)  that 

(27)  a^)  =  0 

from  which  we  compute  a^ 

(ii)  As  b^ (©)  =  s,  we  have 

(28)  b^)  =  0,  t  -  2,3,... 
from  which  we  compute  es_j. 

Expanding  f(o,x)  to  the  third  order  gives 

f=-ex-  +  -jox  -  ^ax2-bJ0x-bxJO  +  bJ(^-9  -  g— )  + 

{29)  x2  P  , 

+  bxJtO  +  bj-  Jo  -  +  ... 

with  p=Dq  +  e  std-j/s^ )(l+b)  +  e* 
flow,  we  consider  the  first  three  orders  of  the 
solutions:  p 

(a)  First  Order.  From  (29)  we  have  fj=  y**]  •  Fr0!n  (27) 
we  have  ao=0  and  we  already  know  that  the  linearized 
problem  has  the  solution 

(30)  s1  =  sinu,  x  1  =  --,j  cosa  with  =  Sj/dj 

(0)  Second  Order.  As  ci=0  (to_.i-0)>  we  have 

pZ - -  p„  b,,  3bn 

fg-  -  "  ”4 — "  2a 

From  (27)  we  get  ^  =  "b'l/po  ’  consequently 
f2  *-(30,^/45(005  2j).  Using  (23)  we  get 
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-  ^2  sin  20}  Tg  ~  -Y252  2o 
(31)  »ith  3(s3  +  3s1-)b 

S2  =  2(^{b-2)--  3dj(b+2')')  '  »  Y2  =  s2/d2 

(c)  Third  Order.  From  (2?)  we  have 


p0  P0 

f3  =  "e2T1  ”  T~  “3  +  Y~ a?T]  "  b J ( 9 1 x2  +  xl02^— ” 
2  ~  0? 


2 

*1 


-  bT-jd02  bj( — 2”  0*| 


■)  +  tiJt-|0^  +  ^  TiJ0]  " 


T  T1 

After  rewriting  all  products  in  terras  of  trigonometric 
polynomials,  it  is  sufficient  to  consider  the  cos 
terms : 

3  b  Y1 

f$  =  cos  a  ( e2"'C‘j  _  •q  Y-j^b  +  +  ■g-  ) 

Beside  those  terms  there  will  be  constants  and  terms  in 
cos  3o. 

From  (28)  we  get  a-|(f3)  =  0  which  yields 


(32) 


_  3  s  .  b  '1 

-  ?  *2b  -  1577  -  TT 

The  solution  of  pur  problem  will  then  be 

?  3 

0  =  s  sino  +  52s  sin  2a  +  0(s  ) 

(33)  t  =  -y-|S  cosu  -  y252s2<:os  2<j  +  °(s3) 

l+b  /3  ,  b  Yl.  2  .  n,  4, 

p "  ^TqJ  s2b  r  B77 "  F)s  +  0(s  ) 

This  result  agrees  with  our  result  in  the  case  of  in¬ 
finite  channels  when  q+0  (see  [4]). 

Through  back  transformation  we  can  get  all  physical 
parameters  as  well  as  the  equation  of  the  free  surface 

y0(x). 

Simple  integration  will  yield 

(34)  y0(x)  =  ^{s  cos  x  -f-  J(«2+  ^)s2cos  ^  x  + 

+  0(s3)} 
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Abstract  -  A  computational  method  used  L,o  calculate 
the  transonic  flow  o.er  an  aerofoil  with  passive 
boundary-layer  control  is  described  briefly.  Both 
the  computational  and  experimental  results  show 
that  passive  control  can  reduce  both  viscous  and 
wave  drag  of  aerfoils  in  transonic  flow. 


shocxs  with  an  extended  interaction  region.  This 
will  reduce  the  wave  drag.  The  suction  downstream 
of  the  shock  can  also  reduce  separation  and  therefore 
reduce  viscous  losses.  The  porous  surface  and  the 
cavity  can  also  damp  pressure  fluctuations  associated 
with  shock  wave  boundary-layer  interaction. 


1.  INTRODUCTION 


Transonic  flow  over  an  aerofoil  contains  super¬ 
sonic  regions  embedded  in  a  subsonic  field.  The 
supersonic  flow  invariably  terminates  in  a  shock 
wave.  The  formation  of  shock  waves  cn  an  aerofoil 
gives  an  additional  pressure  drag  (wave  drag)  to 
the  subsonic  pressure  drag.  The  shock  wave  also 
imposes  an  adverse  pressure  gradient  on  the 
boundary-1 ayer. 

A  control  technique  which  appears  to  show  some 
promising  results  for  a  substantial  drag  reduction 
in  transonic  flow  is  the  passive  control  of  shock- 

1-2 

boundary-layer  interaction  (PCSB).  This  paper 
presents  a  brief  review  of  computational  approaches 
to  the  solution  of  transonic  flow  with  passive 
boundary-layer  control. 

2.  THE  CONCEPT  OF  PASSIVE  CONTROL  OF  SHOCK-BOUNDARY 
LAYER  INTERACTION 


The  concept  of  PCSB  as  originally  suggested  by 
Bushnell  and  Whitcomb  (see  Ref.1)  consists  of  a 
porous  surface  and  a  cavity  or  plenum  underneath 
located  in  the  region  of  shock  bcundary-layer  inter¬ 
action  (Fig.  1).  It  is  suggested  that  the  static 
pressure  rise  across  the  shock  wave  will  result 
in  a  flow  through  the  cavity  from  downstream  to 
upstream  of  the  shock  wave.  This  is  equivalent 
to  a  combination  of  suction  downstream  and  blowiny 
■pstream  of  the  shock.  The  cavity  would  also 
increase  the  communication  of  signals  across  the 
shock  wave.  These  efiects  would  lead  to  a  rapid 
thickening  of  the  boundary-layer  approaching  the 
shock  which  in  turn  should  produce  a  system  of  weaker 


(o) 


^Strong  shock 


Turbulent 
DoufxJory^lojre.'  ^ 


Seporotcd 

oirflow 


Aerofoil  without  possive  control 


<o) 


Porous  surface  creotes  recirculotin?  oirflow 
on<3  inereosc>  communieotion  across  the  sr***  wove* 
Aerofoil  possive  control 


Fig.  l.The  concept  of  passive  boundary-layer  control 


The  conservation  form  of  the  two  dimensional 
comoressible  Navier-Stoxes  equation  in  cartesian 
co-ordinates  without  bouy  forces  or  external  heat 
transfer  can  be  written  as 


8u  .  3E  , 
Ft+  97  + 


0) 


where  the  vector  eqi  ation  comprises  conservation 
of  mass,  momentum  and  energy. 


The  anproximations  made  to  the  above  equations 
to  reduce  computational  grids  and  time  in  the  order 
of  reducing  accuracy  are  (i)  thin  layer 
appr  .’.ations  (TLA),  (n)  parabolised  Navier-Stokes 
(PNS),  (iii)  Euler  equations,  (iv)  full  potential 
flow  equations  and  (v)  small  perturbation  equations. 
Whereas  (i)  and  (i-i)  resolve  viscous  terms  in  the 
flow  to  some  degree  of  approximation,  (iii)  to  (v) 
neglect  the  viscous  terms.  The  viscous  terms  can 
be  resolved  by  coupling  (iii),  (iv)  or  (v)  with 
equations  based  on  boundary-layer  approximations. 

3.  COMPUTATION  OF  TRANSONIC  FLOW  WITH  PASSIVE  CONTROL 


Some  of  the  methods  mentioned  above  have  been 
used  to  compute  transonic  flow  over  an  aerofoil 
with  passive  control.  These  are  described  briefly 
here. 


3.1  Transonic  small  disturbance  approach 

The  equation  describing  two  dimensional  invicid 
irrotational  transonic  flow  around  a  thin  aerofoil 
in  transformed  £  ,  n  co-ordinates  in  non  conservative 
form  can  be  expressed  as 

(K*c  -  *r  \  }£  -  V 0  (2) 

where  K  =  (1-M^)/t 

d>’=  <f>/(cvro),  t  =  t/c,  £  =  x/c 
n  «  y/(ct ~'n) 

where  *  is  velocity  potential,  c  is  aerofoil  chord, 
1  is  thickness  ratio,  free  stream  Mach  number. 

The  boundary  condition  on  a  solid  surface  is 

4>*  =  0  (3) 
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The-  equation  can  he  solved  by  a  successive  line 
over-relaxation  procedure  with  a  central  difference 
scheme  in  the  subsonic  region  (elliptic)  and  upwind 
difference  scheme  in  the  supersonic  region 

(hyperbolic)3.  Savu  and  Trifu4  used  this  procedure 
to  calculate  the  flow  field  around  a  porous  aerofoil 
assuming  that  the  normal  velocities  in  the  porous 
region  obey  Darcy's  law 

vn  -  <*p.  «  =  5/(P„VJ 

where  0  is  -the  porosity  factor. 

3.2  Full  potential  flow  approach 

5 

Subsequently  Chen  et  al  used  full  potential 
flow  equations  with  the  same  boundary  conditions 
used  by  Savu  and  Trifu  to  solve  this  problem.  The 
results  of  the  computation  agreed  qualitatively 
with  those  of  Savu  and  Trifu.  Further,  it  was  shown 
that  passive  control  can  not  only  reduce  drag  but 
augment  lift  on  an  aerofoil. 

3.3  Interactive  boundary-layer  approach 

Refinement  to  the  above  solutions  was  achieved 
by  introducing  viscous  effects.  These  include  for 
the  flow  around  an  aerofoil  with  passive  control, 

thin  layer  approximations  by  Chung  et  al®,  coupling 
full  potential  outer  flow  to  a  boundary-layer 

equation'  near  the  surface  by  Chung  et  al®  and 
coupling  transonic  small  perturbation  theory  to 

7 

boundary-layer  equations  near  the  surface  by  Gray  . 

The  viscous  flow  near  the  surface  of  the  aerofoil 
and  wake  can  be  expressed  by  the  following  non 
dimensional  non  conservative  steady  two  dimensional 
boundary-layer  equations  in  transformed  £,  n 
co-ordinates. 


(pu)?  5X+  (pv)n  nx  =  0 


(4) 


p{-(u,  £  +  u  n)  +  vu  n)  = 
'  ^  x  D  x  r)  'y 


-  B  pP  5  +  (u  u  n  )  n 

x  n  y  n  y 


(c) 


pcP{u(Vx  +  Tn  nx>  +vTnny)  = 


Bu  P5  Sx  +  (k  Tn  ny)n  +u  (un  ny)2  (6) 


p  =  pT,  6  =  p/pu2,  Cp  =yR/(y-1) 


The  boundary-layer  equations  were  solved  using 
MacCormack’s  predictor-corrector  algorithm  with 
appropriate  initial  conditions. 

Baldwin-Lomax  turbulence  model  was  used  for  the 
transonic  small  perturbation  boundary-layer 
interaction  code. 


Typical  results  obtained  from  these  computations 
are  shown  in  Fig.  2.  The  computational  results 

O 

agree  qualitatively  with  the  experimental  results- 
and  show  some  of  the  features  of  transonic  shock 
wave  boundary-layer  interaction  with  passive  control. 
The  porous  surface  splits  the  flow  into  a  X  shock 
with  the  leading  edge  of  the  shock  system  anchored 
to  the  beginning  of  the  porous  region.  This  has 
the  effect  of  reducing  entropy  changes  across  the 
shock  and  therefore  the  wave  drag.  It  has  also 
been  shown  that  passive  control  can  alleviate  shock 
oscillations  in  the  transonic  flow. 


Fig.  2.  Pressure  distribution  t  =  12%  circular  arc 
=  0.83,  R  o  2  x  10®,  o  =  0.03 
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Abstract- We  describe  an  efficient  preconditioning  technique  for  solv¬ 
ing  time  dependent  problems  with  local  refinement  both  in  time  and 
in  space.  The  prccunditiunor  makes  use  of  solvers  on  regular  grids 
only,  lienee  it  can  be  easily  incorporated  in  existing  codes  for  solving 
parabolic  problems  based  on  standard  timesleppmg.  The  difficulty 
that  arises  in  local  timeslcpping  is  that  such  a  discretisation  always 
leads  to  nonsymmetric  matrices.  However,  it  turns  out  that  we  can  pre¬ 
condition  these  problems  with  generalized  conjugate  gradient  (GCG) 
type  methods  in  an  optimal  way. 

I.  INTRODUCTION 

We  describe  an  efficient  solution  technique  based  on  Domain  De¬ 
composition  (DD)  ideas  for  solving  time  dependent  diffusion  problems. 
Wo  consider  the  following  model  problem 

-  V  ■  Qvp)  =  q  in- ft  C 1R2,  t  >  0, 

with  appropriate  boundary  and  initial  conditions.  The  discretization 
of  the  problem  can  be  done  in  the  fiamcwork  of  the  discontinuous 
Calcrkin  method,  (cf.  Thomcc  [0])  where  we  have  a  global  time  step 
rc.  In  the  time  interval  (t„,f„+i],  fn  -  nrc,  n  >  0,  in  regions  ftj  C  ft 
of  special  interest,  we  introduce  a  finer  time  step  77  =  rc/m  for  some 
m  >  1.  We  also  couple  this  with  local  refinement  in  space  on  the 
subdomain  flj-  See  Figure  1  for  a  one  dimensional  domain  ft.  Then 
we  have  intermediate  time  levels  f„,,  -  fn  -f  fry,  i  -  0, l,...,m. 

( 

f«+ 1 


In 


fti  F  ftj  x 

Figure  1.  Grid  with  local  refinement  in  space  and  in  lime.  /It  the 
interface  F  x  (f„,i  .+1]  ‘slave’  nodes  (denoted  by  ‘x  ’)  arc 
introduced. 

By  using  a  variational  formulation  (for  details  see  Ewing  cl  ut. 
(5))  or  by  cell-centered  finite  difference  approximation  of  the  above 
problem,  cf.  Ewing  cl  at.  [3],  one  can  derive  a  composite  grid  problem 
for  the  unknowns  between  two  global  time  steps  <„  and  tn+i-  We 
obtain  a  linear  algebraic  problem  of  the  form,  Ax  —  b.  Note  that,  the 
composite-grid  matrix  obtained  in  this  way  is  always  nonsymmetric, 
but  has  a  coercive  symmetric  part. 

II.  TWO-GIUD  PRECONDITION)-;!! 


Using  the  following  DI)  ordering  of  the  nodes  in  the  time  slab 

(!«  An-pl)  k  D, 

_  X/  }ft2  X  (iriAn-fll 

xc  }ft|  x  {<ri+i}  ’ 

we  obtain  the  following  2x2  block  form  of  A, 


AJAI  B] 

‘  [C  D  J  ’ 


whole  the  block  Ay  col  responds  to  a  standaid  Umestepping  procedure 
on  the  subdomain  ft2  a  (fn,in+i]-  That  is,  to  solve  systems  defined  by 
Ay,  we  can  use  any  available  limcsicpping  code  on  a  rectangular  grid. 

The  preconditioner,  uiiginaily  pioposcd  in  Bramble  ct  al.  [2]  fold 
lip  tic  problems  with  local  icftnuncnl ,  and  extended  for  time  dependent 
piobloinsin  Ewing  tl  til.  [3  o],  is  consliucLvd  for  the  reduced  problem 

Sxc  =  b,,  -  CAjBj , 

where  S  =  D  -  CA~jyB  is  the  reduced  Scliur  matrix.  Consider  the 
problem  on  the  original  coarsc-grid  (i.e.,  without  any  local  refinement 
in  either  space  or  time).  Then  we  have  a  coarsc-grid  matrix  Al  defined 
foi  the  coarse  grid  atithc  time  level  l  -  („+!•  Formally,  using  the  same 
DD  idea,  we  can  partition  A  in  2  x  2  block  form  as  follows 

At  B  1  }ft2  X  {<„+,} 

C  D  }ft,  X  {«„+,}, 

where  A2  is  a  block-matrix  corresponding  to  a  global  timeslcpping 
but  for  the  subdomain TI2  only.  Note  that  in  this  case  A  is  symmetric 
and  positive  definite,  hence  its  reduced  Scliur  matrix  S  —  D  —  CAjB 
is  also  symmetric  and  positive  definite.  The  preconditioner  for  the 
reuuced  problem  we  choose  is  S.  Note  that  in  order  to  solve  a  system 
with  S,  we  can  use  solvers  for  the  matrix  A,  lienee  we  can  use  any 
available  soRware  for  timcstcpping  procedures  on  rectangular  grids. 
In  Ewing  ct  ol.  [d]  it  was  shown  that  using  an  approximate  S  in  a 
GCG-typc  mevliod  (since  S  is  nonsymmetric)  will  give  an  optimal 
convergent  method.  The  convergence  properties  arc  independent  of 
possible  jumps  of  the  coefficient  k/p  and  the  coarse-grid  sizes.  For 
more  details  and  some  numerical  experiments  wo  refer  to  Ewing  cl 
ul.  (<1,5).  For  application  in  industrial  reservoir  simulation  codes,  see 
Boyelt  el  al.  [1). 
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A  DOMAIN  DECOMPOSITION  PROCEDURE  FOR  PARABOLIC 
EQUATIONS 


CLINTDAWSON 
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Houston,  TX  77251-1892  U.S.A. 

Abstract  A  domain  decomposition  procedure  for  solving  parabolic  partial 
differential  equations  based  on  explicit/ implicit,  Gatcrkin  finite  clement  dis¬ 
cretizations  is  presented.  Error  estimates  are  stated,  and  numerical  results 
on  a  parallel  processing  machine  are  discussed. 

I.  INTRODUCTION 


Here  (v)a  denotes  the  LJ(A)  inner  product, 

DS(Vn ,  v)  =  (Vl/n,  Vv)n,  +  (Un ,  «)n, , 

and  />({/"  =  (Vn-Vn-')/Mn.  Note  that  once  B(Un~')  has  been  calculated, 
U"  can  be  computed  on  ft,  and  completely  independently 

In  order  to  state  an  error  estimate  for  the  above  algorithm,  let  W'  C  Ad 
be  the  elliptic  projection  of  u,  defined  for  each  t  6  [0,71  by 

3 

£>;((W -«)(.,  <),«)  =  0,  ti£M.  (8) 

s=i 


Domain  decomposition  procedures  have  received  much  attention  in  re¬ 
cent  years  as  a  way  of  numerically  solving  partial  differential  equations  on 
parallel  processing,  machines,  sec,  for  example,  [1],  Much  of-llus  work  lias 
been  directed  at  elliptic  equations.  These  techniques  arc  often  extendable  to 
implicit  time  discretizations  of  parabolic  equations,  since  an  “elliptic"  equa¬ 
tion  must  be  solved  at  eaclrtime  step,  generally  resulting  in  an  algorithm 
requiring  iteration  between  subdomain  problems  and  interface  problems.  In 
the  work  described  here,  we  avoid  this  complication  by  using  information 
from  the  previous  time  step  to  calculate  fluxes  along  an  interface  between 
subdomains.  These  approximate  fluxes  are  then  used  as  boundary  data  for 
implicit  subdomain  problems.  Thus,  the  procedure  is  noniterative  and  uses 
noiioverlapping  subdomains.  For  the  method  described  here,  a  Galcrkin 
finite  clement  discretization  is  used  in  each  subdomain 

II.  ALGORITHM  DESCRIPTION 

Let  Cl  denote  a  spatial  domain  in  nd.  Denote  by  Hm(Cl)  and  the 

standard  Sobolev  spaces  on  fl,  with  norms  ||  ■  ||m  and  ||  •  ||M,,n,  respectively. 
Let  If  (Cl),  p=  2,oo,  denote  the  standard  Banach  spaces,  with  |1||  denoting 
the  L2  norm,  ||  ■  ||M  the  LM  norm. 

Let  (or, /)]  C  [0,2']  denote  a  time  interval,  X  =  A'(fi)  a  normed  space.  To 
incorporate  time  dependence,  we  use  the  . notation  ||  •  ||tr(o,<J;X)  to  denote 
the  normof  A-valucd  functions  /  with  the  map  t  >-♦  ||/(-,  t)|| a'  belonging  to 

First,  consider  the  case  d  =  2,  and  Cl  =  (0, 1)  x  (0, 1).  Decompose  Cl  into 
two  subdomains, -Di  =  (0,  §)  x  (0, 1),  and  CI3  =  (L,  1)  x  (0, 1).  Let  I’  denote 
the  interface  between  these  two  domains,  F  =  {5}  x  (0, 1),  and  let  u  satisfy 

u(-Au+u  =  0,  on  fix  (0,7’],  (I) 

u(x,0)  =  u°(x),  on  fi,  f2) 

—■  =  0,  onan:x(0,n  (3) 

where  nn  is  the  outward  normal  to  dCl. 

Our  domain-decomposition  procedure  relies  on  calculating  an  approxi¬ 
mate  normal  derivative  of  u  on  F.  Let  0(x)  =  fa((x  —  1/2)///)///,  where 
//  is  a  parameter,  5  >  7/  >  0,  and 


Let  i;  =  u  —  W.  The  following  theorem  is  proved  in  (2). 

Theorem  1  Suppose  that  the  solution  u  is  sufficiently  smooth  and' that  lrn  £ 
Ad  is  taken  to  be  H’(  ,U).  Let  At  —  maxn  At".  Then  thee  exists  a  constant 
C,  independent  of  the  spaces  Mt,  such  that 

max||u"  -  C/n||  <  C +At+ //25  +  /  IM  ,<)||dF+  //-*|l')lli.~(fix(o,T)) 

n  \  Jo 

provided  that  At  < 

The  algorithm  can  be  extended  to  domains  Cl  c  RJ  withpicecivisu  uni¬ 
formly  smooth,  Lipschitz  boundaries,  where  the  interface  I’  Is  a  uiiifuiinly 
smooth,  (d  -  l)-dimensional  manifold.  Moreover,  dilTcrent  functions  other 
than  02  may  be  used  in  the  flux  approximation  B,  which  give  higher  order 
accuracy  in  //.  In  particular,  suppose  0(x)  =  0a((x  —  1/2)///)///,  where 


&(*)  -  j 
l 


(x-2)/12, 
-51/4  +  7/6, 
5x/4  +  7/6, 
~(x+2)/12, 
0 


1  <  x  <  2, 

0  <  x  <  1, 

-1  <  x  <0, 
-2  <  x  <  -1, 
otherwise. 


(9) 


In  this  case,  for  0  five  tunes  difTercntiablc  in  r, 

lM5.»)-B(0)(i,y)l<C//4.  (10) 

The  proof  of  Theorem  1  relics  on  the  following  coercivity  property  of  the 
method.  Namely,  for  0  g  Ad,  let 


where 

IIMII2r  =  (M,M)f- 

Then,  under  the  assumptions  of  Theorem  1,  it  can  be  shown  that 


f  1  —  x,  0  <  x  <  1, 

05(*)=  <  x  +  1,  — 1  <  x  <  0, 

[  0.  otherwise 

(4) 

nwii*:sc  ^r^(*,-»)+ W),M)pj  ■ 

(12) 

For  V>  a  smooth  function,  define  an  approximate  normal  derivative 
each  point  y  on  T  by 

of  y  al 

In  general,  assume  that  for  some  II  s  0,  B  is  a  linear  map 
ZA(F)  and  that  it  satisfies  the  following  four  conditions. 

of  L2(Cl)  into 

M^.V)  ~  y(v5)(|,!/)  =  -J  <h'(r:)ih(x,v)(lz, 

(5) 

(i)  There  is  a  constant  Co  such  that 

IIM2<Co(D(d-,0)  +  (B(«,[0])r), 

(13) 

and  note  that 

(ii)  There  is  a  constant  Ci  such  that 

(6) 

IW)||?<cI//-3||d>||2. 

(Id) 

Let  0  =  t°  <  f 1  <  ...  <  lM  =  T  be  a  given  sequence;  At"  =  t"  —  t"~l. 
We  approximate  u  at  time  t"  by  U",  where  U”\ n,  €  Mj ,  and  Mt  is  a  finite 
dimensional  subspacc  of  //'(fl/).  Let  Ad  be  the  subspace  of  l?(Cl)  such  that 
if  v  6  Ad,  t)|n,  S  Ad;,  and  let  [t]  denote  the  jump  i.i  function  values  of  r 
across  F  (which  is  well-defined).  The  approximations  U1,..., UM  are  given 
by 

E{Wy",u)n, +  £»;•(//", u)}  +  (C(t/"->).H)r  =  0,  uS.M.  (7) 

/=! 


(iii)  There  is  a  constant  C3  such  that 

IIB(t>)llr  <  CaW'IWIw  (15) 

(iv)  There  is  a  constant  1  ^  II  and  a  constant  C3  which  depends  on  the 
solution  u  such  that 

||^^-y(u)(-.0||r<Ca//*,  (16) 

for  0  <  t  <  T,  where  du/Dy  is  the  normal  derivative  of  u  on  F,  in  the 
direction  from  fl|  to  flj. 
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We  note  that  for  ^  =  fo,  Q  the  unit  square  on  R2,  and  P  =  {5}  x  (0, 

Co  =  1:7,  Ci  =  2,  and  Ca  =  2.  For  <t>  =  Co  =  1.64,  Ci  =  3.14,  and 
Ci  =  8/3. 

In  general,  assuming  conditions  (i)-(iv)  hold,  we  have  the  following  The¬ 
orem  (23. 

Theorem  2  Suppose  that  u  is  sufficiently  smooth  and  that  U°  =  lF(-,0). 
Let  At  =  max„At",  Then  there  exists  a- constant  C,  independent  of  the 
spaces  Mj  such  that. 

max||(u"  -  mi  <  C  ^At  +  //*+*  +  jf  ||9l(.,  f)||<ti  a.  , 

provided 


H2 

At  <  . 

C0C1 


(17) 


III.  NUMERICAL  EXAMPLES 


We  have  implemented  the  algorithm  outlined  above  on  a  32  processor 
Intel  iPSC/860  at  the  Center  for  Research  in  Parallel  Computing,  Rice  Uni¬ 
versity.  We  now  present  some  timings  which  demonstrate  the  parallelism  of 
the  method. 

The  first  problem  tested  was 


u(  -  Au  =  0, 

on  0  x  (0,'T), 

(18) 

u(z,  0)  =  cos(irz)  cos(iry), 

on  0, 

(19) 

du 

On  n  "0> 

on  9Si  x  (0,T], 

(20) 

with  n  the  unit  square  on  R2.  This  equation  has  solution  u(z,  y,  t)  = 
c_2'J‘u°(x,y). 

In  our  domain  decomposition  procedure,  once  the  interface  fluxes  arc  cal¬ 
culated, a  system  of  linear  algebraic  equations  must  be  solved  within  each 
subdomain.  Preconditioned  conjugate  gradient  with  diagonal  precondition¬ 
ing  was  used  to  solve  these  subdomain  problems. 

In  Table  1,  we  present  timings  for  runs  with  different  types  of  domain 
decompositions.  In  column  1  of  Table  I,  the  notation  “m  x  n”  refers  to  a 
decomposition  of  i 1  into  m  subdomains  in  the  x  direction,  and  n  in  the  y 
direction.  The  decomposition  was  done  so  that  the  subdomains  contained 
the  same  number  of  unknowns.  In  these  runs.  At  =  .0025  and  II  =  .10. 
The  final  time  T  =  .10.  The  approximating  space  in  each  subdomain  was 
the  tensor  product  of  continuous  piecewise  linear  functions  in  x  and  y.  A11 
underlying  rectangular,  uniform,  80-by-80  grid  was  used.  We  present  both 
the  CPU  time  for  each  case  and  the  average  number  of  conjugate  gradient 
iterations.  The  latter  number  was  computed  by  summing  the  number  of 
conjugate  gradient  iterations  (per  subdomain)  required  to  “solve”  the  linear 
algebraic  system  at  each  time  step,  and  dividing  this  quantity  by  the  nur. 
ber  of.  time  steps.  (“Solving”  the  linear  algebraic  system  meant  reducing 
th?  residual  below  10-6.)  In  general,  this  number  is  subdomain  dependent, 
however,  for  this  particular  problem,  it  was  essentially  the  same  on  each 
subdomain.  Not  surprisingly,  however,  the  number  varied  with  the  decom¬ 
position.  The  timings  presented  in  Table  1  indicate  that,  for  a  fixed  number 
of  unknowns,  the  run  time  essentially  decreased  by  a  factor  of  two  when  the 
number  of  processors  was  doubled. 

The  second  problem  we  considered  was 

u(-Au  =  0,  on  fix (6, T],  (21) 

u(x,0)  =  0,  on  n,  (22) 


Deromposition 

CPU  (sec) 

C.-G.  iter. 

2x1 

110.608 

43 

2x2 

49.391 

42 

4x2 

25.435 

42 

4x4 

9.696 

33 

Table  2.  TIMINGS  ON  AN  Intel  iPSC/860.  PROBLEM  2 


with 


on  {0}  x  (0,l)x  (0,Tj, 
on  (1/4,1)  x{0)x  (0,71,  (23) 

otherwise  . 

This  problem  corresponds  to  having  a  heat  source  on  the  left  boundary  of  O 
and  a  heat  sink  on  the  bottom  boundary.  The  results  in  this  case  arc  given 
in  Table  2.  For  this  problem,  the  average  number  of  conjugate  gradient 
iterations  varied  from  one  subdomain  to  the  other.  In  Table  2,  we  present 
the  maximum  of  these  averages.  This  is  the  quantity  which  controls  the 
problem,  since  data  cannot  be  passed  from  one  subdomain  to  another  until 
the  linear  algebraic  problems  in  each  subdomain  have  converged.  As  in  the 
previous  case,  the  computation  time  is  reduced  by  a  factor  of  two  with  each 
doubling  of  processors.  A  factor  of  greater  than  two  is  obtained  when  the 
number  of  conjugate  gradient  iterations  decreases. 
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Decomposition 

CPU  (sec) 

C.  G.  iter. 

2x1 

106.650 

41 

2x2 

55.010 

48 

4x2 

27.819 

47 

4x4 

10.642 

37 

Table  I:  TIMINGS  ON  AN  Intel  iPSC/860:  PROBLEM  1 
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ABSTRACT 

Computing  Sparse  linear  Algebra  problems  on  SIMD  massively  par 
ailcl  architectures  is  an  important  and  major  challenge  for  the  future 
of  these  machines.  In  order  to  obtain  good  performance  when  solving 
many  large  sparse  linear  algebra  problems,  we  use  a  communication 
compiler  which  permits  to  obtain  a  good  speed-up  compared  to  clas¬ 
sical  global  communications.  We  study  in  this  paper  a  polynomial 
preconditioned  conjugate  gradient  method  to  solve  a  symmetric  pos¬ 
itive  definite  very  sparse  linear  system  on  massively  parallel  archi¬ 
tectures.  We  evaluate  performance  obtained  on  CM-2  with  respect 
to  a  few  very  sparse  matrices.  We  conclude  that  to  solve  some  large 
very  sparse  matrix  linear  algebra  problems  we  can  now  rely  on  CM-2 
performance  as  fast  as  could  be  obtain  on  vector  machines  for  dense 
problems  a  few  years  ago. 

X  Introduction 

Researches  in  massively  parallel  algorithms  are  numerous.  Especially 
since  the  introduction  of  the  Connection  Machine  2  (CM-2)  by  Think¬ 
ing  Machines  Corporation.  Sparse  computations  arc  not  yet  very  de¬ 
veloped  despite  the  supercomputer  target  applications  developed  on 
such  problems. 

The  sizes  of  the  concerned  sparse  matrices  are  sometimes  very 
large  and  the  degree  of  row  (resp.  column),  ie  the  number  of  no  zero 
elements  by  row  (resp.  column),  is  often  »mall.  Many  scientific  re 
search  fields  generate  now  very  large  linear  algebra  problems  with  row 
degrees  smaller  than  one  per  thousand  of  the  matrix  order.  Thus,  in 
scientific  computing  we  often  need  to  solve  a  linear  system  starting 
with  very  large  sparse  matrices.  We  shall  study  in  this  paper  un 
structured  very  sparse  matrices,  i.c.  with  very  small  degree  of  row 
and  column. 

Iterative  methods  arc  often  used  to  solve  these  problems  on  SIMD 
massively  parallel  machines.  These  methods  often  use  3  major  op 
orations,  sequential  scalar  operations,  reductions  (principally  inner 
products)  and  matrix  vector  operations  (principally  matrix  vector 
multiplication).  Scalar  operations  arc  often  made  redundant  on  each 
processor  to  optimize  communications  between  processors. 

'This  research  was  supported  in  part  by  the  Direction  Rochorchos  et 
Etudes  Techniques,  French  Department  of  Defense,  under  contract 
20.357/01/ETCA/CREA  while  the  authors  were  in  residence  at  the 
Etablissemcnt  Technique  Central  do  I’Armement  (ETCA). 


Laboratoire  MASI 
Universite  P.  et  M.  Curie  (Paris  6) 
75252  Paris  Cedex,  FRANCE. 


2  Sparse  Matrix  Computation  on  the  CM-2 

On  many  iterative  linear  algebra  methods  when  the  matrices  are 
sparse,  the  matrix-vector  multiplication  is  the  only  computation  that 
manipulates  sparse  objects  (4).  Tims,  we  first  focus  on  the  massively 
parallel  sparse  matrix-vector  multiplications. 

Methods  to  compute  the  multiplication  of  a  sparse  matrix  by  a 
vector  on  massively  parallel  architectures  principally  depend  on  the 
matrix  and  vector  mapping  and  on  the  number  of  processors  Let  us 
assume  that  n  is  the  matrix  order  and  C  the  degree  of  row  that  we 
suppose  equal  to  the  degree  of  column  Tims,  with  Cn  processors 
we  can  map  the  sparse  matrices  witli  scan  class  as  described  by  P. 
Kumar  [3],  with  only  one  clement  of  the  matrix  by  virtual  processor, 
see  (7)  for  detailed  implementation  on  the  CM-2. 

The  idea  is  to  compute  all  the  floating  point  multiplications  of 
the  matrix-vector  operation  in  massively  parallel  mode  and  to  reduce 
with  addition  the  other  operations  in  a  logj(C)  theoretical  complex¬ 
ity.  But  we  need  two  different  mappings  to  do  that  efficiently.  Then, 
we  need  to  change  the  mapping  during  the  matrix-vector  operation. 
The  multiplication  will  be  done  witli  a  mapping  in  wh:c!i  the  clement 
a{i,j )  will  be  mapped  on  the  virtual  processor  (ic,j),  fc  =  0,C  -  1 
and  j  =  0,n  —  1,  where  ic  is  the  row  indicc  on  the  Compress  Sparse 
Column  iCbOj  format  representation  of  the  matrix,  sec  [5]  for  the 
description  of  the  sparse  matrix  formats.  Then,  if  we  want  to  reduce 
with  addition,  along  only  one  dimension,  the  partial  results  in  a  log 
arithrmc  complexity,  we  need  to  re-map  the  paitial  results,  stored  on 
virtual  processors  to  the  virtual  processor  (jc,  t),  where  j c  is 
the  column  indicc  of  the  element  on  the  Compress  Sparse  Row 
tCbR;  formal  representation.  Thus,  the  complexity  of  this  column 
oriented  sparse  matrix  vector  multiplication  is  1  +  Mfl2(Cj  operations 
plus  one  global  one-to-one  general  send  operation 

With  the  general  CM-2  router,  the  time  to  do  these  irregular 
communications  is  really  a  strong  bottleneck,  except  for  very  well 
adapted  sparse  matrix  patterns.  Fast  sparse  computation  is  really 
impossible  on  the  CM-2  without  using  special  tools  to  optimize  these 
one-to-one  general  communications.  Denny  Dahl  developed  such  a 
tool  [2]  which  permits  ns  to  obtain  more  than  aspect!  up  of  10  com¬ 
pared  to  the  CM-2  general  router  [7j.  Then,  -vc  can  really  do  sparse 
computations  on  the  CM-2. 

It  is  an  important  and  difficult  goal  to  propose  lest  sparse  ma- 
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trices  to  evaluate  the  performance  for  massively  parallel  algorithm 
computations.  In  this  paper  we  do  not  propose  special  application 
patterns.  We  try  to  find  bounds  on  the  performance.  These  ones 
depend  principally  on  the  global  send  and  especially  on  the  distance 
between  the  diagonal  of  the  sparse  matrices  and  the  C  non-zero  el¬ 
ements.  Then,  we  take  matrices  with  C  non-zero  diagonals  around 
the  main  diagonal  (C-diagonal  matrix  pattern)  and  we  perturb  at 
random  them  with  a  given  probability  9 ,  which  is  a  parameter  of  the 
evaluation.  Thus,  it  is  nothing  but  the  exchange  of  non-zero  elements 
(i,j)  of  the  C-diagonal  with  the  elements  ( i,jrand ),  where  jrand  is 
a  random  integer  number  between  0  and  n  —  I.  Each  of  these  pertur¬ 
bations  of  the  C  band  matrix  is  done  with  the  probability  q.  Hence, 
we  can  study  the  performance  with  respect  to  q.  We  also  use  matri¬ 
ces  with  non-zero  elements  uniformly  distributed  all  along  the  rows 
and  columns,  with  a  non  zero  main  diagonal  (C  distributed  matrix 
pattern).  In  the  first  case  we  will  obtain  close-to-peak  performance 
when  <?  =  0,  i.e.  without  perturbation  of  the  C  diagonals,  for  this 
algorithm  and  in  the  other  case  we  will  have  the  lower  performance. 

But,  this  tool  uses  the  CM-2  as  a  hypercube  of  the  vector  accel¬ 
erators.  As  we  have  just  one  vector  accelerator  per  each  32  physical 
processors  set,  for  example  on  a  16K  CM2  we  have  512  of  these 
floating  point  fast  units,  can  we  conclude  that  it  is  always  massively 
parallel  computation? 

3  Algorithm  and  Implementation 

We  are  interested  in  the  conjugate  gradient  method  for  the  resolution 
of  the  linear  system  Ax  =  b  whore  A  is  a  very  sparse  symmetric 
positive  matrix.  To  improve  the  conjugate  gradient  method,  it  is 
possible  to  combine  it  with  a  polynomial  preconditioning,  sec  [1]  and 
(G). 

The  polynomial  s  we  chose  for  the  preconditioning,  is  given  by 
the  Neuman  serie : 

s(/l)  =  I  +  D  +  •  ■  •  +  Dm  where  I)  =  J  -  A  and  ||fl||  <  1. 

The  through-put,  in  term  of  Megaflops  (Mflojis),  does  not  depend 
on  the  coefficients  of  the  polynomial  but  on  the  degree. 

We  map  the  vector  and  scalar  on  a  2  D  C  x  n  grid  compatible 
with  the  mapping  of  the  matrix  and  to  optimize  communications.  We 
often  compute  with  redundancy  :  for  example  the  inner  product  is 
computed  on  each  row  of  processors  and  distributed  on  each  proces¬ 
sor.  And,  we  do  not  compute  the  polynomial  directly  but  wc  use  the 
matrix- vector  multiplication  to  compute  s(/ljac  at  each  iteration  of 
the  algorithm. 

Likewise  the  matrix-vector  multiplication,  wc  lake  the  same  test 
matrices  to  obtain  the  performance  of  the  algorithm.  Figure  1  shows 
the  performance  on  a  16K  CM-2  when  the  degree  of  the  polynomial 
is  <1  and  the  matrix  coefficients  arc  real.  Wc  observe  that  the  per¬ 
formance  decreases  as  q  increases  and  that  the  uniformly  distributed 
pattern  matrix  is  really  a  lower-bound.  The  performance  looks  like 
the  matrix-vector  multiplication  performance.  The  performance  wc 
take,  proves  that  the  computational  rate  increases  with  the  degree  of 
the  polynomial. 


0  0.2  0/1  0.G  0.8  1 

9 


Figure  I:  Polynomial  Preconditioned  Conjugate  Gradient  perfor¬ 
mance  on  the  GM-2.  C  =  4  and-n  =  128A'. 

4  Conclusion 

We  siiow  that  sparse  computations  arc  possible  on  massively  paral¬ 
lel  architectures.  We  assume  in  our  method  that  Cn  >  p  to  have  a 
vpr  >  1  but  we  do  notneed  n  >.p  (where  p  is  the  number  of  physical 
processors).  Problems  from  fluid  mechanics,  quantum  chemistry  or 
biology  generate  such  problems.  For  dense  or  sparse  computations, 
parallel  machines  will  become  more  and  more  powerful.  Teraflops 
peak  performance  and  gig.vword  memories  will  soon  allow  us  to  ac¬ 
cess  a  new  area  of  scientific  computing.  The  challenge  will  be  to  pro¬ 
pose  efficient  parallel  algorithms  for  these  machines.  The  researches 
presented  in  this  paper  are  a  step  ir.  this  direction. 
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Abstract  -  We  compare  three  algorithms  to  solve  the  sparse  sym¬ 
metric  generalized  eigenvalue  piohlctn  on  vector  and  parallel  comput¬ 
ers.  An  efficient  vcctorization  for  Iridiagonalizing  a  banded  matrix  is 
defined.  Finally,  we  propose  a  decision  tree  for  the  procedure  selection. 

1.  INTRODUCTION 

The  purpose  here  is  to  solve  on  a  parallel  computer  the  following 
generalized  eigenvalue  problem  : 

Ax  =  XAlx  ,  (1) 

where  A  and  M  real  symmetric  matrices  of  order  n,  such  arise  in 
Structural  Mechanics.  The  assumptions  imply  real  eigenvalues  and 
the  existence  of  a  ji/-orlhogonal  basis  of  eigenvectors.  The  matrices  .1 
and  M,  which  arc  usually  obtained  from  a  discretization,  are  assumed 
'to  be  large  and  sparse.  Typically,  their  bandwidth  does  not  exceed 
n/10.  In  fact,  M  is  either  diagonal  or  with  the  same  nonzero  pattern 
as  .4.  For  non-diagonal  matrices,  we  consider  three  possible  storage 
techniques  :  banded  matrix,  profiled  matrix  or  sparse  matrix  with 
an  unstructured  pattern.  In. all  these  situations,  symmetric  matrices 
arc  only  half-stored.  Since  the  large  size  of  the  matrices  prevent  the 
computation  of  the  entire  spectrum,  the  user  must  sperify  which  part 
of  the  spectrum  he  is  willing  to  compute.  He  may  specify  it  cither  by 
limiting  the  interval  of  the  eigenvalues  sought  or  by  looking  for  a  given 
number  of.extrcmal  eigenvalues. 

The  algorithms  considered  lieie  are  designed  for  parallel  comput¬ 
ers  with  a  shared  common  memory  such  as  tlic-CRAY  or  ALLIANT 
computers.  Three  algorithms  are  developed  depending  on  the  type  of 
storage  used  for  the  matrices.  After  a  description  of  each  of  them, 
we  compare  their  performance  on  some  test  problems  and  draw  some 
conclusions  V  >ut  the  method  of  choice  for  each  situation. 

All  the  ji  problems  are  defined  on  matrices  which  belong  to  the 
HARWELL  set  of  test  matrices.  Since  profile  minimization  may  be 
done  at  a.vcry  small  lost.  the  profile  of  tin  matures  was  minimized  in 
ail  cases. 

2.  REDUCTION  TO  A 
STANDARD  EIGENVALUE  PROBLEM 
(A  :  banded  matrix.  AI  ;  diagonal  matrix) 

2.T.  Analysis  of  the  sequential  algorithm 

Since  Al  is  a  positive  definite  mniiix,  the  problem  defined  by  Equa¬ 
tion  (1)  is  equivalent  to  the  following  standard  eigenvalue  problem  ; 

Cij=  ,\y  ,  r  =  Ihj  .  (2) 

where  D  =  Al~ll2  and  C  =  DAI).  Since  in  this  section  A  is  a  banded 
matrix  and  M  is  diagonal,  the  tnattix  C’  is  easily  computed.  It  has 
the  same  band  as  the  original  matrix  .1  Therefore,  given  an  interval 
[<1,6],  all  the  eigenvalues  of  the  original  problem  which  belong  to  the 
interval  and  their  corresponding  eigenvectors  can  be  computed  by  tl  e 
following  algorithm  : 

1.  Compute  the  matrix  ('  defined  in  Equation  (2). 

2.  Compute  a  tridiagoun!  matrix  T  unitarily  similar  to  C  using 
Givens  transformations. 

3.  Compute  all  the  eigenvalues  of  T  which  belong  lo  [n.6]  by  Hera 
live  bisections  of  the  interval. 


4.  For  each  eigenvalue  A,  compute  the  corresponding  eigenvector 
by  inverse  iterations  (tins  implies  the  factorization  of  the  matrix 
C  -  XI). 

5.  M-rcortliogonalize  groups  of  eigenvectors  corresponding  to  close 
eigenvalues  by  using  the  Modified  Grnm-Sclunidt  procedure  [2]. 

The  algorithms  of  Steps  2  to  4  may  be  found  in  [5).  They  have  been 
implemented  in  the  subset  of  the  routines  which  are  devoted  to  banded 
matrices  in  the  EISPACK  library. 

Let  us  consider  each  stage  with  respect  to  parallelism  and  operation 
counts.  The  half-bandwidth  of  A  is  denoted  p. 

Step  1  is  easy  to  parallalizc  since  it  only  involves  vector  operations 
(componentwise  vector  multiplications  with  vector  length,  p).  More¬ 
over,  its  complexity  is  low  (2 np  operations). 

Ill  Step  2,  the  tridiagonalizalion  process  involves  vector  operations 
but  with  vector  length  decreasing  fiom  p  to  2  during  the  procedure 
with  a  0(n2p )  complexity  for  scalar  operations.  The  algorithm  is 
based  on  a  sequence  of  lotalions  which  gives  rise  to  recursions.  It 
is  essentially  sequential. 

A  parallel  algorithm  for  Stop  3  is  studied  in  [3].  Its  efficiency  is 
usually  almost  optimal  but  the  low  complexity  of  the  step  limits  its 
impact  on  the  overall  process. 

Step  4  is  intrinsically  parallel  since  the  inverse  iterations  may  be 
independently  performed. 

In  Step  5,  two  levels  of  parallelism  may  be  exploited  :  between 
different  groups  of  vectors  and  within  the  orthogonalization  of  one 
group.  The  implementation  is  studied  in  [3],  io  ortliogonalize  a  group 
of  m  vectors,  2 m2n  operations  must  be  performed. 

In  conclusion,  Step  2  appears  to  be  the  bottleneck  for  parallelizing 
the  whole  process.  We  propose  iiere  a  new  version  of  the  algorithm 
which  allows  efficient  vcctorization.  Theoretically,  whenever  vectoriz¬ 
ing  is  possible,  parallelizing  should  also  be  possible.  However,  on  the 
computers  considered  here,  vve  were  not  able  to  obtain  adequate  speed- 
ups.  Hence,  vve  restnet  ourselves  to  the  use  of  one  vector  processor. 

2.2.  Vectorizing  the  tridiagonalizntion  of  a  banded  matrix 

The  successive  eliminations  of  entries  of  the  banded  matrix  C  are 
ordered  as  follows  :  diagonal  by  diagonal,  starting  from  the  outer 
most  one.  and  on  one  diagonal,  from  top  to  bottom.  Therefore,  the 
computation  is  structured  by  a-tvvo-Icvcl  loop  : 

do  i/  =  p, p -  l.„.,2 
do  i  =  1.2, I; 

elimination  of  A{/.  1 4-  </) 

where  elimination  of  Ap.  i-t-'i)  involves  a  sequence  ul  t  ~  Givens 

rotations  R(k,l,0)  that  aie  successively  applied  to  .4  . 

A  :=  /?(/.-, /, 0)T A  R{k.  1.0),  I;  =  0, •  •  ■ .  t  -  1 .  (3) 

The  sequence  of  rotations  comes  from  the  fact  that  eliminating  an 
entry  gives  rise  to  a  new  nonzero  entry  lower  down  on  the  side  of  the 
band.  This  new  entry  will  have  to  be  eliminated  later.  Therefore, 
elimination  of  A(i,i  +  </)  is  implemented  1  y  a  two-level  loop 

'  do  I;  =  0,  !,*••,/  -  1 

compulation  of  R(k,l,0) 

loop  for  computing  .1  :=  .4  R(k,I.O) 

loop  for  computing  . I  :=  R(kJ.0)rA 

At  the  beginning  of  the  process,  the  vectorized  inner  loops  of  are 
efficient  if  the  band  is  large.  However,  when  eliminating  entries  dose 
to  the  main  diagonal,  the  number  of  rotations  is  high  and  at  the  same 
time  the  vectors  being  manipulated  are  very  short.  In  this  ease,  a 
vcctorizer  will  not  yield  efficient  code.  I  his  problem  can  be  rectified 
by  commuting  the  inner  and  outer  loops.  This  is  permitted  when  the 
computation  of  all  the  rotations  tl(k.l.O)  may  be  taken  out  of  body 
of  the  loop.  This  ran  be  done  by  a  recursion  vvliirb  computes  the  sines 
and  cosines  of  the  rotations  (4)  . 

We  compared  those  two  methods  of  vei  loiizatiun  with  a  third  com¬ 
bined  method.  For  every  pair  (</./).  the  implementation  selects  the 
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best  strategy  between  the  original  one  (strategy  A)  or  the  strategy 
which  is  obtained  by  permuting  tiie  loops  (strategy  B).  The  efficiency 
of  the  approach  is  described  in  Table  1. 


s  =  vector  speed-up 

half-bandwidth  (p)  |j  7 

50 

100 

s  =  0.88 

■adiiyii 

ngnfri 

KSI21 

wr^ikwra 

Hi 

Table  1:  Vectorization  of  the  tridiagonalization  on  Cray  2  (n=500, 

1  CPU) 

3.  MULTISEGTIONNING 
WITH  STURM  SEQUENCES 
(A  :  profiled  matrix,  M  :  diagonal  or  profiled  matrix) 

3.1.  Presentation  of  the  algorithm 

'When  A  and  M  are  profiled  matrices  with  the  same  profile,  the 
problem  defined  by  Equation  (1)  can  be  solved  by  iteratively  parti¬ 
tioning  the  interval  [a,  6]  in  which  the  eigenvalues  are  sought.  Unlike 
the  case  in  the  previous  section,  the  Sturm  sequences  are  computed 
from  the  original  matrices.  The  calculation  implies  L-  D- LT  factor¬ 
izations  of  matrices  A  -  AA/  where  A  6  |<i,  b\.  A  factorization  involves 
vector  operations  with  a  vector  length  equal  to  the  half-bandwidth  p. 
Parallelism  is  obtained  by  computing  several  sequences  concurrently. 
For  that  purpose,  we  adopted  a  strategy  similar  to  the  strategy  used 
in  the  tridiagonal  situation  [3],  namely  : 

1.  Isolate  the  eigenvalues  by  multisections  of  order  nproc,  the  num¬ 
ber  of  processors  (a  multisection  is  a  synchronous  computation 
of  nproc  Sturm  sequences).  This  step  results  in  a  list  of  intervals 
enclosing  single  eigenvalues  is  obtained. 

2.  Extract  the  eigenvalues  from  their  interval  and  compute  the  cor¬ 
responding  eigenvectors.  Here,  Sturm  sequence  computations 
are  asynchronous.  We  selected  ZEROIN  as  the  root  finding  pro¬ 
cedure  [1].  Eigenvectors  are  computed  via  inverse  iterations. 

3.  M-rcorthogonalizc  the  groups  of  vectors  corresponding  to  close 
eigenvalues. 

3.2.  Parallel  implementation 

We  illustrate  the  behavior  of  the  algorithm  on  a  problem  of  order 
n  =  817  and  where  the  half-bandwidth,  ;;,  of  A  is  equal  to  IS  but  where 
M  is  diagonal.  The  number  of  cigenpairs  sought  is  1C.  The  speed-ups 
on  ALLIANT  FX/80  arc  displayed  in  Tabic  2.  For  S  processors,  the 
proportion  of  time  spent  in  Step  1,  Step  2  and  Step  3  arc  respectively 
12.3%,  87.0%  and  0.6%  of  the  total  time. 


nb.  processors 

1 

2 

-1 

s 

speed-up 

_1_ 

2 

3.6 

0.0 

Table  2:  Multisections  with  profiled  matrices  on  an  ALLIANT  FX/80 
(Total  time  on  one  processor  :  23-1.6  seconds) 

4.  METHOD- OF  LANCZOS 
(A  :  unstructured  sparse  matrix, 

Af  :  diagonal  or  profiled  matrix  ; 
extremal  eigenvalues) 

For  solving  Problem  (1),  we  consider  the  Lanczos  method  with  the 
following  characteristics  :  block  version  with  full  rcorlhogonalization 
and  dynamic  restarting  process.  The  algorithm  is  described  in  [-]].  The 
iterative  process  builds  an  A/-orthogonal  system  of  vectors  V}  and  a 
banded  matrix  T_,  -  I 'J A  V3  at  every  step.  At  every  iteration,  the 
following  steps  are  performed  ; 

•  prcmultiplication  of  a  block  by  A  ; 

•  prcmultiplication  of  a  block  by-  A/  ; 


•  dense  computations  between  blocks  of  vcctuis  , 

»  prcmultiplication  of  a  block  by  A/-1  ; 

•  tridiagonalization  of  T  and  computation  of  the  cigenpairs  (not 
at  each-iteration)  ; 

•  Af-reorthogonalization. 

Use  of  blocks  provides  an  obvious  way  to  parallelize  the  algorithm 
by  performing  the  transformations  on  the  columns  of  a  block  indepen¬ 
dently.  The  tridiagonalization  was  not  paiallelized  but  only  vectorized 
as  seen  in  Section  2.  On  a  problem  of  order  n  =  1 173  where  A  stored 
by  sparse  diagonals  and  A/  is  a  profiled  matrix  (;;  =  62),  the  program 
was  run  on  -Lproccssors  of  a  CRAY  2.  The  time  required  to  compute 
the  20  largest  cigenpairs  was  31.88  seconds  (block  size  :  /  =  20).  The 
corresponding  speed-up  was  2.0. 

5.  COMPARISONS  AND  CONCLUSION 

The  domain  of  applicability  of  each  of  the  three  presented  algo¬ 
rithms  is  different,  depending  on  the  position  of  in  the  spectrum  of 
the  eigenvalues  sought  and  on  the  matrix  A/.  They  have  also  differ¬ 
ent  memory  requirements.  The  highest  requirement  comes  from  the 
Multisections  which  require  the  storage  of  one  profiled  matrix  per  pro¬ 
cessor  However  this  is  also  the  algoiilhm  which  yelds  to  the  highest 
speed  ups.  To  compare  the  methods,  we  present  running  times  for  two 
different  problems  in  Table  3  : 

•  Problem  (I) :  n  =  122-1, ;;  =  56,  A/  is  not  diagonal. 

•  Problem  (11) :  n  =  1083,  p  =  62,  A/  is  diagonal. 

It  is  clear  that,  when  applicable.  Lanczos  method  is  the  method  of 
choice.  The  decision  tree  for  the  algorithm  selection  is  given  in  Fig¬ 
ure  1. 


nb.  computed 
cigenpairs 

Reduction 
standard  pb 

Multisections 

Lanczos 

Pb.  (I) 

13 

- 

50  76 

13.69 

Pb.  (11) 

8 

23.82 

71  3-1 

3.23 

Table  3:  Punning  times  (seconds)  on  CRAY  2  (-1  processors). 


Extreaal  oi$onvalu«s  ? 


Figure  1:  Decision  tree  for  algorithm  selection. 
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Abstract.  The  generalized  eigenvalue  problem,  Kz  -  AA/z,  is  of 
significant  practical  importance,  for  example,  in  structural  engineer¬ 
ing  where  it  arises  as  the  vibration  and  buckling  problems.  The 
paper  describes  the  implementation  of  a  solver  based  on  the  Lanczos 
algorithm,  LANZ,  on  two  shared-memory  architectures,  the  CRAY 
Y-MP-and  Encore  Multimax.  Issues  arising  from  implementing  linear 
algebra  operations  on  a  multivoctor  processor  are  examined.  Porta¬ 
bility  between  a  multivector  processor  and  a  simple  multiprocessor 
is  discussed.  Performance  results  from  some  practical  problems  are 
given  and  analyzed. 


.1.  INTRODUCTION 

The  generalized  symmetric  eigenvalue  problem,  Kz  =  Xhfx,  is 
of  significant  practical  importance,  for  example,.jn.  structural  engi 
neering.wherc  it  arises  as  the  vibration  and  buckling  problems.  In  the 
problems  of  interest,  a  few  of  the  eigenpair:  closest  to  some  point,  a, 
in  the  eigenspectrum  are  sought.  The  matrices,  A'  and  A/,  are  usu¬ 
ally  sparse  or  have  a  narrow  bandwidth.  Because  eigenvalue  problems 
arising  in  structural  cnginccmg  arc  often  very  large,  it  is  natural  to 
attempt  to  use  parallel  computers  to  solve  them.  In  Section  2  the 
parallel  LANZ  algorithm  and  its  implementation  on  shared-memory 
architectures  with  a  small  to  moderate  number  of  processors  is  de¬ 
scribed.  In  Section  3  results  from  the  implementations  are  given  and 
analyzed. 

2.  ALGORITHM  AND  IMPLEMENTATION 

To  speed  convergence  to  desired  eigenvalues,  a  shift-and-invert 
Lanczos  algorithm  similar  to  that  described  in  (8)  is  used.  On  se¬ 
quential  and-  vector  machines,  this  algorithm  has  been  observed  to 
be  superior  to  the  subspacc  iteration  method  that  is  popular  in  en¬ 
gineering  (9]  [2].  To  maintain  the  desired  semi-orthogonality  among 
the  Lanczos  vectors,  a  version  of  partial  reorthogonalization  [14)  is 
used.  Extended  local  orthogonality  among  the  Lanczos  vectors  is 
also  enforced  [7]  [12).  If  eigenvectors  are  found  before  executing  the 
Lanczos  algorithm,  an  improved  version  of  external  selective  orthog- 
onabzation  [1]  suggested  in  [2j  is -used  to  avoid  recomputing  these 
eigenvectors.  Although  the  discussions  in  this  paper  assume  that 
hi  is  positive  semi-definite,  the  computations  remain  essentially  the 
same  when  hi  is  indefinite. 

The  Force,  a  Fortran-based  language  for  parallel  programming 
[S|,  was  used  to  implement  LANZ  because  it  is  available  on  several 
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shared  memory  architectures,  thus  allowing  at  least  a  superficial  level 
of  portability. 

The  parallel  LANZ  algorithm  is  presented  in  Figure  1.  Its  various 
computational  components  and  their  parallel  implementations  are 
discussed  in  the  following  subsections.  Explicit  global  synchroniza¬ 
tion  points  in  the  algorithm  are  denoted  fay  the  term  “SYNCHRO¬ 
NIZE.”  Other  synchronization  points  are  required  by  particular  op¬ 
erations,  for  example  inner  products,  and  arc  not  explicitly  denoted 
in  the  algorithm.  To  avoid  extra  synchronization,  each  processor  is 
responsible  for  computing  a  fixed  subset  of  each  vector  computation. 
For  example,  if  at  step  21  processor  i  computes  the  first  m  elements 
of  ,  then  at  step  22,  processor  i  would  compute  the  contribution 
of  the  first  m  elements  to  the  inner. product,  thus  avoiding  a  synchro¬ 
nization  between  steps  21  and  22.  In  these  discussions  p  represents 
the  number  of  processors,  n  represents  the  order  of  the  matrices,  b 
represents  the  block  size  in  a  block  algorithm,  and  y  represents  the 
current  Lanczos  step.  , 


0)  to  =  po  =  0 

1)  Choose  in  initial  veelot,  guesi 

2)  pi  =  hlgucit 

3)  Orlhogonilize 

4)  SYNCHRONIZE 
$)  p,  =i  M  gven 

6)  SYNCHRONIZE 

7)  f,  =(A'-oA/)'’pi 

8)  (fietoiizxtion  occurs  here) 

5)  SYNCHRONIZE 

10}  pi  =  Mg, 

u)pi = (?r„)> 

12)  Onhogoualize 

U)7i  =  9i  IPi 

14)  pi  =  fi/Pi 

15) For  /=  1, ... 

16)  (A'  -  tM) j,t,  =  p, 

17)  (only  raxlrix  solution  here) 

18)  SYNCHRONIZE 

19}  inormsjj  9,ti  |] 

JO)  (if  external  oilhogonalizalion) 


21)  7  =  pJ-Wi+i 

22)  9,+i  =  9,4 i  -  79,-1 

23)  6  =  pJV,4i 

24)  9,4i  =  9,41  -  oij 

26)  7  =  pT-,9,4. 

26)  9,41  =  9,41  ~  79,-1 

27)  o,  =  pj*9i4i 

28)  9,41  =  9)4)  -  o,j, 

29)  SYNCHRONIZE 

30)  F,4l=Al9,4> 

31)  o  ,  =  Oj  +  a 

32)  0/41  =(pj4l9,4i)^ 

33)  Calculate  eigenvalues  of  Tj 

34)  Count  the  converged  eigenvalues 

35)  Oithogonalize 

36)  9)41  =  9)41/0,41 

37)  (requites  use  of  critical  sections) 

38)  Pifi  =  P/4i/0, 41 

39)  End  of  Loop 

40)  compute  til*  vectors 


Flu.  1.  Parallel ihi/r  ond-intcrl  lanczos  algorithm 
2.1.  Factorization 

Factorization  takes  place  only  once  during  the  algorithm,  at  step 
7  Because  the  matrices,  K  and  hi,  arc  sparse  (or  have  been  re¬ 
ordered  to  have  a  narrow  bandwidth),  the  parallel  implementation  of 
direct  factorization  and  solution  methods  must  he  carefully  consid¬ 
ered.  Ir.  this  paper,  only  the  case  in  which  the  matrices  have  been 
reordered  to  a  narrow  bandwidth,  /?,  will  be  considered.  However, 
the  limitations  on  parallelism  in  factorization  and  forward/backward 
matrix  solution  that  are  imposed  by  a  narrow  bandwidth  arc  similar 
to  those  imposed  by  sparse  matrices. 

Two  situations  may  exist  when  factoring  (A'  -  chi).  (1)  [K  - 
cM)  is  known  to  be  positive  definite,  and  therefore  it  is  desirable 
to  use  cither  Cholesky  factorization  of  LDLr  decomposition,  or  (2) 
[I{  c.M)  may  be  indefinite,  and  therefore  a  factorization  algorithm 
with  pivoting  is  necessary.  In  the  fii-.i  t  i-e,  a  block  factorization  and 
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solution  subroutine  described  in  [13]  has  been  parallelized  for  use  in 
LANZ.  In  the  second  case,  a  block  algorithm  for  banded  matuces 
based  on  Bunch-Kaufman  factorization  is  used  [3]. 

LANZ  was  initially  written  for  vector  architectures,  and  there¬ 
fore  careful  attention  has  been  paid  to  achieving  good  vectonzation. 
With  small-to-moderate  vector  lengths,  it  is  desirable  to  perform 
saxpy  operations’  as  opposed  to  inner  products,  as  well  as  to  com¬ 
pute  more  than  one  saxpy  operation  at  a  time.*  On  multivector 
processors,  however,  good  vectonzation  is  often  at  odds  with  par¬ 
allelization.  In  the  factorization  algorithms,  this  conflict  between 
vcctorization  and  parallelization  occurs  in  the  computation  of  the 
pivot  column(s):  the  pivot  coluntns(s),  vectors  of  length  /),  must  be 
split  into  vectors  of  length  /5/p  for  each  processor  to  compute.  On  the 
CRAY  Y-MP  the  benefit  of  parallel  compulation  of  the  pivot  column 
is  outweighed  by  the  resulting  inefficient  short  vector  operations  and 
the  cost  of  the  added  synchronization;  therefore,  this  computation 
is  not  parallelized.  However,  on  a  simple  multiprocessor  such  as  the 
Multimax,, this  conflict  docs  not  occur,  and  the  computation  of  the 
pivot  column  is  parallelized.  The  dominant  part  of  the  calculation 
is  the  updating  of  the  uneliminated  nonzeroes  by  using  the  pivot 
columns:  the  updating  is  implemented  by  distributing  extended 
saxpy's  to  each  of  the  processors  to  compute.  The  extended  saxpy’s 
parallelize  well  because  there  is  sufficient  work  for  each  processor, 
and  the  vector  lengths  arc  unaffected  by  parallelization. 

2.2.  Matrix  Solution 

Forward  and  backward  matrix  solution  is  required  at  steps  7  and 
16.  The  conflict  between  vectorization  and  parallelism  is  much  worse 
in  these  operations.  This  discussion  will  be  limited  to  the  forward 
and  backward  solution  algorithms  that  take  place  after  a  Bunch- 
Kaufman  factorization  in  which  the  block  sizes  vary  ar.J  arc  selected 
according  to  numerical  criteria  rather  than  the  number  of  processors.1 * 3 4 
The  following  discussion  will  assume  that  the  lower  triangular  factor, 
L,  resulting  from  the  Bunch-Kaufman  algorithm  has  been  stored  by 
row.*  Because  of  the  order  in  which  pivots  arc  performed,  a  saxpy- 
based  algorithm  for  the  forward  solution  must  be  used,  and  an  inner 
product  algorithm  for  the  backward  solution  must  be  used. 

The  time-consuming  portion  of  the  block  forward  solution  algo¬ 
rithm  is  the  6  fMcngth  saxpy  operations  that  can  be  combined  into 
a  single  extended  saxpy  operation.  The  only  practical  way  to  paral¬ 
lelize  this  operation  is  to  split  the  vector  into  p  shorter  vectors.  This 
approach,  of  course,  significantly  reduces  the  efficiency  of  the  vector 
operations. 

The  time-consuming  portion  of  the  block  backward  solution  al¬ 
gorithm  is  the  computation  of  6  /5-length  inner  products.  Two  types 
of  parallelism  arc  available  here.  (1)  two  or  more  processors  can  co¬ 
operate  to  compute  a  single  inner  product,  and  (2)  individual  inner 
products  can  be  computed  independently.  Even  though  both  meth¬ 
ods  arc  used,  the  algorithm  is  still  inefficient  because  inner  products 


1  The  saxpy  operation  is  defined  as  is  -  at  t  y,  where  w.  jr,  and  a  are  vectors 
and  a  is  a  scalar. 

5  Performing  more  than  one  saxpy  at  a  lime,  called  an  extended  saxpy  in  this 
paper,  is  defined  as  us  =  y  +  101ml  a,Zl  is  often  implemented  via  loop 
unrolling.  This  type  of  operation  reduces  the  ratio  of  roentoty  references  to 
computations. 

1  The  situation  is  slightly  bettet  for  the  positive  definite  casern  which  the  block 
sizes  can  be  selected  based  on  the  number  of  processors  rather  than  according  to 
numerical  criteria. 

4  If  it  were  stored  by  column,  the  same  limitations  would  apply,  hut  the  dis¬ 

cussion  for  the  forward  solution  would  be  applicable  to  backward  solution  and 

vice  versa. 


arc  not  as  fast  as  saxpy's,  the  parallel  computation  of  a  shore  in¬ 
ner  product  is  adversely  affected  by  synchronization  delays,  and  the 
block  size  may  not  be  evenly  divisible  by  p,  and  therefore  a  load 
imbalance  may  result. 

The  considerations  regarding  efficiency  of  vector  operations  are  . 
not  a  concern  when  implementing  this  algorithm  on  the  Encore,  and 
therefore  better  parallel  speedup  from  the  forward  and  backward 
solution  algorithms  can  be  expected  than  on  the  CRAY  Y-MP.  The 
ratio  of  computation  to  synchronization,  however,  is  still  much  worse 
than  for  factorization,  and  good  speedup  cannot  be  expected. 

2.3.  Other  Computations 

The  parallelization  of  other  computations  in  the  algorithm,  in¬ 
cluding  sparse  matrix  multiplication,  solution  of  the  small  tridiag¬ 
onal  eigenproblem.  RitZ' vector  computation,  and  orthogonalization 
and  discussed  more  fully  in  [■!]. 
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FiO.  2.  Speedup  curves 


3.  PERFORMANCE  RESULTS  AND  ANALYSIS 

As  a  demonstration  of  its  performance,  LANZ  was  run  on  a 
medium  size  oigcnproblem  from  structural  engineering5  where  the  ten 
lowest  eigenpairs  were  found  in  22  steps  on  a  four  processor  CRAY 
Y-MP  A  smaller  problem6  was  run  on  a  twenty  processor  Encore 
Multimax  in  which  the  ten  lowest  eigenpairs  were  found  in  22  steps. 
It  is  clear  from  the  speedup  curves  in  Figure  2  that  a  speedup  plateau 
occurs.  The  main  cause  of  this  plateau  is  the  poor  speedup  realized 
in  the  forward  and  backward  matrix  solution  algorithms.  The  prob-  ■ 
lem  caused  by  the  matrix  solution  algorithms  is  exacerbated  as  the 
number  of  Lanezos-steps  increases,  because  each  Lanczos  step  re¬ 
quires  another  forward/backward  matrix  solution,  taking  more  and 
more  time  as  compared  to  factorization,  which  speeds  up  well.  This 
plateau  occurs  later  on  the  Encore  than  the  CRAY  because  the  En¬ 
core  does  not  have  to  contend  with  the  conflict  between  vectonzation 
and  parallelization:  -ector  lengths  decreasing  as  the  number  of  pro¬ 
cessors  increases.  However,  both  implementations  suffer  from  the 
poor  ratio  of  computation  to  synchronization  in  the  forward  and 
backward  matrix  solution  algorithms. 

If  problems  with  larger  bandwidths  were  used,  better  speedup 
from  these  algorithms  could,  of  course,  be  expected.  It  has  been  the 
authors’  experience,  however,  that  if  the  bandwidth  arising  from  a 
structural  engineering  problem  is  large,  then  most  likely  many  zeroes 
exist  inside  the  band,  and  therefore  sparse  methods  arc  best  used. 


*  Finding  the  vibration  modes  an  i  mode  shapes  ol  the  finite  clement  model 
of  a  circular  cylindrical  shell  [la].  In  Ibis  problem  n  »  12054  and  the  average 
semi-bandwidth  is  334. 

*  Finding  the  five  lowest  buckling  modes  and  mode  shapea  of  the  finite  element 
model  af  an  1  stiffened  panel.  In  this  problem  n  —  4474  and  the  average  semi* 
bandwidth  was  207. 


678 


4.  CONCLUDING  REMARKS 

A  pnralklLanczos  algorithm  for  finding  a  few  of  the  eigenpairs 
around  a  point  in  the  eigenipettrum  was  described.  Differences  in  the 
implementation  of  the  algorithm  on  a  multivcctor  processor  and  on  a 
multiprocessor  were  described.  The  algorithm  was  shown  to  perform 
reasonably  well  on  a  moderate  number  of  processors.  A  performance 
bottleneck  which  prevents  efficient  utilization  of  a  large  number  of 
processors  was  identified. 

Several  possible  modifications  to  the  LANZ  algorithm  can  be 
used  to  improve  its  parallel  performance.  The  use  of  dynamic  shift¬ 
ing  (1)  to  improve  parallelism  by  reducing  the  number  of  forward  and 
backward  matrix  solutions  was  investigated  in  (2)  and  was  found  to  be 
successful  when  the  eigenvalue  distribution  was  difficult.  The  use  of 
groups  of  processors  executing  the  LANZ  algorithm  independently  at 
different  shifts  was  inves  gated  in  [2]  and  was  found  to  be  successful 
when  many  eigenpairs  are  being  sought.  Block  Lanczos  holds  some 
promise  because  it  allows  several  forward  and  backward  matrix  solu¬ 
tions  to  occur  .simultaneously  [1],  The  improvement  in  performance 
resulting  from  block  Lanczos  will  depend  on  how  many  Lanczos  steps 
are  eliminated  and  what  block  size  can  be  effectively  used.  Unfortu 
natcly,  s-step.  Lanczos  methods  [Gj  will  not  alienate  the  bottleneck 
imposed  by  forward  and  back  solutions  and,  therefore,  will  not  have 
a  significant  effect  on  performance. 

Another  avenue  for  improving  parallel  performancc-is  the  use 
of  iterative  methods  to  solve  {K  -  oM)z  =  y  rather  than  direct 
methods.  However,  it  has  been  the  authors’  experience  that  ( I{  — 
oM)  is  often  poorly  conditioned  and,  therefore,  L  difficult  to  solve 
by  iterative  methods. 
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Abstract  Serial  computation  combined  with  high  communication 

costs  on  distributed-memory  multiprocessors  make  parallel  implc-  X,  and  Tj: 


mentations  of  the  QR  method  for  the  nonsymmctric  eigenvalue 

(TX 

- 

f 

Pm 

problem  inefficient.  This  paper  introduces  an  alternative  algo-  T  = 

j 

1  +  1 

7m 

Pm+l 

•  (2) 

rithm  for  the  nonsymmctric  tridiagonal  eigenvalue  problem  based 

K 

t2J 

Tm+1 

) 

on  rank  two  tearing  and  updating  of  the  matrix.  The  parallelism  ™  ,  ,  ..  .  .  .  , 

°  *  °  If  X,  and  Tj  arc  nondefective,  we  can  compute  the  eigcndecompo- 

of  this  divide  and  conquer  approach  stems  from  independent  so¬ 
lution  of  the  updating  problems.  sitions  T\  —  X\D\ A,  and  Zj  =  X3D2 A'2  .  Substituting  these 

decompositions  and  abbreviating  a  =  am  gives  the  matrix  product 


I.  Introduction 

The  eigenvalues  and  eigenvectors  of  a  nonsymmctric  matrix  A 
have  traditionally  been  computed  by  first  reducing  A  to  Hessen- 
berg  form  //  and  then  computing  the  cigendecomposition  of  II  by 
the  QR  method.  The  serial  nature  of  the  QR  method  conbincd 
with  the-high  cost  of  data  transfer  on  distributed-memory  mul¬ 
tiprocessors  has  made  parallel  implementations  of  this  approach 
inefficient  [7].  In  this  paper,  we  outline  an  alternative  algorithm 
for  the  nonsymmctric  eigenvalue  problem.  The  algorithm  uses 
a  divide  and  conquer  technique  and  follows  from  methods  that 
have  performed  well  both  serially  and  in  parallel  for  the  symmet¬ 
ric  tridiagonal  [4]  and  unitary  [2]  eigenvalue  problems  and  for  the 
bidiagonal  singular  value  problem  [10]. 

The  method  is  presented  here  for  nonsymmctric  tridiagonal 
matrices.  Matrices  of  this  form  arise  directly  from  certain  appli¬ 
cations  [1]  and  from  reduction  of  general  matrices  to  tridiagonal 
form  [5].  We  expect  ultimately  to  extend  our  divide  and  conquer 
technique  to  general  matrices. 

Throughout  this  paper,  unless  otherwise  specified,  capital  Greek 
and  Roman  letters  represent  matrices,  lower  ease  Roman  letters 
represent  column  vectors,  and  lower  ease  Greek  letters  represent 
scalars.  A  superscript  T  denotes  transpose.  The  vector  cj  is  the 
j-th  “canonical  vector”  with  all  elements  equal  to  zero  except  the 
/•th  which  equals  1. 


II.  The  Algorithm 


*••1  =  PmXi'cm,  V2  =  7m+|A'j ‘ei,  hi  =  7mA', Tem,  and  h2  = 
1X2  c,  for  canonical  vectors  c,  and  cm  of  appropriate  length. 
(The  algorithm  can  be  reformulated  to  account  for  defective  ma¬ 
trices  by  replacing  the  cigcndccompositions  X,  =  XiDtX{1  and 
Ti  =  XjDjXj1  with  ones  including  the  rank  deficient  left  and 
right  eigenvector  matrices  T\=  X\D{Y\  and  T?  =  X3D2Y2.) 

We  permute  the  elements  of  equation  (3)  to  form 


and  rewrite  the  interior  matrix  of  equation  (4)  as 


Let  T  be  the  following  n  x  n  real,  tridiagonal,  irreducible,  non- 
defective  nonsymmctric  matrix 

fa  t  (h  \ 

72  02  03 

T  =  -  (1) 

7n-l  1  0n 

\  7i> 

By  splitting  off  two  superdiagonal  elements  0m  and  0m+i  and  the 

corresponding  subdiagonal  elements  }m  and  jm+,,  we  can  wr«w 
the  matnx  X  in  terms  of  the  tridiagunal  nuns^mmetricsubmatriccs 


The  matrix  M  is  the  sum  of  a  diagonal  matrix  and  a  rank  two  non¬ 
symmctric  matrix.  The  eigenvalues  of  the  matrix  M  are  the  eigen¬ 
values  of  X.  The  left  and  right  eigenvectors  of  M  postmultiplicd 
by  XT  and  A'-1,  respectively,  arc  the  left  and  right  eigenvectors 
of  X. 

The  procedure  for  computing  the  eigenvalues  and  eigenvectors 
of  M  follows  basic  steps  similar  to  those  foi  the  cigcndecomposi 
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tion  of  a  diagonal  plus  symmetric  rank  one  matrix  developed  in 
[3,8],  but  because  Jl/  is  nonsymmetric,  the  details  differ  in  several 
important  ways.  Let  6i,...,6n  denote  the  diagonal  elements  of 
D.  If  no  eigenvalue  A  of  A/  equals  a  diagonal  clemcat  S},  then  the 
eigenvalues  of  Af  are  the  zeros  of  the  rational  equation 


ff(A)=(A-a)  + 


Vi(c£h)(£v) 

t-'  Si-  A 
1  =  1  * 


=  0 


(6) 


which  may  be  solved  cy  a  complex  rootfindor  such  as  Muller’s 
method  (11).  Because  they  are  also  the  eigenvalues  of  a  submatrix 
of  the  real  tridiagonal  matrix  T,  the  complex  eigenvalues  of  A/ 
occur  in  conjugate  pairs. 

Once  the  eigenvalues  have  been  computed,  it  is  a  straightfor¬ 
ward  matter  to  compute  the  eigenvectors  using  the  expression  for 
the  matrix  Af.  Let  A  be  a  computed  eigenvalue  of  Af .  One  expres¬ 
sion  for  the  corresponding  right  eigenvector  ijt  =  (gT,  ()  comes 
from  the  relation 


Specifically,  if  the  matrix  (D—  A)  is  nonsingular,  the  right  eigen¬ 


vector  is  given  by 


9 


(7) 


As  in  the  symmetric  case,  we  expect  the  divide  and  conquer 
method  to  be  a  good  parallel  method.  The  rank  two  tearing  of 
equation  (2)  can  be  applied  recursively  to  tridiagonal  submatri¬ 
ces  Ti  and  T2.  Parallelism  arises  boiluat  the  subproblcm  level 
(computing  T\  =  XiD^Xf1  and  T2  =  X^DiXf1  in  parallel)  and 
at  thc-rootfinding  level.  Both  levels  can  be  exploited  in  shared- 
memory  implementations  of  divide  andisonquer  algorithms  [4,10], 
but  no  implementation  on  a  distributed-memory  multiprocessor 
has  attempted  to  parallelize  the  rootfinding  tasks  [9].  As  in  the 
symmetric  case,  the  nonsymmetric  divide  and  conquer  algorithm 
can  be  pipelined  with  reduction  of  a  general  matrix  to  tridiago¬ 
nal  form  by  the  algorithm  ir.  [6].  As  soon  as  a  submatrix  has  been 
formed,  its  cigcndccomposition  is  computed.  Once  additional  sub¬ 
problems  have  been  solved,  rank  one  updating  can  begin. 
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where  £  is  selected  to  make  qTq  —  1.  A  similar  expression  can  be 


derived  for  the  corresponding  left  singular  vector. 

To  this  point,  the  derivation  of  the  divide  and  conquer  method 
for  the  nonsymcietric  eigenvalue  problem  requires  that  the  matrix 
(D-  A I)  be  nonsingular.  For  this  to  be  the  case,  no  eigenvalue  of 
Af  may  equal  a  diagonal  tlemcnt  of  D.  Equivalently,  no  element 
of  v  can  be  zero,  no  element- of  A  can  be  zero,  and  no  diagonal 
elements  of  D  may  be  equal.  We  now  show  how  to  deflate  the 
problem  in  exact  arithmetic  so  that  none  of  these  situations  arises. 
The  deflation  rules  not  only  produce  a  correct  form  for  the  matrix 
M  b ut  also  reduce  the  amountof  computation  needed  for  solving 
its  cigensystem. 

First,  if  the  jrth  element  of  e  is  zero,  then  ejM  =  A;cJ  where 
Cj  is  the  jth  canonical  vector  offcr.glh  n.  Thus,  Xj  is  an  eigenvalue 
of  Af  and  Cj  is  its  corresponding  left  eigenvector.  Likewise,  if  the 
jth  element  of  h  is  zero,  then  Me.  =  A ,e},  so  that  (A ,c})  is  a  right 
eigenpair  of  Af.  Rows  and  columns  of  the  matrix  Af  having  all 
zero  ofF-diagonal  elements  can  he  removed  from  the  matrix  and 
the  eigenvalue  problem  deflated. 

When  A,  =  S},  we  can  apply  unitary  similarity  transformations 
to  reduce  hi  =  cjh  to  zero  and  deflate  the  problem.  Let 

r»  =  !fcJ|I+|ft1|\  c=h, 

then  the  matrix  is  transformed  in  the  following  way 


(IT  *(:?)- 

After  transformation,  S,  is  an  eigenvalue  of  Af  with  right  eigenvec¬ 
tor  et.  Note  that  the  zero  structure  of  the  deflated  Af  guarantees 
that  the  n  x  n  matrix  Af  -  Af  has  rank  at  least  n  -  1.  Thus,  Af 
has  distinct  eigenvalues  and  a-eomplete  set  of  eigenvectors. 
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A  PARALLEL  VARIANT  OF  GMRES(m) 
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Abstract:  In  the  usual  implementation  of  GMRES(m)  [3]  the 
computationally  most  expensive  part  is  the  Modified  Gram- 
Schmidt  process- (MGS).  It  is- obvious,  that  the  MGS  process 
is  not  well  parallelizable  on  distributed  memory  multiproces¬ 
sors,  since  the  inner  products  act  as  synchronization  points  and 
thus  require  communication  that  cannot  be  overlapped.  Fur¬ 
thermore,  as  all  orthogonalizations  must  be  done  sequentially, 
MGS  generates  a  large  number  of  short  messages,  which  is  rel¬ 
atively  expensive.  Especially  on  large  processor  grids  the  time 
spent  in  communication  in  the  MGS  process  may  be  significant. 
For  this  reason  a  variant  of  the  usual  GMRES(m)  algorithm 
is  considered,  called  modGMRES(m),  which  first  generates  the 
vectors  that  span  the  Krylov  space  and  then  combines  the  MGS 
steps  for  a  group  of  vectors.  It  is  shown,  on  real  world  prob¬ 
lems,  that  the  modGMRES(m)  method  can  yield  a  considerable 
gain  in  time  per  iteration.  Numerical  experience  suggests  that 
the  total  number  of  iterations  remains  about  the  same  as  for 
GMRES(m). 

Int£Q.duction 

As£described  in.(2]  at  SHELL’S  KSEPL  the  reservoir  simulator 
Bosim  has  been  parallelized  on  a  Mciko  Computing  Surface,  a 
transputer  based  parallel  computer.  The  parallelization  is  based 
on  a  2-D  domain  decomposition,  where  the  reservoir  is  divided 
among  a  2-D  grid  of  processors,  in  addition  there  is  a  master 
processor,  which -handles  the  initialization  and  input  /output.  In 
Parallel  Bosim  the  largest  part  of  the  computation's  done  in 
Fortran.  On  each  processor,  the  Fortran  program  runs  in  par¬ 
allel  with  an  Occam  process.  The  Occam  processes  on  different 
processors  form  a  harness  that  takes  care  of  the  communication. 
When  Fortran  on  a  processor  has  to  communicate,  it  sends  the 
data  to  the  local  Occam  process  and  then  continues  until  its  next 
communication.  Meanwhile,  the  Occam  processes  concurrently 
take  care  of  the  communication  and  see  to  it  that  the  data  is 
returned  to  Fortran  on  the  receiving  processor(s).  In  this  way 
communication  and  computation  can  be  overlapped.  Within  this 
Parallel  Bosim  package  the  GMRES(m)  and  modGMRES(m) 
method  were  implemented  and  compared.  In  Bosim  the  conver¬ 
gence  in  the  linear  solver  is  checked  by  a  separate  routine,  which 
needs  the  residual  vector.  Therefore  the  convergence  in  the  lin¬ 
ear  solver  is  only  checked  after  each  complete  (mod)GMRES(m) 
cycle. 

The  modGMRES(m)  method 

Let  Ax  =  6  be  the  preconditioned  system,  and  let  r  =  6  —  /Is 
be  the  residual.  Let  tq  be  the  normalized  residual,  then  from  tq 
a  suitable  set  of  vectors  tq, ... ,  tim+i  ,  which  span  the  Krylov 
space,  is  generated  (see  below).  Then  in  the  MGS  process  these 
vectors  are  orthogonalized.  Because  the  Krylov  space  is  gener¬ 
ated  in  a  different  way,  the  Hcsscnbcrg  matrix  //m+i  =  VT AV 
must  be  computed  from  the  coefficients  of  the  MGS  process, 
where  V  is  the  matrix  The  rest  of  the  method 

is  analogous  to  the  GMRESfm)  method.  See  however  also  [lj. 

In  the  MGS. process  the  vectors  tq,  v2, . . . ,  um+i  are  orthog 
onalized  in  the  following  steps: 

1.  orthogonalizc  tq, . . . ,  0m+i  on  tq,  normalize  i2,  which  gives  v2 

2.  orthogonalizc  63 . .  on  tq,  normalize  63,  which  gives  v3 

Each  step  can  be  done  blockwisc,  because  the  orthogonaliza¬ 


tions  in  one  step  are  all  independent.  As  the  innerproducts 
computed  on  each  processor  are  strictly  local,  these  local  coeffi¬ 
cients  must  be  accumulated  over  the  processor  grid  to  compute 
the  global  coefficients.  This  is  done  blockwise  by  the  routines 
accs(array,len),  which  sends  the  array  to  Occam  and  returns 
so  that  Fortran  can  continue,  while  Occam  performs  the  actual 
accumulation  in  parallel,  and  accr(array,len),  which  receives 
the  accumulated  values  from  Occam.  The  MGS  process  is  im¬ 
plemented  as  follows  (locally  on  each  processor): 

do  i  =  l,m  —  1 

nbl  =  max(l,(m  —  t)/2) 
do  k  =  i,i  4-  nbl  —  1 
h(k,i)  =  vJVh 
&ccs(h(i,i),nbl) 

do  k  =  i  +  nbl ,  m  —  1  [concurrent  with] 

h(k,i)  =  vfvk+i  [accumulation] 

accr(/t(t,t),ni/) 
v,-+i  =  v.'+i  -  h(i,i)  *  Vi 
h(m,  i)  =u£., t\-+i 
accs  (h(i  +  nbl,  i),m  —  t  —  nbl  +  1 ) 
do  k  =:i  +  l,t  +  nbl  —  1  [concurrent  with] 

Vjt+i  =  t>*+i  —  h(k,i)  *  v;  j  accumulation-] 
accr  (h(i  4-  nbl,i),m  —  i  —  nbl  +  1) 
do  k  =  i  4-  nbl,  m  —  1 

Vk+ 1  =  »>*+ 1  —  h(k,i)  *  v, 
h(i,i  +  1)  =  sqrt(h(m,i)) 
u.+i  =  h(i,i  +  I)"1  *  vi+i 

In  this  implementation  communication  is  mostly  overlapped  and 
also  time  is  saved  by  combining  small  messages,  corresponding 
to  one  group  of  orthogonalizations,  in  one  large  message,  which 
saves  startup  times  and  Fortran-Occam  communication. 

The  generation  of  the  vectors,  that  span  the  Krylov  space, 
can  be  handled  in  two  ways.  If  the  condition  number  of  the 
preconditioned  system  is  sufficiently  small  and  m  is  also  rela¬ 
tively  small  (e.g.  10  or  20),  the  vectors  can  be  generated  as 
Vi,  Avi,  /l2tq,  .. . ,  Amvi,  where  A  is  the  preconditioned  matrix; 
this  will  be  referred  to  as  version  1.  However  for  larger  m  and/or 
a  preconditioned  matrix  A  with  a  large  condition  number,  the 
matrix  [t>i,  /Itq,  ...,  /lmtq]  will  be  so  poorly  conditioned  that 
orthogonalization  with  the  MGS  algorithm  will  not  produce  a 
set  of  sufficiently  orthogonal  Vj  and  consequently  will  result  in 
an  inaccurate  representation  of  //m+i-  Therefore  the  v,  might 
be  generated  as  follows: 

do  i  =  1 ,  m 

Vi+ 1  =  v;  -  diAiii,  ( i>i  =  t)i  ) 

where  the  d,  are  parameters,  which  should  be  chosen  in  such  a 
way  that  the  condition  number  of  the  matrix  [tii,V2,...,um+i] 
is  sufficiently  small.  This  will  be  referred  to  as  version  2.  The 
computation  of  the  di  can  be  based,  for  example,  on  the  eigen¬ 
values  of  IIm+ j.  The  exact  computation  of  these  parameters  is 
however  outside  the  scope  of  this  paper. 

Computational  and  Communication 
Costs  of  GMRES(m)  and  modGMRES(m) 

The  total  computational  costs  will  be  expressed  in  terms  of  the 
timings  of  the  main  computational  kernels.  The  computational 
costs  for  GMRES(m)  on  each  processor  arc  given  by: 

Cfmrc,  =  ^(m2  +  3m)Tdjol  +  i(m2  +  3m)?i„py  + 

(m  +  \)TjJcai  +  (m  +  1  )Tmo(  + 

(rn  +  1  )Tprcc  -b  Tlman  ( 1 ) 
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The  computational  costs  for  modGMRES(m)  version  Ton  each 
processor  are  given  by: 

cngm,i  =  ^(m2  +  Zm)Tddot  +  ^(m2  +  3m)TJalpy  + 

(m  +  l)Td,cai  +  (m  +  l)Tma(  + 

(m  +  l)Tpree  +  Ti;ncon  +  The,,(m)  (2) 

and  for  version  2  by: 

~~  q [pi  4“  3f?i)7'jj‘0;  -f  ~(m2  T  5ni)7!v3l:py  4- 
(m  +'l)TiJCa|  +  (m  +  l)!Tma(  + 

TT)Tprec  +  T/incdn  4*  The33(rn)  (3) 

where  lincon  is  the  routine  that  checks  whether  convergence  is 
reached  and  Hess  is  the  routine  that  computes  Hm+\  in  modGM- 
RES(m).  The  communication  costs  for  GMRES(m)  are-given 
by: 

^mr«  =  2  (m2  +  3m)raK,oln  (4) 

where  accsum  is  a  Fortran  routine  that  sends  one  number 
to  Occam,  waits  for  Occam  to  accumulate  the  values  over  the 
processor  grid  and  receives  back  the  global  result.  The-commu- 
nication  costs  for  modGMRES(m)  are  given  by: 

C™m  =  2rnTacc,  4-  2mTaccr  4-  Tovh(,n)  4-  Tnoc  (5) 

To  Am)  =  2m7’c+|m2repn  (6) 

where  Tovh  indicates  the  time  overhead  measured  in  the  daxpy’s 
and  ddot’s  which  overlap  the  accumulation,  Tc  is  some  constant 
time  and  Tcpn.  gives  a  time  increase  per  number.  Tnoc  indicates 
the  cost  of.  lion-overlapped  communication/accumulation. 

Besults 

The  GMRES(m)  and  the  mudGMRES(m )  method  were  com¬ 
pared  simulating  a  real  reservoir  for  a  large  number  of  iterations. 
As  the  simulation  had  to  be  done  on  a  fairly  small  machine  (1 
master  and  24  gridnodes),  whereas  the  modGMRES(rn)  method 
will  only  be  really  advantageous  on  a  relatively  large  processor 
grid,  involving  100  or  more  processors,  a  small  reservoir  was 
simulated  on  a  ID  (line)  processor  grid.  This  gives  24  communi¬ 
cation  steps  for  accumulating  a  distributed  value  over  the  grid, 
which  compares  to  a  processor  grid  of  some  150  processors.  The 
number  of  unknowns  in  this  problem  was  2138,  which  gave  a 
maximum  of  l05  unknowns  on  aproccssor.  With  an  average  of 
some  90  unknowns  per  processor  and  150  processors  this  com¬ 
pares  to  a  reservoir  with  about  13500  (active)  gridblocks,  which 
is  a  medium  scale  reservoir  model.  This  produced  the  following 
average  timings  on  the  busiest  processor: 


computational 

immmm 

KZDM 

F'daxpy 

0.30594 

F accsum 

0.62041 

Tdjot 

0.24707 

'Faces 

0.16000 

Tdscal 

0.12354 

Taccr 

0.06400 

IUSWBB— M 

2.8251 

Tc 

0.35625 

mammm 

mxmm\ 

'An 

0.16293 

3.0336 

T 

6.9964 

HH 

1.2060 

im 

7.4160 

\mmmm 

96.046 

Inserting  these  timings  in  (1)  and  (4)  for  GMRES(m),  in  (2),  (5) 
and  (6)  for  modGMRES(m)  version  1,  for  m  =  10  or  20,  and  in 
(3),  (5)  and  (6)  for  modGMRES(m)  version  2,  for  m  =  50,  leads 
to  the  following  tables: 


m 

~  time  (ms) 

time  diff. 
(%) 

modGMRES(m) 

GMRES(m) 

10 

126.12 

138.49 

10 

20 

313.43 

385.91 

23 

50 

1390.2 

1832.3 

32 

---  -  - 

m 

efficiency  (%) 

modGMRES(m) 

GMRES(m) 

10 

66 

60 

20 

66 

54 

50 

63 

47 

These  theoretical  efficiency  figures  are  based  upon  the  model  de¬ 
scribed  above,  with  13500  grid  blocks,  a  processor  grid  of  150 
processors  and  one  master  processor.  The  number  of  commu¬ 
nication  steps  for  accumulating  a  distributed  value  is  24  and 
the  maximum  number  of  blocks  on  a  processor  is  105.  Further¬ 
more  communication  costs,  other  than  in  the  global  accumu¬ 
lation  of  distributed  values,  are  neglegible.  For  GMRES(IO), 
GMRES(20),  modGMRES(lO)  and  modGMRES(20)  the  overall 
timings  were  also  determined  experimentally  on  the  busiest  pro¬ 
cessor,  which  leads  to  the  following  table,  containing  the  average 
time  per- iteration: 


m 

time  (ms) 

time  diff. 

% 

modGMRES(m) 

GMRES(m) 

10 

126.09 

137.13 

0 

20 

314.58 

383.94 

22 

FYom  these  tables  lt  is  obvious  that  the  modGMRES(m)  method 
can  yield  a  substantial  improvement  in  time  per  iteration.  Fur¬ 
thermore,  for  these  simulations,  there  was  no  difference  in  the 
total  number  of  iterations  between  GMRES(m)  and  modGM- 
RES(m).  With  respect  to  the  (theoretical)  parallel  efficiency, 
it  can  be  seen  that,  for  increasing  in,  the  decrease  in  efficiency 
of  modGMRES(m)  is  much  less  than  for  GMRES(m)  This  is 
explained  by  the  fact,  that  the  communication  costs  increase  ex¬ 
ponentially  with  m,  and  these  are  much  higher  for  GMRES(m) 
than  for  modGMRES(m). 
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Abstract:  We  consider  the  performance  of  the  Jacobi  S7  itera¬ 
tive  method  applied  to  linearsystems  arising  from  partial  differential 
equation  problems.  The -E/T  methodology  is  applied  to  experimental 
data  from  a  128  processor  NCUBE  1.  The  observed  performance  of 
the  implementation  is  seen  to  bepoor,  reasons  for  tins  arc  presented 
and  remedies  suggested . 

1.  INTRODUCTION 

We  describe  the  applications  of  the  Event  Thread  of  Control  (E/‘l ) 
methodology  for  parallel  performance  evaluation  to  iterative  methods 
implemented  on  an  NCUBE  1  (a  distributed  memory  machine).  The 
E/T  methodology  is  to  collect  traces  of  events  and  from  their  general 
behavior  infer  certain  aspects  of  program  performance,  see  [2j.  Several 
kinds  of  events  are  traced,  of  interest  here  arc  Read  and  Hi  de  events 
as  they  relate  to  the  communication  and  synchronization  delays  that 
occur  in  parallel  iterative  methods. 

The  key  item  in  the  E/T  methodology  is  the  characteristic  function 
g  defined  by  E  =  g(P)  where  E  is  the  number  of  events  and  P  is  the 
number  of  threads  or  processors.  The  methodology  uses  assumptions 
of  conservation  and  monoticity  of  work  to  derive  various  relationships 
among  performance  measures,  c.g.,  speed  up,  work,  load  balancing. 
A  typical  result  is:  If  g{P)  is  increasing  and  convex,  then  the  work 
per  thread,  IK(P),  is  convex.  Let  P"  be  the  unique  solution  of  P  = 
[iV(l)/0  +  g(P)]/g'(P),  then  the  speed  up  is  a  maximum  at  P".  Here  6 
is  the  additional  work  required  of  a  thread  when  an  event  occurs  and 
is  characteristic  or  the  hardware  and  operating  system. 

The  iteration  considered  is  The  Jacobi  SI  method  .applied  to  the 
linear  system  that  arises  from  solving  an  elliptic  PDE  in  two  dimen¬ 
sions.  This  iteration  is  inherently  parallel  and  can  be  summarized  on 
a -P  processor-machine  as  follows: 

Initialize 

For  NITER  =  1  to  LAST 

For  NPROC  =  1  to  P 

Do  all  iterations  on  my  equations 
Send  my  boundary  variables  to  neighbors 
Receive  neighbors  boundary  variables 

End 

End 

The  actual  computation  is  complicated  by  stops  to  test  for  conver¬ 
gence  and  to  adapt  iteration  parameters.  These  steps  require  global 
communication. 

The  NCUBE  1  used  has  128  processors  with  boll  communication 
and  computation  handled  by  the  single  processor  at  each  node.  Com¬ 
munication  is  expensive  on  this  machine  relative  to  computation. 


2.  EXPERIMENTS  AND  MONITORING 

ihc  TRIPLEX  tool  set  [I]  I&  used  u>  culkci  tin*  tt«iu  fur  two 
computations: 

‘This  research  supported  in  part  by  NSF  grant  CUR  8G-10817  and  by  the  Strate¬ 
gic  Defense  Imtiatne  through  ARO  grants  IMACiO-l-Sb-iv-oiun  an*.  iiaA l.ul-iu- 
0107. 


solid;  PDE  problem  with  33  x  33  grid  (about  1000  unknowns)  on  a 
nonrectangular  domain  (see  Figure  5).  Two  to  128  processors 
used. 

dash  PDE  problem  with  50  a  50  grid  (about  2500  unknowns)  on  a 
square.  Four  to  64  processors  used. 

The  names  solid  and  dash  refer  to  the  lines  used  in  the  graphical  data 
given  below.  The  communication  procedure  used  is  to  send  all  data 
from  one  processor  to  all  other  processors  (broadcast).  This  inherently 
inefficient  scheme  was  used  because  (a)  the  mapping  of  subdomains 
to  processors  was  not  known,  (b)  the  system  utilities  for  multicasting 
do  not  work  properly,  (c)  we  wanted  to  guarantee  that  the  converges 
properties  of  the  iterative  method  remain  the  same.  Time  is  measured 
in  units  of  a  tick  which  is  about  0  1  msec.  Five  iterations  were  made. 

3.  MEASUREMENTS  AND  DISCUSSION 

Figure  1  shows  the  most  basic  data  obtained  m  the  E/T  method¬ 
ology,  the  characteristic  function  E  =  g(P),  the  number  of  events  per 
thread  (or  processor).  The  average  (expected)  number  of  events  per 
thread  are  shown  as  a  function  of  P  using  solid  and  dash  lines  for  the 
two  experiments.  The  95%  level  confidence  intervals  as  computed  from 
the  experimental  data  arc  shown  by  +  (for  the  solid  case)  and  i  (for 
the  dash  case).  We  see  that  g{P)  grows  linearly  with  slope  about  two 
on  this  semi-logarithmic  plot  so  g(P)  ~  0(P 2).  It  is  known  [2]  that 
such  a  computation  cannot  exploit  high  parallelism  well. 


Number  of  Threads  of  Control  log^P) 

Figure  X:  The  expected  number  of  events  per  thread  of  control  and  a 
95%  confidence  interval  for  it. 

Blocking  is  an  important  source  of  low  performance,  we  illustrate 
the  phenomena  in  Figure  2.  At  lime  fj  processor  P,  executes  a  READ 
and  at  lime  U,  the  requested  result  is  available.  The  time  lj  -  <i  is 
algorithmic  blocking,  the  time  spent  waiting  because  processor  P3  has 
not  yet  computed  the  data  Pi  requests.  The  time  <3  -  f2  is  propagation 
delay,  the  time  spend  waiting  for  the  WRITE  opera'ion  to  be  exe¬ 
cuted  and  the  time  i.|  -  tj  is  transmission  delay.  The  propagation  and 
transmission  delays  on  the  NCUBE  1  are  much  larger  than  the  ones  in 
second  and  third  generation  hypercubes,  but  it  is  usually  algorithmic 
blocking  that  causes  very  poor  performance.  The  total  time  t\  -  t,  is 
often  called  synchronisation  delay. 
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Fig-jre  2:  Communication  involving  blocking. 

1'igure  3  shows  the  expected  algoriliiinic  blocking  time  as  a  frac¬ 
tion  of  the  total. blocking  time  for  these  two  PDE  computations.  The 
most  obvious  fact  is  that  algorithmic  blocking  increases  strongly  as 
the  number  of  processors  increases.  Note  that  the  irregular  behavior 
of  these  two  curves  are  similar  and  can  be  explained  from  a  detailed 
analysis  of  the  characteristics  of  this  computation  (3). 

Figure  <1  shows  the  computing  time  as  a  fraction  of  the  total  non- 
blocked- time  per  thread.  Here  time  is  partitioned  into  blocked  (sec 
Figure  2),  performing  I/O  (Read  or  Write),  and  computing  (presum- 
ably  the  useful  work).  We  sec  that  the  fraction  of  computing  time 
decreases  rapidly  with  increasing  P,  in  an  ideal  case  one  hopes  for  this 
to  decrease  much  more  slowly. 


Number  of  Threads  of  Control  log^P) 


Figure  3:  The  expected  algorithmic  blocking  time  during  a  read  oper¬ 
ation  as  a  fraction  of  the  total  blocking  time  during  a  read  operation. 

4.  CONCLUSIONS 

Our  E/T  model  predicts  that  parallelism  cannot  be  effectively  ex¬ 
ploited  if  the  characteristic  function  g(P)  is  quadratic  in  P.  Our  ex¬ 
periments  show  that  g(P)  is  quadratic  and  that  the  speed  up  obtained 
is  low.  Further  analysis  of  this  data  [Jj  provides  other  conclusions, 
namely.  (I)  The  cost  of  synchronization  of  the  iteration  is  quite  high, 
(2)  The  Jacobi  SI  code  adapts  the  iteration  parameters  and  tests  for 
termination  often,  this  results  in  even  poorer  performance  due  to  the 
relative  inefficiency  of  these  compulations  f  r  a  distributed  memory 
machine.  A  self-synchronization  approach  is  presenled-and  discussed 
in  (2)  which  can  alleviate  these  synchronization  delay  problems.  Other 
approaches  to  improve  performance  arc. presented  in  [3]. 


Number  of  Threads  of  Control  logi{P) 


Figure  4:  The  expected  computing  time  as  fraction  of  the  non-blocked 
time  per  thread. 


Figure  5:  The  nonrcctangular  PDE  domain  and  its  decomposition. 
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Abstract.  ITPACKV  2D  is  &  research-oriented  numerical  software  package  of  iterative 
algorithms  for  solving  large  sparse  systems  of  linear  equations  de\ eloped  in  the  Center 
for  Numerical  Analysis,  The  bruversuy  of  Texas  at  Austin.  The  intent  of  this  paper 
is  to  report  on  the  project  of  parallelizing  this  software  on  the  eight-processor  Cra> 
Y-MP  supercomputer  using  its  advanced  multitasking  facilities.  Model  problems  in  two- 
dimensions  and  three-dimensions  are  tiled  to  test  the  performance  of  the  parallelized 
tersion  of  the  package  using  one  to  eight  processors.  Numerical  results  are  used  for 
comparing  the  performance  of  the  routines  in  this  package,  for  determining  the  speedup 
ratios  for  them,  and  for  drawing  general  conclusions  with  regard  to  the  efficiency  and 
parallel! zability  of  each  of  the  method*. 

I.  Introduction.  The  ITPACK  Project  was  started  over  a  decade  ago 
in  the  Center  for  Numerical  Analysis  of  The  University  of  Texas  at  Austin 
to  conduct  basic  research  on  iterative  algorithms  for  solving large  sparse 
systems  of  linear  algebraic  equations  The  emphasis  has  been  on  devel¬ 
oping,  testing,  and  evaluating  software  for  solving  linear  systems  arising 
from  partial  differential  equations  discretized  using  finite-differences  and/or 
finite-elements.  Several  ITPACK  packages  have  been  developed,  modified, 
improved,  and  changed  through  various  versions. 

In  the  ITPACKV  2D  package,  the  basic  iterative  methods  [.Jacobi  (J) 
Reduced  System  (RS),  and  Symmetric  Successive  Ovcrrclaxation  (SSOR)] 
arc  combined  with  two  acceleration  procedures;  namely,  Chcbyshev  (SI) 
and  Conjugate  Gradient  (CG).  Also,  included  in  the  package  is  the  Succes¬ 
sive  Ovcrrclaxation  (SOR)  method.  The  package  uses  adaptive  procedures 
for  the  selection  of  the  acceleration  parameters  and  for  automatic  stopping 
tests.  These  routines  work  best  when  solving  systems  with  symmetric  pos¬ 
itive  definite  or  mildly  nonsymmetric  coefficient  matrices. 

The  basic  iterative  routines  available  in  the  package  are  as  follows. 

JCG  Jacobi  Conjugate  Gradient 
JSI  Jacobi  Semi-Iteration 
SOR  Successive  Ovcrrclaxation 
SSORCG  Symmetric  SOR  Conjugate  Gradient 
SSORSI  Symmetric  SOR  Semi-Iteration 
RSCG  Reduced  System  Conjugate  Gradient 
RSSI  Reduced  System  Semi-Iteration 
Two  orderings  of  the  unknowns  in  the  l<r«ar  system  arc  available:  the  nat¬ 
ural  (lexicographic)  ordering  and  the  red-blacf.  (checker-board)  ordering. 

II.  Vcctorization.  ITPACKV  2D  (8, 10]  is  a  modified  version  of  ITPACK 
2C  (11)  with  enhanced  vcctorization  capabilities.  The  primary  changes  made 
for  the  vectorized  version  (13]  arc 

1.  changing  the  storage  formal  for  the  coefficient  matrix  from  the 
“Yale  sparse  storage  format”  (4]  to  the  “ELLPACK  matrix  storage 
format”  [15]  since  the-  latter  is  more  vcctorizablc,  and 

2.  using  a  wavefront  orderiry  (ordering  by  diagonals)  to  enable  SOR, 
SSORCG,  and  SSORSI  routines  to  vectorize  under  natural  ordering. 

The  primary  vcctorizablc  and  parallclizablc  operations  in  the  iterative  alge  • 
rithms  in  ITPACKV  2D  [7]  arc  matrix-vector  multiplications,  forward  solves 
and  backward  solves. 

A.  Matrix- Vector  Multiplication.  The  Yale  sparse  matrix  form;.' 
[4],  as  used  in  ITPACK  2C,  is  a  row  wise  storage  format  using  three  line-., 
arrays. a,  ja.ia.  With  this  data  structure,  a  mntrx  vector  multiplication 
of  the  form  Axi  results  in  operations  where  the  maximum  vector  length  i« 
equal  to  the  number  of  nonzero  elements  in  the  row,  wlfirh  may  .mall 
for  sparse  matrices. 

In  the  ELLPACK  sparse  matrix  storage  format  [15],  a  rectangular  array 
co ef  stores  the  nonzero  elements  of  the  scaled  coefficient  matrix  A  in  a 
row-wise  fashion.  [The  original  linear  system  Ax  =  b  is  initially  sealed  l,y 
the  diagonal  D  =  diag(A)  with  =  (ir,/3t)  so  that 

it  assumes  the  form  (/  —  0}u  =  k,  The  enltics  in  coo  1  arc  also  re-ordered 
when  the  red-black  or  wavefront  ordering  is  used.]  Another  rectangular 
array  jeoel  stores  the  column  numbers  of  the  corresponding  elements  in 
coo i.  If  caxnz  is  the  maximum  number  of  nonzero  elements  per  row  in  .4 
and  n  is  the  number  of  columns,  then  the  matrix-vector  product  ir>  —  i+Gu 
can  be  computed  with  this  data  structure  as  follows. 

do  20  j  -  l.staxnz 
do  10  1=1, n 
w(i)  =  rhs(i) 

10  continue 

do  15  1  =  l,n 

u(i)  =  s(i)  +  eoef(i.j)*u(jco«f(i,j)) 

!5  continue 

20  continue 


This  approach  has  the  advantage  .hat  ill ;  vector  lengths  are  1  -eg  (equal  to 
n,  the  order  of  the  system)  and  only  oaxnz  gather  operations  „  e  required. 
Hence,  there  are  fewer  vector  start-up  costs  compared  to  the  ong  nal  format 
used  in  this  package. 

D.  Forward  and  Backward  Solves,  forward/ Backward  sole  ns  of 
sparse  triangular  matrices  arc  a  major  component  of  the  SOR  and  SSOR 
routines  with  the  natural  ordering.  Since  these  routines  do  not  vectorize  in 
this  situation,  the  unknowns  arc  re-organized  using  a  wavefront  ordering. 
Several  authors  [1,  2,  3,  16]  have  noted  that  this  ordering  can  effectively 
vectorize  the  forward  solution  process  of  a  5-poml  fiintc-diffcrcncc  stencil 
on  a  rectangular  grid. 

Although  this  concept  of  wavefront  ordering  is  applied  in  ITPACKV  2D  to 
vectorize  the  SOR  and  SSG;.  routines  in  the  case  of  natural  ordering,  the  vec¬ 
tor  lengths  arc  still  much  shorter  than  for  the  Jacobi  or  the  Reduced  System 
routines. 

III.  Microtasking.  Th»  basic  parallelizing  technique  used  is  to  par¬ 
tition  do-loops  into  segments.  This  partitioning  is  done  by  introducing  an 
outer  loop  that  defines  these  partitions  and  assigns  them  to  available  proces¬ 
sors.  The  beginning  of  a  parallel  do-loop  is  marked  using  a  control  command 
directive. 

for  example,  the  computation  of  a  matrix-vector  product  w  —  k  +  Cu 
is  shown  below. 

CHICS  DO  ALL  SHARED  (ntask,n,caxnz,u,u,rhs,coeI, jeocf) , 

CHICS*  PRIVATE  («c,i,j,ist,ied) 
do  25  k  =  l.ntask 

ist  =  C(k-l)*n)/ntask  +  1 
ied  =  (k*n)/ntask 
do  10  i  ?  ist, ied 
u(i)  =  rhs(i) 

10  continue 

do  20  j  =  l.naxnz 
do  IS  i  =  ist, ied 

»{i)  =  w(i)  +  coeI(i, j)*u(jcoef (i, j)) 

15  continue 

20  continue 

25  continue 

Here  ntask  is  the  number  of  available  p.occssors.  The  CHICS  DO  ALL  direc¬ 
tive  enables  parallel  execution  tisin;  several  processors  with  each  computing 
a  range  of  rows  determined  by  the  variables  ist  and  ied.  For  this  directive, 
the  si.cpc  of  each  variable  (shared  and  private)  used  within  the  region  must 
be  def.-ied.  Notice  that  no  synchronization  is  needed  within  the  loops.  For¬ 
ward  and  backward  solves  arc  also  parallelized  using  the  same  basi;  idea  of 
partitioning  the  outer  loop. 

For  the  iterative  algorithms  under  rcd-black  ordering,  the  matrix-vector 
multiplication  can  be  partitioned  in  such  a  way  that  all  the  red  points  are 
updated  m  parallel  and  then  all  the  black  points.  Ihus,  a  single  synchro- 
iiizetiun  point  is  needed.  In  the  Reduced  System  method  based  on  the  black 
points,  for  example,  the  computation  is  ui/j  —  cn+f'/iup,  wp  —  cp+Fnwn 
,.ml  it  can  be  carried  out  as  shown  in  the  displayed  code  below. 

CHICS  PARALLEL  SHARED  (ntask,nr,nb,caxnz,tr,rhs,u,eoci  ,ycoof) , 
CHICS*  PRIVATE  (k,i,y,ist,ied) 

CHICS  DO  PARALLEL 

do  25  k  =  l.ntack 

ist  =  C(k-l)*nb)/ntask  +  nr  *  1 
ied  =  (k*nb)/ntask  +  nr 
do  10  i  =  ist.iod 
u(i)  =  rhs(i) 

10  continue 

do  20  j  =  2,caxnz 
do  15  i  =  ist, ied 

v(i)  =  v(i)  +  coef{i,j)*uf jcoefti.j)) 

15  continue 

20  continue 

2o  continue 
CHICS  END  DO 
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CHIC*  DO  PARALLEL 

do  45-k  =  l.ntask 

ist  =  ((k-l)*nr)/ritask  +  1 
icd'=  (k*nr)/r.task 
do  30  i  =  ist.ied- 
w(i)  =  rhs(i) 

30  continue 

do  40  j  =  2,caxnz 
do  35  i  =  ist.ied 

»(i)  =  w(i)  +  cool(i,j)»u(jco«f(i,j)) 

35  continue 

40  continue 

45  continue 
CHIOS  END  DO 
CHICS  END  PARALLEL 

XV.  Model  Problems.  The  parallelized  version  of  ITPACKV  2D  was 
tested  on  the  Gray  Y-MP ~  and:  was  applied  to  sparse  matrix  problems  re¬ 
sulting  from  a  (inite-dilfcrcncc  discretization  of  partial  differential  equations 
in  two-dimensions  f2-D)  and  three-dimensions  (3-D).  The  two  model  prob¬ 
lems  are  described  in  this  section. 

2- D  Model  Problem 

u«  -i-  2uys  =  0,  (z,  y)  6  n2  =  (0, 1)  x  (0, 1), 

u  =  l+zy,  (z,y)  6  uQi. 

This  problem  was  discrctiz.d  using  the  standard  5  point  finite  difference 
stencil  with  mesh  sizes  h  -  1/100  and  h  —  1/110  resulting  in  systems 
of  size  N  —  992  =  9,80’.  and  -V  =  1392  =  19,321,  respectively  The 
stopping  criterion  used  is  given  by  [1/(1  -  jUe)]||  6<nt  ||j/||  ufn'  ||i  <  (, 
where  St")  =  <7zb*l  +  k  —  is  the  pscudo-rcsidu.il  at; the  nth  iteration, 

uf">  is  the  nth  iterative  approximate  solution  vector,  and'M#  is  an  estimate 
of  the  maximum  eigenvalue  of  the  iteration  matrix  G  [5].  For  this  stopping 
test,  (  was  taken  to  be  10-6. 

3- D  Model  Problem 

’  Urr  +  2usy  +  u„  =  0,  (z,  y,  r)  e  «3  =  (0, 1)  X  (0, 1)  x  (0,  l), 
u  =  1,  if  z  =  0  or  y  =  0  or  z  =  0, 

ur  =  yz(  1+yz),  ifz=l, 

Uj,  =  zz(l  +  zz),  ify  =  1, 

u,  =  zy(  1+xy),  if  z  =  1. 

When  the  standard  7-point  finite-difference  stencil  was  used  with  mesh  sizes 
h  =1/20  and  /i  =  1/30,  the  resulting  problem  sizes  were  .V  =  20’  =  8,000 
and  rV  =  303  =  27,000,  respectively. 

For  both  problems,  all  the  routines  were  tested  using  both  natural  or¬ 
dering  and  red-black  ordering  of- the  unknowns.  The  various  iteration  pa 
ramcicrs  needed  in  the  algorithms  were  determined  using  adaptive  proce¬ 
dures.  The  only  exceptions  were  me  SSORCG  and  SS0RSI  algorithms  where 
the  relaxation  factor  u  was  fixed  to  be  1  for  the  red-black  ordering. 

V.  Results  and  Discussion.  Among  the  different  multitasking  tools 
provided  by  the  Cray  computer  systems,  mic-.itasltny  seems  best  suited  for 
parallelizing  ITPACKV  2D  since  this  software  has  the  potential  for  parallelism 
more  at  the  do-loop  level.  The  basic  principles  followed  in  mn.rolast.inj 
this  package  involved  partitioning  the  loops  into  equal  segments  that  are 
assigned  to  available  processors  and  combining  do-loops  into  long  parallel 
regions,  wherever  possible,  in  order  to  reduce  parallel  startup  costs 

The  model  problems  in  2-D  and  3-D  given  above  were  used  to  test  the 
performance  of  the  mtcrolaskcd  version  for  varying  number  of  processors. 
The  maximum  number  of  processors  used  was  eight.  All  the  tests  were  run 
in  dedicated  mode.  The  numerical  results  are  presented  in  [11] 

In  comparing  the  timings  between  the  uni-processor  version  and  the 
sequential  version,  it  was  observed  that  the  sequential  code  was  faster  than 
the  uni-processor  version  of  the  parallelized  code  for  most  all  of  the  routines 
This  is  due  to  the  overhead  costs  associated  with  the  loop  partitioning  in 
the  parallelized  code. 

With  regard  to  overall  speed,  SSORCG  and  SS0RSI  were  the  fastest  rou¬ 
tines  using  only  a  single  processor  for  the  smaller  2-D  problem  However  for 
eight  processors,  JCG  was  the  fastest  due  to  its  superior  parallelization.  For 
the  larger  2-D  problem,  SSORSI  was  the  fastest  on  a  single  processor  and 
JCG  performed  the  Fast  for  eight  processors.  The  fastest  routines  using  one 
processor  for  the  smaller  3-D  problem  were  JCG  and  SSORCG  under  natural 
ordering.  For  the  larger  problem,  SSORCG  was  the  fastest  routine.  For  eight 
processors,  JCG  gave  the  best  result  for  both  problems  since  it  parallelized 
very  well.  Ui.der  red-black  ordering,  all  the  routines  performed  reasonably 
well  with  the  RSCG  being  the  fastest  routine  for  all  the  problems  for  any 
number  of  processors. 


The  speedup  ratios  obtained  for  the  larger  problems  (both  2-D  and  3-D) 
were  better  than  that  obtained  for  the  smaller  problem.  Under  natural 
ordering,  the  JCG  and  JSI  routines  gave  good  speedup  results  while  the 
SOR  and  SS0R  routines  performed  quite  poorly.  In  general,  the  wavefront 
ordering  used  for  these  routines  resulted  in  short  vector  lengths  and  also 
required  the  processors  to  synchronize  too  often.  However,  the  SOR  and 
SSOR  routines  had  improved  speedups  under  the  natural  ordering  for  the 
3-D  problems.  This  was  due  to  the  fact  that  there  were  fewer  wavefronts  for 
the  3-D  problems  in  comparison  to  the  2-D  problems.  This  minimized  the 
number  of  synchronization. points.  Under  red-black  ordering,  all  routines 
had  good  speedups.  For  both  ordering,  the  speedup  ratios  obtained  for  the 
3-D  problems  were  not  as  good  as  those  obtained  for  the  2-D  problems. 

Since  the  largest  speedup  does  not  imply  the  fastest  procedure,  the 
recommended  routines  in  this  parallel  package  are  RSCG  when  the  unknowns 
can  be  re-ordered  into  the  red-black  ordering  and  JCG  otherwise. 
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Introduction 

Thispapcr  des  ribs  new  mapping  algorithms  for  domain-oriented  data- 
parallel'  amputations,  where  the  workload  is  distributed  irregular!)  through¬ 
out  the  domain  We  consider  the  problem  of  partitioning  the  domain  (rep¬ 
resented  as  an  n  r  m  array  of  execution  weights)  for  an  ,V  x  M  array  of 
locally  connected  parallel  processors,  in  such  a  way  that  the  workload  on  the 
most  heavily  loadcd  processor  is  minimized,  subject  to  the  constraint  that 
the  partition  be  perfectly  rectilinear,  as  illustrated  by  Figure  1.  The  total 
execution  weight  of  a  processor  is  the  sum  of  all  execution  neighu  assigned 
to  its  rectangle  Data  parallel  computations  tend  Urban.  localized  data  de¬ 
pendencies,  rectilinear  partitions  ensure  that  all  communication  induces  by 
localized  data  dependencies  is  between  local  processors,  this  algorithm  will 
be  particularly  useful  on  architectures  where  there  is  a  high  differentia!  be¬ 
tween  the  cost  of  local  and  global  communication  Wc  will  nut  explicitly 
include  commur  icalion  costs  in  our  model.  Our  implicit  assumption  is  that 
communication  casts  will  be  minimized  when  locality  is  ensured. 

This  paper  ,  covides  an  improved  algorithm  fur  finding  the  optimal  par- 
tilior  in  or.e  di-  ehsion  new  algorithms  for  partitioning  in  two  dimensions, 
and  show?  that  r  ptin  al  partitioning  in  three  dimensions  Is  XP-complctc.  Wc 
d:scuss  our  application  of  these  a'gorilhms  to  real  problems. 


Figure  1.  Rectilinear  Partitioning  of  Two  Dimensional  Domain 


One  Dimensional  Partitioning 

The  rectilinear,  partitioning  algorithm  in  one  dimension  has  been  extensively- 
studied  as  the  chains-on-chains  partitioning  problem  (1,  3,  -I,  5]:  wc  are 
given  a  linear  sequence  of  work  pieces  (called  modules),  and  wish  to  partition 
the  sequ  nce  for  execution  on  a  linear  array  of  processors  The  best  known 
published  algorithm  to  date  finds  the  optimal  partitioning  in  O(.tfmlogm) 
time,  where  if  is  the  number  of  processors  and  m  is  the  number  of  modules. 
This  solution  repeatedly  calls  a  probe  function.  This  function  accepts  an 
argument  IF,  and  uses  a  greedy  workload  assignment  algorithm  to  determine 
whether  there  is  a  partition  that  assigns  no  more  than  IF  work  to  each 
processor,  probe  is  used  in  conduction  with  a  search,  in  order  to  find  the 
minimal  IF  for  which  there  exists  a  feasible  partition.  The  cost  of  calling 
probe  is  0(il  logmy.  Tree  tons  solutions  nave  invoiced  calling  probe  U{in) 
times.  Weliavcanew  southing  strategy  that,  reduces  the  tailing  frequency  to 
0(. \!  log  m),  thereby  reducing  the  complexity  of  one-dimensional  partitioning 
to  0(m+M7  log*  in). 


"Thu  research-  was  supported  in  pan  by  the  Aimy 
Avionics  Research  and  Development  Activity  ihrongh 
NASA  grant  XAG-I  "t.  in  pan  by  NASA  grant  N  *G- 
1-1132,  and  in  part  by  NSF  Granl  ASC  8M93T3. 


Two  dimensional  Partitioning 

The^heart  of  out  2D  partitioning  algorithms  is  an  ability  to  optimally  par¬ 
tition  in  one  dimension,  given  a  fixed  partition  in  the  other.  Suppose  a  row 
partition  R  is  given.  Wc  can  compress  workload  forced  [by  R)  to  reside  on 
a  common  processor  into  super-piccesj-thercby  creating  an  A  x.m  load  mi- 
trix.  This  matrix  can  be  viewed  as  A  one  dimensional  chains,  a  common 
partitioning  of  their  columns  will  produce  a  2D  rectilinear  partition. 

The  problem  of  finding  an  optimal  column  partition  can  be  approached 
through  a  minor  modification  to  the  iD  probe  function.  This  modification 
raises  the  cost  of  calling  probe  to  0(A  M  logm;,  plus  an  0\nm)  preprocess¬ 
ing  cost.  Otherwise,  the  conditional!}  optimal  problem  is  solved  in  the  same 
tv  a}  as  the  the  ID  partitioning  problem,  in  0[mn  -f  A  Af7\og*  m)  time. 

We  ma>  appl>  the  conditionally  optimal  partitioning  algorithm  m  an  it¬ 
erative  fashion.  Suppose  that  a  row-partition  R\  is  given.  For  example,  wc 
might  construct  an  initial  row  partition  as  follows,  sum  the  weights  of  all 
work  pieces  in  a  common  row,  to  create  a  super-piece  representing  that  row. 
Findlan  optimal  ID  partition  of  those  super-pieces  onto  A’  processors.  Use 
this  partition  as  Ri,  assume  it  io  be' fixed,  and  let  Ci  be  the  optimal  column 
partition,  given  Rx.  Let  s*  —  x{RltCi)  be  the  cost  of  that  partitioning. 
Next, 'fix  the  column  partition  as  Cx,  and  let  R2  be  the  optimal  row  parti¬ 
tioning,  given  Cx.  Let  72  =  v[R2,Ci).  Clearly  we  may  repeat  this  process 
as  many  limes  as  wc  like.  We  have  shown  that  the  sequence  is 

monotone  non-incrcasing,  and  that  eventually  the  computation  converges  to 
a  fixed  row  partition  Roo  and  column  partition  Coo.  Wc  have  also  bounded 
the  number  of  iterations  required  for  convergence  by  0(n5m2(n  +  m)).  Far 
fewer  iterations  arc  required  to  converge,  in  practice.  The  talk  will  discuss  the 
use  of  this  procedure  on  highly  irregular  2D  grids  used  in  fluid-flow  problems. 

Three  Dimensional  Partitioning 

Finally,  we  consider  the  complexity  of  the  3D  partitioning  problem.  We  have 
already  seen  that  the  ID  problem  can  be  solved  in  polynomial  time;  it  is 
not  yet  known  whether  the  2D  problem  is  tractable.  It  turns  cut  that  the 
problem  of  finding  an  optimal  rectilinear  partition  in  three  dimensions  is 
NP-compIetc.  The  proof  shows  that  the  monotone  3SAT  problem  [2)  can 
be  reduced  to  rectilinear  partitioning  in  three  dimensions.  The.  key  idea  is 
to  construct  a  domain  as  a  function  of  the  3SAT  clauses.  Each  literal  is 
given  three  rows,  or  columns  in  the  3D  weight  matrix.  The  intersection  of 
rows  and  columns  for  literals  xltz-y,zi  is  a  3  x  3  x  3  volume.  This  volume  is 
to  be  partitioned  among  2x2  x  2  processors,  which  essentially  forces  each 
literal  group  to  divide  into  one  of  two  possible  partitionings.  The  partitioning 
choice  can  be  interpreted  as  the  assignment  of  a  truth  value  to  the  literal. 
The  volume  is  weighted  in  such  a  way  that  its  partition  has  bottleneck  value 
1  if  and  only  if  the  partition  corresponds  to  an  assignment  that  satisfies  the 
clause.  This  shows  that  optimal  three  dimensional  partitioning  is  as  hard  as 
the  monotone  3SAT  problem,  which  is  known  to  be  NP-complctc. 
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Abstract 

We  identify  two  useful  classes  of  flowgraphs  that  can  be  compiled  onto 
distributed-memory  multiccmputers  using  chain  mapping  algorithms, 
and  whose  performance  can  be  predicted  accurately. 

1  Introduction 

Flowgraphs  have  been  used  for  years  to  model  digital  signal  processing 
(DSP)  algorithms.  A  flowgraph  is  a  collection  of  nodes  and  arcs, 
where  nodes  represent  computations  and  arcs  represent  FIFO  queues. 
Each  node  iterates  an  infinite  number  of  times;  .each  iteration,  a  node 
consumes  a  vector  of  data  items  from  each  of  its  input  arcs,  performs  a 
computation  on  the  iripet  vectors,  and  produces  a  vector  of  data  items 
on  each  of  its  output  arcs.  The  sizes  of  the  input  and  output  vectors  arc 
indicated  by  integer  arc  labels. 

There  is  much  published  research  on  the  problems  of  compil¬ 
ing?  flowgraphs  .onto  sequential  machines  and  onto  shared-memory 
multiprocessors!:!].  Little  attention  has  been  given  to  date  on  the 
problem  of  compiling  flowgraphs  onto  distributed  memory  multicom 
puters;  some  recent  work  can  be  found  in  [5, 8] 

In  this  paper  we  identify  two  useful  classes  of  flowgraphs  that  we 
call  pipes  and  trellises.  Apipe  models  apipclined  sequence  of  different 
operations  performed  on  a  single  data  stream.  A  trellis  models  a  single 
operation  performed  in  parallel  on  different  data  streams.  Pipes  and 
trellises  arc  interesting  because  they  can  be  compiled  efficiently  and 
optimally  using  chain  mapping  algorithms,  and  because  their  perfor¬ 
mance  can  be  accurately  predicted. 

2  Pipes  and  Trellises 

A  common  DSP  application  is  to  pipeline  data  from  a  sepsor  through 
a  sequence  of  filtering  operations  such  as  FIR  filters  and'FFT  s.  Such 
applications  are  modeled  by  a  fiowgraph.wc  call  a  pipe.  An  example 
with  4  filtering  operations  is  shown  in  Figure  1. 


(aJ — c~ — f/ij — e- — ( fij — c — ( /j  } 

Figure  1:  Apipe. 

In  another  common  DSP  application,  data  from  multiple  sensors 
is  distributed,  processed  independently  and  combined  in  some  way. 

"The  research  was  supported  In  part  by  Defense  Advanced  Research  Projects 
Agency  (DOD)  monitored  by  DARPA/CMO  under  Contract  MDA972-90-C-0055 
and  in  part  by  the  Office  of  Naval  Research  under  Contract  N00014.90-J.1939. 


Such  applications  can  be  modeled  by  a  fios/giaph  we  call  a  trellis.  An 
example  with  four  sensors  is  shown  in  Figure  2. 


Figure  2:  A  trellis. 

Pipes  and  ircihscs  arc  extremely  useful  classes  of  fluu. graphs  that 
can  be  used  to  bund  real  applications.  Foi  example,  sonar  adaptive 
beam  interpolation  aua  the  2DTFT  can  each  be  modeled  as  a  pipe  of 
two  trellises. 

3  Applying  Chain  Methods 

Chain  mapping  algonthmsil,  2, 4J  compile  a  chain  of  M  modules  onto 
a  chain  of  P  distributcd-mcmoiy  processors,  typically  with  P  %  M. 
Thescialgorithms  arc  anractivc-because  they  arc  efficient,  requiring 
time  polynomial  in  M  and  P,  and  because  they  arc  optimal,  minimizing 
the  maximum  load-on  any  processor,  subjeefto  the  constraint  that 
two  contiguous  modules  are  mapped  on’-1  the  same  processor  or  its 
neighbor. 

Pipes  and  trellises  have  the  nice  property  That  they  arc  easily  trans¬ 
formed  into  a  fomi  suitable  for  chain  mapping  methods.  The  trans¬ 
formation  of  pipes  is  trivial;  each  node  in  the  flowgraph  becomes  a 
module  for  the  chain  mapping  tUgorithm.  This  is  shown  in  Figure  3. 
The  transformation  for  trellises  is  also  straightforward,  as  shown  irs 
Figure  4.  Each  of  the  dashed  boxes  becomes  a  module  for  the  chain 
mapping  algorithm. 
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Figure  3;  Transformation  of  a  pipe,  M  =  4. 
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Module  0  Module  1  M0'Jule2  ModuIe3 


Figure  4:  Transformation  of  a  trellis,  M  -  4. 

4  Predicting  Performance 

We  Have  seen  that  pipes  and  trellis  can.bc  compiled  ontodistributed- 
memory  multicomputer*  using  chain  mapping  methods.  Another  nice 
quality  of  these  fiowgranhs  is  that  their  performance  can  oo  predicted 
quite  accurately.  A  common  performance  measure  fer  flowgraphs  is 
speedup,  denoted  by  S  and  dcfmed’by  5  =  E/P,  where  £  denotes 
efficiency.  We  derive  an  expression  for  the  efficiency  of  pipes  and 
trellises  under  the  following  assumptions:  (1)  All  modules  consume 
the  same  number  of  clerics  per  iteration.  (2)  The  number  of  modules 
M  is  an  integral  multiple  of  the  number  of  processors  P. 

Let  T  -Tt+Td  be  the  number  of  number  of  clocks  per  iteration  pet- 
module,  where  Tc  is  the  number  of  docks  spent  doing  computations 
and  Tj  is  any  additional  clocks.requircd  because  of  intctproccssor 
communication,  these  can  be  clocks  spent  waiting  fot  data  ot  actually 
transferring  data  between  a  communications  network  and  memory. 
Under  these  assumptions,  efficiency  is  simply 
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Figure  5:  Predicted  and  measured  efficiency  on  iWarp 

5  Discussion 

The  empirical  results  aresomcwhatstaitling.  In  each  case,-  the  predicted 
performance  was  within  one*  percent  of  the  measured  perforncjtcc. 
Communications  overhcadiwas  restricted  to  the  unavoidable  cost  of 
physically  transferring  data  between  the  communications  network  and 
memory.  There  was  negligible  overhead  due  to  waiting  for  data. 

The  accuracy  of  the  model  allows  us  to  make  strongjpredictions 
about  performance  for  various  values  of  . ,  N,  and  Tc.  For  example, 
if  r  could  be  reduced  from  40  to  4,  which  is  quite  possible  for  iWarp, 
then  the  efficiency  of  the  trellisl  fiowgraph  in  Figure  5  would  rise  from 
34%  to  84%. 
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If.the  computations  associated  with  each  node  in  the  flow  graph-arc 
tfcra-independcm,  true  for  most  DSP  operations,  then  Tc  can  be  pre¬ 
dicted  precisely  for  a  given  parallel  computer  and  compiler. 

On  the  othechand,  Td  may  be  more  difficult  to  predict  accurately 
becauserit  could  include  time  spent-waiting  for  data  to  arrive.  For 
our  modj  wc  will  assume  that  Td  =  2-.V,  where  jV  is  lhe  number 
of  inputs  (and  outputs)  for  each  module,  and  .  is  the  uverhead  (in 
clocks)  Associated  with  transferring  a  word  between  thecommunicalion 
network  pnd  memory.  Notice  that  r  is  constanj  for  a:  given  parallel 
moJiinc  and  compiler.  Notice  aiso-ihat  ihis  expression  for  Tj  is  a 
lower  bound  that  ignores  any  clocks  spent  v.amng_fcr  dara  <o  aruve 
While  this  is  unrealistic  in  general,  empincai  evidence  suggests  that 
this  if  reasonable  for  pipes  and  trellises.  Given  the: expression  for  7V, 
efficiency  becomes 
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Wc  tested  the  model  in  (2)  using  four  different  pipes  and  trellises 
running  on  a  64-processor  iWarp  computer  at  Carnegie  MellonlC,  7J. 
Bach-fiowgraph  was  compiled  using:3  rJiain  mapping  algorithm,  and 
the  resulting  chain  was  embedded  in  the  iWa.-p's  2D  merit.  Tits  results 
arc  shown  in  Figure  5.  Predicted  efficiency  was  computed  using  (2j. 
For  all-tests,  P  =  64,  M-  64,  and  r  --  40.  Mcastired  efficiency  was 
obtained  by  measuring  the  speedup  S  and  then  applying  the  identity 
E  -  S/P. 


[4]  D.  M.  Nicol  and  D.  R.  O’Hrdlaron.  Efficient  algorithms  for  map¬ 
ping  pipelined  and  parallel  computations,  1991.  to  appear  In  IEEE 
Transactions  on  Computers. 

15]  H.  W.  Prifflz.  Automatic  Mopping  of  Large  Signal  Processing 
Systems  'o  a  Parallel  Machine.  PhD  thesis,  Carnegie  Mellon, 
January  1991. 

16J  S.Borkarct..il.  iWarp.  An  integrated  suiunon  to  high-speed  paral¬ 
lel  computing.  InSupercampuiing  SS,  Kissimmee,  FL,  November 
1988. 

[’’]  S  fiork.u  ct  al.  Supporting  systolic and  incnwuy  uimmuoic-iuun 
in  iWarp.  Jr.  1 7th  Annual  International  Symposium  on  Coniputct 
Ajn.hilCi.tntx..  ICtX  Computer  Society  and  ACM.  May  1990. 

]8J  G.  C.  Sih  and  E,  A.  Lee.  Scheduling  to  account  for  intetproccssor 
communication  within  interconnection-constrained  processor  net¬ 
works,  in  Proceedings  oj  the  J98S  international  Conference  on 
Parallel  Processing,  August  1 99*1. 


690 


A  MAPPING  ALGORITHM  FOR  HETEROGENEOUS 
MULTIPROCESSOR  ARCHITECTURES 

Todd  P.  Carpenter 
Honeywell  Systems  and  Research  Center 
3660  Technology  Drive 
Mpis.  MN  55418-1003  USA 
carp  ent<3src.honeyNe!L  com 


Abstract- Resource  management  is  an  integral  facet  cf 
the  design,  development,  and"  application  of  multiproces¬ 
sor  architectures.  This  paper  is  concerned  with  oat  spe¬ 
cific  aspect  of  the  problem  -  »h.  assignment  of  concur¬ 
rently  exe.u  table  (within  precedence  constraints)  tasks  to 
the  processors.  Naive  assignments  c eh.  lead  to  cxceuswe 
performance  degradation  due  to  the  C'jnsequei.V  overhead 
in  inter-task  communication  and  synchronisation.  In-par¬ 
ticular  wc  fociri  on  heterogeneous  architectures  comprised 
of  distinct  processor  types,  distinct  comhiur.icaliodrm?- 
dla,  and  many  data  types.  Such  systems  are,  becoming 
increasingly  widespread,  particularly  in  special  purpose 
applications  add  distributed  systems.  \Vs  addrew  the 
problem  of  statically  mapping  programs  to  such  multi¬ 
processors. 

i.LNTRODTJCTION 

Examples  of  heterogeneous  applications  include  dis¬ 
tributed  environments  -  different  processor  platforms,  mix 
pf  worluiations,  mini-,  minisuper-,  mainframe  computers, 
•etc.  They  represent  different  processors  of  varying  per¬ 
formance  and  compilers  may  or  may  not  exist  for  all  lan¬ 
guages  on  all  machines.  Further,  each  application  mod¬ 
ule  runs.at  differing  speeds  on  differing  processors.  Each 
pair  of  processors  may  communicate  at  different  rates. 
For  instance,  heterogeneous  environment  might  consist  of 
Apollo,  SUN,  Dec&Utions,  Vakea  ond  Amigar  platforms. 
Alternatively,  dedicated  appl-cotkns  of.en  are  supported 
by  heterogeneous  muhiprocessor  architectures. io-realicc 
High  performance.  For  example,  The  Intel  IPSC/2  hy¬ 
percube  28  available  as  mixed. «peed  systems  ucing  i860 
and  80386 : processors,  Packaging  constraints  often  lead 
to  systems  v/herc  subcubes  of  a  hypercube  residing  in  djf- 
fcicni  racks  csmmuhicate  over  different  media  (e.g,  cp- 
iic  fiber)  than  processors  crithin  a  rack.  Special  purpose 
multiprocessor  architectures  lor  signal  processing  have 
been  designed  with  Zycrarcfcictlly  organized  intcicohnec- 
.iion  netwerbs-riith  diffcric&  cQst/delay  characteristic  at 

each  level.  .  „  ,  .  , 

The  problem  of  mapping  parallel  programs  onto  homo¬ 
geneous  architectures  ^  a  sufficiently  complex  combina¬ 
torial  problem  in  its  own  right  [1].  The  presence  of  addi¬ 
tional  coiiciraincc  cf  processor  and  processing  types.end 
variable  communication  delays  makes  the  problcii.  even 
more  difficult- In  this  paper-  we  describe  an -approach  for 
realizing  such  assignments.  This  approach  is  an  adapta¬ 
tion  of  an.  approach  we  successfully  implemented  for  com¬ 
puting  assignments  when  the  target  architecture  (and  the 
computations)  arc  homogeneous  [2].  This  work  only  ap¬ 
plies  tc  the  static  assignment  problem.  We  do  not  yet 
addjess  the  mere  difficult  dynamic  mapping  problem. 

II.  MODEL  AND  METHODS 
The  mapping  problem  is  addressed  in  the  ccntex’.  of 
exploiting  medium-coarse  grained  parallelism  in  message 
passing,  multiple  instruction  stream  multiple  data  stream 
(MIMD)  architectures.  The  application  and  and  architcc 
ture  are  described  in  terms  of  attributed,  directed  graphs. 
Node  (edge)  weights  represent  computing  (community 
lion)  requirements.  Nodes  arc  also  labeled  by  a  type 
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representing  she  nature  of  the  computation,  e.g.,  float¬ 
ingpoint,  symbolic,  etc.  Assignments  must  now  maintain 
compatibility  between  types,  !.?,  a  node  of  a  certain  type 
is  constrained;  to  execute  on-only  a  subset  of  processors. 
We  propose  to  compute  assignments  based  on  an  adapta¬ 
tion  of  simulated  annealing  •  a  combinatorial  optimization 
procedu-e  that  realizes  a  probabilistic  search  of  a  discrete 
state  space  [3].  The  process  starts  from  some  initial  state 
■which  is  perturbed.  The  riew  state  13  evaluated  based  on 
an  objective  function  (also  known  as  the  energy  function). 
If  this  state  ie  “better  as  measured  by  vhe  value  of  the 
energy-function  it  is  acceptrd;  If  not  it  is  probabilistically 
accepted.  It  is  this  latter random  behavior  that  enables 
the  search  process  to  avoid  being  trapped  in  local  min¬ 
ima.  Simulated  annealing  has  found  wide  application  in 
a  number  of  combinatorial  optimization  problems.  A  sim¬ 
plified-view  of  the  process  is  shown  below,  and  each  step 
is  elaborated  in  the  following. 

Loop  until  done 

state  perturbation; 
state  evaluation; 
state  acceptance/rejection; 
end  loop 

A.  State  Perturbation 

Given  an  assignment  of  tasks  to  processors,  this  step 
modifier  the  assignments)  of  task(s).  The  change  may 
be  based  on  architectural  characteristics  (e.g.,  limited  to 
adjacent  processors)  or  may  be  based  on  the  structure 
of  algorithm  (e.g.,  limited  to  communicating  tasks).  In 
a  single  iteration,  multiple  tasks  may  be  moved  simulta¬ 
neously  corresponding  to  large  jumps  in  the  state  space, 
or  one  task  may  be  moved  at  a  time.  Further,  the  per¬ 
turbation  strategies  may  change  over  time  to  adapt  to 
the  behavior  of  the  search.  Finally,  the  perturbations  arc 
governed  by  type  constraints  i.e.,  between  tasks  and  pro- 
ccssore. 

B.  State  Evaluation 

The  energy  function  maps  states  to  real  or  integer  val¬ 
ues.  The  value  of  the  function  is  a  measure  of  the  qual¬ 
ity  of  the  mapping  represented  by  that  state.  For  the 
mapping  problems  we  are  considering  examples  of  appro¬ 
priate  energy  functions  include  maximum  processor  load, 
maximum  inter-processor  communication  load,  variance 
of  processor  loads,  etc.  The  more  complex  the  energy 
junction  the  longer  the  run-times,  or  the  smaller  num¬ 
ber  of  states  evaluated  per  unit  time.  The  goal  is  to  find 
a  state  that  maximizes  (or  minimizes)  the  value  of  the 
energy  function. 

We  propose  an  energy  function  that  we  have  success¬ 
fully  used  when  mapping  onto  homogeneous  architectures. 
This  function  consists  of  two  components  -  a  load  bal¬ 
ancing  component  and  a  inter-processor  communication 
component.  It  is  typically  desirable  to  maximize  the 
first  and  minimize  the  second,  and  can  be  represented 
as,  E  —  v>n  x  LB  +  toe  x  C  where  wc  are  the  weight¬ 
ing  factors  for  load  balancing  and  inter-processor  com¬ 
munications.  The  individual  components  are  computed 
as  follows. 
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Load  balance  is  a  measure  of  how  evenly  the  processing 
load  is  distributed  among  the  processors.  The  objective 
is  to  distribute  the  processing  load  as  evenly  as  possible. 
The  value  of  the  expression  Loa.dBa.la.nct  shown  below  is 
minimized  when  the  load  is  evenly  distributed. 

Define: 

P  =  number  of  resource  elements 
Ti  =  number  of  tasks  mapped  to  element 

i 

Twjj  —  the  weight  of  the  jth  task  mapped 
to  resource  element  i 

Pwi'typt  =  the  weight  for  resource  element  to 
perform  type  task 

Ttjtl  =  the  type  of  task  j  mapped  to  ele¬ 
ment  i 

LR  =  The  number  of  resource  elements 

with  nonzero  loads _ 

I  JjR 

The  expression  Commur.  lion  shown  below  is  a  mea¬ 
sure  of  how  the  inter-proce^oor  communications  load  is 
distributed.  The  load  is  a  function  of  the  distance  be¬ 
tween  communicating  tasks,  the  data  volume,  and  link 
throughput.  The  value  of  Communication  is  minimized 
when  all  tasks  are  mapped  to  the  same  processor.  There¬ 
fore  this  expression  is  at  odds  with  the  load  balancing 
term  described  above. 

Define: 

T  —  number  of  tasks 

Tot  —  number  of  outputs  of  task  Ti 

I'RTipRTj  —  the  links  from  resource  to  which 
Task  i  is  mapped,  to  the  resource  for 
task  j 

Tc,  j  =  the  amount  of  data  from  Task  i  to 
Task  j 

Ljt  reciprocal  of  throughput  of  link  k 
P  Amount  of  communications  band¬ 

width  potential 

C.  State  Acceptance/Rejection 
New  states  are  accepted  or  rejected  based  on  the  value 
of  the  energy  function.  We  deviate  from  traditional  an¬ 
nealing  implementations  with  respect  to  this  decision  pro¬ 
cess.  The  following  acceptance/rejection  techniques  were 
employed  in  our  study.  Note  that  although  we  can  accept 
worse  states,  we  do  maintain  a  record  of  the  minimum 

state  found.  .  .  .  , 

•  Annealing  If  A E  <  0,  the  new  state  is  accepted, 

and  is  used  as  the  starting  point  for  the  next  itera¬ 
tion.  If  AE  >  0,  the  new  state  is  accepted  proba¬ 
bilistically  according  to  P(AE)  —  e~&  where  k  is 
the  Boltzmann's  constant  and  T  is  the  temperature. 

•  Kappa  Sequence  If  A E  <  0,  or  if  n.  contiguous 
states  have  been  rejected,  accept  the  new  state.  The 
value  of  k  is  increased  if  A£  <  0,  and  is  decreased  if 
k  states  have  been  rejected.  This  function  contains 
some  notion  of  history,  and  modifies  the  behavior  of 
the  search  based  upon  trends. 

•  Lambda  Sequence  If  AE  <  0  accept  the  new  state, 
or  accept  the  new  state  based  on  a  probability  dis¬ 
tribution  function  A.  After  k  states,  A  is  modified 
based  on  computable  trends  in  the  sequence  of  states. 
This  is  an  adaptive  acceptance  function  which  mod¬ 
ifies  its  behavior  based  on  some  history  of  movement 
within  the  state  space. 


Communications  — 


III.  EXPERIMENTS 

A  major  difficulty  with  mapping  algorithms  is  in  evaluat¬ 
ing  their  performance.  With  no  known  general  method  of 


computing  the  optimal  assignments  for  comparison  pur¬ 
poses,  we  apply  the  mapping  algorithm  to  problems  with 
known  analytical  solutions.  For  example,  we  apply  the 
mapping  algorithm  to  the  problem  of  finding  assignments 
of  hypercubes  onto  hypercubes,  or  meshes  onto  hyper¬ 
cubes.  Such  an  approach  runs  the  risk  of  of  not  accu¬ 
rately  representing  the  performance  of  more  general  cases, 
however  our  implementation  makes  use  of  no  Information 
about  the  structure  of  the  target  architecture  or  algo¬ 
rithms,  The  expectation  is  that  comparable  performance 
is  possible  with  relatively  unstructured  cases. 

We  have  also  experimented  with  heterogeneous  systems, 
including  bus  based  and  hypercube  based  systems.  The 
bus  based  system  consisted  of  a  serial  backplane,  and  IO 
and  processing  nodes.  The  hypercube  consisted  of  hetero¬ 
geneous  communication  links  and  processors,  where  sub¬ 
cubes  have  one  communication  dimension  faster  than  the 
other  dimensions,  and  each  subcube  consists  of  a  different 
type  (throughput)  of  processor. 

Applications  mapped  to  these  hardware  resources  in¬ 
cluded  airplane  flight  managements  control  systems, 
sonar  beamforming,  and  various  benchmark  examples 
such  as  weighted  hypercube  and  binary  tree  graphs. 

IV.  RESULTS 

The  results  of  our  experiments  havebeen  very  encourag¬ 
ing.  For  relatively  small  systems  (<  32  processors)  based 
on  regular,  symmetric  network  topologies  such  as  the  hy¬ 
percube,  globally  optimum  assignments  were  computed 
over  90%  of  the  time  in  les3  than  10®  movers.  The  adap¬ 
tive  schedules  we  have  employed  consistently  outperform 
annealing  implementations  without  adaptive  schedules. 
The  point  at  which  it  is  desirable  to  change  from  adaptive 
to  non-adaptive  schedules  is  currently  unknown. 

We  compared  the  performance  of  this  mapping  algo¬ 
rithm  to  the  manually  generated  schedules  produced  in 
the  design  of  a  current  real-time  flight  management  sys¬ 
tem.  The  target  architecture  was  a  heterogeneous  bus 
based  system.  Manual  generation  of  schedules  makes  it 
possible  to  modify  the  software  to  change  load  distribu¬ 
tion,  inter-processor  communication,  etc.  (i.e.,  effectively 
alter  the  weights  on  the  graph)  to  meet  operating  con¬ 
straints.  As  a  result,  the  manually  generated  schedules 
were  superior,  but  took  on  the  order  of  hours  to  da,  *  to 
generate  compared  to  seconds  for  the  tools  to  return  so¬ 
lutions.  Furthermore,  we  were  dealing  with  relatively  few 
and  large  tasks  creating  high  (e.g.  98%)  system  loads. 
As  the  number  of  tasks  grows  (due  to  decreasing  gran¬ 
ularity  or  more  work)  we  expect  the  gap  between  auto¬ 
mated  mapping  algorithms  and  manually  generated  solu¬ 
tions  will  close  rapidly. 

V.  FUTURE  WORK 

This  work  is  part  of  a  larger  effort  to  develop  a  mul¬ 
tiprocessor  system  toolkit  to  support  the  conception,  de¬ 
sign,  analysis,  and  development  of  large  scale,  medium- 
to-coarse  grained  multiprocessor  architectures.  Future 
research  will  expand  the  role  of  the  mapping  algorithm 
to  consider  Us  effect  on  reliability,  and  the  feasibility  of 
computing  assignments  that  optimize  other  performance 
attributes  such  as  response  time. 
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Abstract  One  of  the  key  objectives  of  the  Applied  Research-Branch 
in  the  Numerical  Aerodynamic  Simulation  (NAS)  Systems  Division  at 
NASA  Ames  Research  Center  is  the  accelerated  introduction  of  highly 
parallel  machines  into  a  full  operational  environment.  In  this  report 
we  summarize  some  of  the  experiences  with  the  parallcl  testbed  ma¬ 
chines  at  the  NAS  Applied  Research  Branch.  We  discuss  the  perfor¬ 
mance  results  obtained  from  the  implementation  of  two  Computational 
Fluid  Dynamics  (CFD)  applications,  an  unstructured  grid  solver  and 
a  partide  simulation,  on  the  Connection  Machine  CM-2  and  the  Intel 
iPSC/S60. 

Keywords:  parallel  architectures,  parallel  algorithms. 
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1  Introduction 

One  of  the  key  tasks  of  the  Applied  Research  Branch  in  the  Numeri¬ 
cal  Aerodynamic  Simulation  (NAS)  Systems  Division  a:  NASA  Ames 
Research  Center  is  the  accelerated  introduction  of  highly  parallel  and 
related  key  hardware  and  software  technologies  into  a  full  operational 
environment  (see  (1)).  From  19SS  1990  a  testbed  facility  has  been 
established  for  the  development  and  demonstration  of  highly  parallel 
computer  technologies.  Currently  a  32k  processor  Connr  ion  Machine 
CM-2  and  an  128  node  Intel  iPSC/560  arc  operated  at  the  NAS  Ap¬ 
plied  Research  Branch.  This  testbed  facility  is  envisioned  to  consist 
of  successive  generations  of  increasingly  powerful  highly  parallel  sys¬ 
tems  that  are  scalable  to  high  performance  capabilities  beyond  that  of 
conventional  supercomputers. 

It  is  recognized  within  the  scientific  computing  community  that  the 
most  promising  approach  toward  achieving  very  large  improvements  in 
computing  performance  is  through  the  application  of  highly  parallel 
architectures.  To  meet  the  future  processing  needs  of  the  aerospace 
research  community,  the  Applied  Research  Branch  supports  a  research 
program  aimed  at  achieving  the  best  match  of  parallel  processing  lech 
nology  to  the  most  demanding  research  applications.  In  the  last  two 
years  a  number  oflargc  scale  computational  fluid  dynamics  applications 
have  been  implemented  on  the  two  testbed  machines,  and  the  potential 
of  the  parallel  machines  for  production  use  has  been  evaluated.  Beycnd 
that,  a  systematic  performance  evaluation  effort  has  been  Initialed  ,'see 
[{)),  -nd  basic  algorithm  research  has  been  continued. 

In  this  report  we  will  first  give  a  brief  description  of  the  capabihui- 
of the  parallel  machines  at  NASA  Ames.  Then  we  will  discuss  some  of 
the  research  carried  out  >n  the  implementation  of  Computational  Fluid 
Dynamics  (CED)  applications  on  these  parallel  machines.  We  focus  here 
on  those  applications  where  we  have  more  detailed  knowledge  because  of 
oar  own  involvement,  an  explicit  2D  Euler  seller  for  unstructured  gods, 
and  a  simulation  based  on  particle  methods.  Other  applications  based 
on  structured  grids  will  be  mentioned  briefly,  as  wed  as  the  XA5  cfT-i  t 
in  parallel  benchmarking.  In  a  final  section  we  offer  some  pithm-nary 
conclusions  on  the  performance  of  correal  parallel  machines  for  CFD 
applications,  as  well  as  the  potential  of  the  different  architectures  for 
production  use  in  the  future.  Another  summary  of  some  of  the  resales 
from  NASA  Ames  is  given  by  D.  Bailey  la  [3], 


2  Parallel  Machines  at  NASA  Ames 

2.1  Connection  Machine 

The  Thinking  Machines;  Connection  Machine  Mo  J»1  CM-2  is  a  mas¬ 
sively  parallel  SIMD  computer  consisting  of  many  thousands  of  bit  se¬ 
rial  data  processors  under  the  direction  of  a  front  end  computer.  The 
system  at  NASA  Ames  consists  of  3276S  bit  serial  processors  each-  with 
with  1  Mbit  of  memory  and  operating  at  7  MHz.  The  processors  and 
memory  are  packaged  as  16  in  a  chip.  Each  chip  also  contains  the  rout¬ 
ing  circuitry  which  allows  any  processor  to  send  and  receive  messages 
from  any  other  processor  in  the  system.  In  audition,  there  arc  1024 
64- bit  Watch  floating  point  processors  which  are  fed  from  the  bit  se¬ 
rial  processors  through  a  special  purpose  ‘Sprint"  chip.  There  Is  one 
Sprint  chip  connecting  every  two  CM  chips  to  a  W'eitck.  Each  Wdtck 
processor  can  execute  an  add  and  a  multiply  each  dock  cycle  thus  per¬ 
forming  at  14  MFLOPS  and  yielding  a  peak  aggregate  performance  of 
14  GFLOPS  for  the  system. 

The  Connection  Machine  can  be  viewed  two  ways,  either  as  an 
11-dimensional  hypcrcube  connecting  the  204S  CM  chips  or  a  10- 
dimcnsional  hypcrcube  connecting  the  1024  processing  elements.  The 
first  view  is  the  “ficMwisc"  model  of  the  machine  which  has  existed 
since  its  introduction.  This  view  admits  to  the  existence  of  at  feast 
3276S  physical  processors  (when  using  the  whole  machine)  each  storing 
data  m  fields  within  its  local  memory.  Ihe  second  is  the  more  recent 
"siicewisc"  model  of  the  machine  which  admits  to  only  1024  processing 
dements  i .when  using  the  whole  machine)  each  storing  data  m  slices  of 
32  bits  distributed  across  the  32  physical  processors  in  the  processing  el- 
ement-  Both  models  allow  for  “virtual  processing",  where  the  resources 
of  a  single  processor  or  processing  dement  may  be  divided  to  allow  a 
greater  number  of  virtual  processors. 

Regardless  of  the  machine  model,  the  architecture  allows  mlerpro- 
ccsso;  communication  to  proceed  in  three  manners.  For  very  general 
communication  with  no  regular  pattern,  the  router  determines  the  des¬ 
tination  of  messages  at  run  time  ana  directs  the  messages  accordingly. 
This  is  referred  to  as  gcnciai  router  communication.  For  communica¬ 
tion  with  an  irregular  but  static  pattern,  the  message  paths  may  be 
precompiled  and  the  router  sou  direct  messages  according  to  the  pro- 
compiled  paths.  This  is  referred  to  as  complied  communication  and 
can  be  5  times  faster  than  general  roster  communication.  Finally,  for 
communication  which  is  perfectly  regular  and  involves  only  shifts  -jg 
grid  axes,  the  system  software  optimizes  the  data  layout  by  ensuring 
strictly  nearest  neighbor  communication  and  uses  its  own  pre- complied 
paths.  TLx  »s  referred  to  as  NEWS  tSor  'XorthLaslttestSoaih'r  com- 
iriUCutat.va.  Despite  li.e  name.  ,\LUi  r^Uiacii 

u*  2  dsis p  w  5*  NEWS  grifih  be 

NEWS  conjsssjuljoa  the  f-utcxi. 

lj  0  toShta  to  t£e  through  i/O 

Aa  4,0  waaaii  io  ^*52  prucswii  through  256 

lf  Q  Them  *$  oat  aat  ioi  dip  bat  the  toatfdc  tsn  oaiv 

to  256  wsis«uae,n*iiv  tsd  rbul  ircti  iU  Nk  pnwo^  4 
hiaks  **f  4k  Mth.  E^a  I/O  uas>f«3  of  ap 

to  46  MB  p«  la  -ultiii/o  to  Aa  I/O  coatr&Ze:  there  oa  be  a 

lisuq  Z*ji  gupiau  output.  Bcu&«  iv  -s  cos£«xte4  fftrau) 
40  uihn  OAa  thtwgh  the  I/O  bgi,  the  ft ASe  buffet 

ter.'irt  Itn^x  the  Chi  protfsjais  at  256  MB  per  seesd*  The 
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system  NASA  Ames  has  two  frame  buffers  connected  to  two-high 
resolution  color  monitors  and  four  I/O  controllers  connected  to  a  20 
GB  DataVault  mass  storage  system. 

The  Connection  Machine’s  processors  are  used  only  to  store  data. 
The  program  instructions  are  stored  on  a  front  end  computer  which 
also  carries  out  any  scalar  computations.  Instructions  are  seque..red 
from  the  front  end  to  the  CM  through  one  or  more  sequencers.  Each 
sequencer  broadcasts  instructions  to  8192  processors  and  can  execute 
either  independent  of  other -sequencers  or  combined  in  two  or  four. 
There  are  two  front  end  computers  at  NASA  Ames,  a  Vax  8350  and 
a  Sun  4/490,  which  currently  support  about  100  users.  There  are  two 
sequencer  interfaces  on  each  computer  which  allow  up  to  four  concurrent 
users.  In  addition,  the  system  software  supports  the  Network  Queue 
System  (NQS)  and  time  sharing  through  the  CM  Tin..  Sharing  System 
(CMTSS). 

The  Connection  Machine  system  was  first  installed  at  NASA  Ames 
in  June  of  1988.  Since  then  the  system  has  undergone  a  number  of 
upgrades,  the  most  recent  being  completed  in  February  of  1991.  An 
assessment  of  the  system  is  given  in  [21].  Perhaps  its  greatest  strength, 
from  a  user  standpoint,  is  the  robust  system  software.  This  is  of  critical 
importance  to  NASA  as  it  moves  its  parallel  machines  into  production 
mode. 

2.2  Intel  iPSC/860 

The  Intel  iPSC/860  (also  known  as  Touchstone  Gamma  System;  is 
based  on  the  new  64  bit  i860  microprocessor  by  Intel.  The  i860  has 
over  1  million  transistors  and  runs  at  40  MHz.  The  theoretical  peak 
speed  is  80  MFLOPS  in  32  bit  floating  point  and  60  MFLOPS  for  64  bit 
floating  point  operations.  The  io60  features  32  integer  address  registers, 
with  32  bits  each,  and  16  floating  point  registers  with  64  bits  each- (or  32 
floating  point  registers  with  32  bits  each).  It  also  features  an  8  kilobyte 
on-chip  data  cache  and  a  4  kilobyte  instruction  cache.  Iliere  is  a  12a 
bit  data  path  between  cache  and  registers.  There  is  a  64  bit  data  path 
between  main  memory  and  registers. 

The  i860  has  a  number  of  advanced  features  to  facilitate  high  exe¬ 
cution  rates.  First  of  all,  a  number  of  important  operations,  including 
floating  point  add,  multiply  and  fetch  from  main  memory,  are  pipelined 
operations.  This  means  that  they  are  segmented  into  three  stages,  and 
in  most  cases  a  new  operation  can  be  initiated  every  25  nanosecond 
clock  period.  Another  advanced  feature  is  the  fact  that  multiple  in¬ 
structions  can  be  executed  in  a  single  clock  period.  For  example,  a 
memory  fetch,  a  floating  add  and  a-floating  multiply  can  all  be  initi¬ 
ated  in  a  single  clock  period. 

A  single  node  of  the  Touchstone  Gamma  system  consists  of  the  i860, 
8  megabytes  (MB)  of  dynamic  random  access  memory,  and  hardware 
for  communication  to  other  nodes.  For  every  16  nodes,  there  is  also 
a  unit  service  module  to  facilitate  access  to  the  nodes  for  diagnostic 
purposes.  The  Touchstone  Gamma  system  at  NASA  Ames  consists  of 
128  computational  nodes.  The  theoretical  peak  performance  of  this 
system  is  thus  approximately  7.5  GFLOPS  on  64  bit  data. 

The  128  nodes  are  arranged  in  a  seven  dimensional  iiyper.  ibe  using 
the  direct  connect  routing  module  and  the  hypercube  interconnect  tech¬ 
nology  of  the  iPSC/2.  The  point  to  point  aggregate  bandwidth  of  tiie 
interconnect  system,  which  is  2.8  MB/sec  per  channel,  is  the  same  as 
on  the  iPSC/2.  However  the  latency  for  the  message  passing  is  reduced 
from  about  350  microsecoiids  to  about  90  microseconds.  This  reduc¬ 
tion  is  mainly  obtained  through  the  increased  speed  of  the  i860  on  the 
Touchstone  Gamma  machine,  when  compared  to  the  Intel  386/387  on 
the  iPSC/2.  The  improved  latency  is  thus  mainly  a  product  of  faster 
execution  of  the  message  passing  software  on  the  i860. 

Attached  to  the  128  computational  nodes  of  the  NASA  Ames  system 
arc  ten  I/O  nodes,  each  of  which  can  store  approximately  700  MB.  Ihe 
total  capacity  of  the  I/O  system  is  thus  about  7  GB.  These  I/O  nodes 
operate  concurrently  for  high  thioughpul  rates.  The  complete  system 
is  controlled  by  a  system  resource  module  (SRM),  which  is  based  uu 
an  Intel  80386  processor.  This  system  handles  compilation  and  linking 
of  source  programs,  as  well  as  loading  the  executable  code  into  the 


hypercube  nodes  and  initiating  execution.  At  present  the  SRM  is  a 
serious  bottleneck  in  the  system,  due  touts  slowness  in  compiling  and 
linking  user  codes.  Tor  example,  the  compilation  of  a  moderate-sized 
application  program  often  requires  30  minutes  or  more,  even  with  no 
optimization  options  and  no  other- users  on  the  system. 

During  1990  the  iPSC/860  has  been  thoroughly  investigated  at  NASA 
Ames.  A  first  set  of  benchmark  numbers,  and  some  CFD  applications 
performance  numbers  have  been  published  in  [2].  A  more  recent  sum¬ 
mary  is  given  by  Barszcz  in  [5].  As  documented  in  (5)  from  an  overall 
systems  aspect  the  main  bottleneck  has  been  the  SRM,  which  js  not  able 
to  handle  the  demands  of  a  moderately  large  user  community  (about 
50  to  100  users)  in  a  production  environment.  Another  important  re¬ 
sult  of  the  investigations  was  the  outcome  of  a  study  by  Lee  [13].  Lee  s 
analysis  of  the  i860  floating  point  performance  indicates  that  on  typical 
CFD  kernels  the  best  performance  to  be  expected  is  in  the  10  MFLOPS 
range. 


3  Structured  Grid  Applications 

Structured  grid  codes,  in  particular  multiblock  structured  grid  codes, 
are  one  of  the  main  production  GFD  tools  at  NASA  Ames.  A  number 
of  different  efforts  were  directed  toward  the  implementation  of  such 
capabilities  on  parallel  machines.  One  of  the  first  CFD  results  on  the 
CM  2  was  the  work  by  Levit  am!  Jespersen  [15, 14],  which  was  recently 
extended  to  three  dimensions  [1C].  Their  implementation  is  based  on 
the  successful  ARC2D  and  ARC3D  codes  developed  by  Pulliam  [20]. 
Work  is  in  progress  to  implement  T3D,  a  successor  code  to  ARC3D, 
on  the  CM  2.  0«  the  irSC/860  Weeratunga  has  implemented  ARC2D 
(for  early  results  see  [2]),  and  work  is  in  progress  to  implement  F3D. 
Wec.alunga  also  has  developed  a  pseudo  CI'D  application  based-on 
structured  grids  for  the.NAS  Parallel  Benchmark,  which  is  described  in 
chapter  3  of  [4].  We  will  not  discuss  these  efforts  here  in  more  detail 
and  refer  the  interested  reader  to  the  references. 


4  Unstructured  Grid  Applications 

We  discuss  here  work  on  an  upwind  finite- volume  flow  solver  for  the  Eu 
ler  equations  in  two  dimensions  that  is  well  suited  for  massively  parallel 
implementation.  The  mathematical  formulation  of  this  flow  solver  was 
proposed  and  implemented  on  the  Cray-2  by  Barth  and  Jespersen[6]. 
This  solver  has  been  implemented  on  the  CM-2  by  Hammond  and  Barth 
[11],  and  on  the  Intel  iPSC/860  by  Venkatakrisbnan,  Simon,  and  Barth 
[23). 

The  unstructured  grid  code  developed  by  Barth  is  a  vertex  based  fi 
nite  volume  scheme.  The  control  volumes  are  non  overlapping  polygons 
which  surround  the  vertices  of  the  mesh,  called  the  “dual”  of  the  mesh. 
Associated  with  each  edge  of  the  original  mesh  is  a  dual  edge.  Fluxes 
are  computed  along  each  edge  of  the  dual  in  an  upwind  fashion  using 
an  approximate  Riemann  solver  Piecewise  linear  reconstruction  is  em¬ 
ployed  which  yields  second  order  accuracy  in  smooth  regions.  A  4  stage 
Runge  Kutta  scheme  .s  used  to  advance  the  solution  in  time.  Fluxes, 
gradients  and  control  volumes  arc  all  constructed  by  looping  over  the 
edges  of  the  original  mesh.  In  the  Cray  implementation,  vectorizat'.on 
is  achieved  by  coloring  the  edges  of  the  mesh. 

It  is  assumed  that  a  Iriangulurization  of  the  computational  domain 
and  tin  corresponding  mesh  has  been  computed.  We  will  not  present 
any  more  details  here.  A  complete  description  of  the  algorithm  can  be 
found  in  [6,  11]. 

In  both  implementations  the  same  test  case  has  been  used.  The  test 
case  used  js  an  unstrnctureu  incsh  with  15606  vertices,  io$i  i  edges, 
30269  faces,  1  bodies,  and  949  boundary  edges.  The  flow  was  computed 
at  a  Mach  number  of  .1  at  0  degrees  angle  of  attack.  The  code  for  this 
test  case  runs  at  150  Mflops  on  the  NAo  Cray-VMP  at  NASA  Ames, 
and  requires  0.39  seconds  per  time  step. 
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4.1  SIMD  Implementation  of  Unstructured  Solver 

Tor  the  implementation  on  the  CM-2  Hammond  and  Barth  [11]  used 
a.  novel  partitioning  of  the  problem  which  minimizesthe  computation 
and  communication  costs  on  a  massively  parallel  computer.  In  a.  mesh- 
vertex  scheme,  solution  variables  are  associated  with  each  vertex  of  the 
mesh  and  flux  computation  is  performed  at  edges  of  the  non-overlapping 
control -volumes  which  surround  each  vertex.  In  conventional  parallel 
implementations  this  operation  is  partitioned  to  be  performed  edge¬ 
wise,  he.,  eacn  edge  of  the  control  volume  is  assigned  to  one  processor 
(edge-based).  The  resulting  flux  calculation  contributes  to  two  control 
volumes  which  share  the  particular  edge. 

In  the  partitioning  used  by  Hammond  and  Barth,  each  vertex  of  the 
mesh  is  assigned  to  one  processor  (vertex-based).  Flux  computations 
are  identical  to  the  edge-based  scheme  but  computed  by  processors 
associated  with  vertices.  Each  edge  of  the  mesh  joins  a  pair  of  vertices 
and  is  associated  with  one  edge  of  the  control  volume. 

One  can  direct  edge  (ij)  to  determine  which  vertex  in  the  pair  com¬ 
putes  the  flux  through  the  shared  edge  of  the  control  volume, 

When  there  is  a  directed  edge  from :  to  j,  then  the, processor  holding 
vertex  j  sends  its  conserved  values  to  the  processor  holding  vertex 
and  the  flux  across  the  common  control  volume  edge  is  computed  by 
processor  i  and  accumulated  locally.  The  flux  through  {k',j')  computed 
by  the  processor  holding  vertex  i  is  sent  to  the  processor  holding  vertex 
j  to  be  accumulated  negatively.  Hammond  and  Barth  show  that  their 
vertex-based  scheme  requires  50%  less  communication  and  asymptoti¬ 
cally  identical  amounts  of  computation  as  compared  with  the  traditional 
edge-based  approach. 

Another  important  feature  of  the  work" by  Hammond  and.  Barth  is 
the  use  of  fast  communication.  A  feature  of  the  communication  within 
the, flow; solver  here  is  that  the  communication  pattern,  although  ir¬ 
regular,  remains. static  throughout  the  duration  of  the  computation. 
The  SIMD  implementation  takes  advantage  of  this  by  using  a  mapping 
technique  developed  by  Hammond  and  Schreiber  (12)  and  a  “Commu¬ 
nication  Compiler”  developed  for  the  CM-2  by  Dahl  (10).  The  former  is 
a  highly  parallel  graph  mapping  algorithm  that  assigns  vertices  of  the 
grid  to  processors  in  the  computer  such  that  the  sum  of  the  distances 
that  messages  travel  is  minimized.  The  latter  is  a  software  facility  for 
schedulingcirrcgular  communications  with  a  static  pattern.  The  user 
specifies  a  list  of  source  locations  and  destinations  for  messages  which 
are  then  compiled  into  routing  paths  to  be  used  at  run  time. 

Hammond  and  Barth  have  incorporated  the  mapping  algorithm  and 
-the  communication  compiler  into  the  flow  solver  running  on  the  CM- 
2  and  have  realized  a  factor  of  30  reduction  in  communication  time 
compared  to  using  naive  of  random  assignments  of  vertices  to  processors 
and  the  router.  Using  8K  processors  of  the  CM-2  and  a  VP  ratio  of  2, 
Hammond  and  Barth  carried  out  100  time  steps  of  the  flow  solver  in 
about  71.62  seconds.  This  does  not  include  setup  time. 

4.2  MIMD  Implementation  ofUnstructured  Solver 

Similar  to  the  SIMD  implementation  one  of  the  key  issues  is  the  par¬ 
titioning  of  the  unstructured  mesh.  In  order  to  partition  the  mesh 
Venkatakrishnan  et  al.  (23)  employ  a  now  algorithm  for  the  graph  par¬ 
titioning  problem,  widen  has  been  discussed  recently  by  Simon  (22), 
and  which  is  based  on  the  computation  of  eigenvectors  of  the  taplacian 
matrix  of  a  graph  associated  with  the  mesh.  Details  on  the  theoretical 
foundations  of  this  strategy  can  be  found  in  (19).  Detailed  investiga¬ 
tions  and  comparisons  to  other  strategies  (cf.  (22j)  have  shown  that  the 
spectral  partitioning  produces  subdomains  with  the  shortest  boundary, 
and  hence  tends  to  minimize  communication  cost. 

After  the  application  of  the  partition  algorithm  of  the  previous  sec¬ 
tion,  the  whole  firute  volume  grid  with  triangular  celis  is  partitioned  into 
P  subgrids,  each  subgrid  contains  a  number  c-f  triangular  cells  which 
form  a  single  connected  region.  Each  subgrid  is  assigned  to  one  proces 
sor.  All  connectivity  information  is  precomputed,  using  sparse  matrix 
type  data  structures. 

Neighboring  subgtids  communicate  to  each  other  only  through  them 


interior  boundary  vertices  which  are  shared  by  the  processors  containing 
the  neighboring  subgrids.  In  the  serial  version  of  the  scheme,  field 
quantities  (mass,  momentum  and  energy )  are  initialized  and  updated 
at  each  vertex  of  the  triangular  grid  using  the  conservation  law  for 
the  Euler  equations  applied  to  the  dual  cells.  Each  processor  performs 
the  same  calculations  on  each  subgrid  as  it  would  do  on  the  whole 
grid  m  the  case  of  a  serial  computation.  The  difference  is  that  now 
each  subgrid  may  contain  both  physical  boundary  edges  and  interior 
boundary  edges,  which  have  resulted  from  grid  partitioning.  Since  a 
finite  volume  approach  is  adopted,  the  communication  at  the  inter¬ 
processor  boundaries  consists  of  summing  the  local  contributions  to 
integrals  such  as  volumes,  fluxes,  gradients  etc. 

The  performance  of  the  Intel  iPSC/860  on  the  test  problem  is  given 
in  Table  1. 

Table  1:  Performance  of  Unstructured  Grid  Code  on  the  Intel 
iPSC/860 _ 
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5  Particle  Methods 

Particle  methods  of  simulation  are  of  interest  primarily  for  high  alti¬ 
tude,  low  density  flows.  When  a  gas  becomes  sufficiently  rarefied  the 
constitutive  relations  of  the  Navicr-Stokcs  equations  (i.e.  the  Stokes 
law  for- viscosity  and  the  Fourier  law  for -heat  conduction)  no  longer 
apply  and  either  higher  order  relations  must  be  employed  or  tiie  con¬ 
tinuum  approach  must  be  abandoned  and  the  molecular  nature  of  the 
gas  must  be  addressed  explicitly.  The  latter  approach  leads  to  direct 
particle  simulation. 

In  direct  particle  simulation,  a  gas  is  described  by  a  collection  of 
simulated  molecules  thus  completely  avoiding  any  need  for  differential 
equations  explicitly  describing  the  flow.  By  accurately  modelling  the 
microscopic  state  of  the  gas  the  macroscopic  description  is  obtained 
through  the  appropriate  integration.  The  primary  disadvantage  of  this 
approach  is  that  the  computational  cost  is  relatively  large.  Therefore, 
although  the  molecular  description  of  a  gas  is  accurate  at  all  densities, 
a  direct  particle  simulation  is  competitive  only  for  low  densities  where 
accurate  continuum  descriptions  are  difficult  to  make. 

For  a  small  discrete  time  step,  the  molecular  motion  and  collision 
terms  of  the  Boltzmann  equation  may  be  decoupled.  This  allows  the 
simulated  particle  flow  to  be  considered  in  terms  of  two  consecutive 
but  distinct  events  in  one  time  step,  specifmally  there  is  a.  collision- 
less  motion  of  all  particles  followed  by  a  motionless  collision  of  those 
pairs  of  particles  which  have  been  identified  as  colliding  partners.  The 
collisionless  motion  of  particles  is  strictly  deterministic  and  reversible. 
However,  the  collision  of  particles  is  treated  on  a  probabilistic  basis. 
Tiie  particles  move  through  a  giid  of  cells  which  serves  to  define  the 
geometry,  to  identify  colliding  partners,  and  to  sample  the  macroscopic 
quantities  used  to  generate  a  solution. 

The  state  of  the  system  is  updated  on  a  per  time  step  basis.  A  single 
time  step  is  comprised  of  five  events. 

1.  Collisionless  motion  of  particles. 

2.  Enforcement  of  boundary  conditio, is. 

3.  Pairing  of  collision  partners. 

4.  Collision  cf  .".elected  collision  partners. 

5.  Sampling  for  macroscopic  How  quantities. 

Detailed  description  of  these  algorithms  m.u  Le  found  m  (IT)  and  (7) 
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5.1  SIMD  Implementation  of  Particle  Simulation 

Particle  simulation,  is  distinct  from  other  CFD  applications  in  that 
there  are  two  levels  of  parallel  granularity  in  the  metj.^J.  There  is 
a  coarse  level  consisting  of  cells  in  the  simulation  (which  are  approxi¬ 
mately  equivalent  to  grid  points  in  a  continuum  approach)  and  there  is 
a  fine  level  consisting  of  individual  particles.  At  the  time  of  the  CM-2 
implementation  there-existed  only  the  field  wise,  model  of  the  machine, 
and  it  was  natural  for  Dagum  [7]  to  decompose  the  problem  at  the  finest 
level  of  granularity.  In  this  decomposition,  the  data  for  each  particle  is 
stored  in  an  individual  virtual  processor  in  the  machine.  A  separate  set 
of  virtual  processors  (or  VP  set)  stores  the  geometry  and  yet  another 
set  of  virtual  processors  stores  the  sampled  macroscopic  quantities. 

This  decomposition  is  conceptually  pleasing  however  in  practice  the 
relative  slowness  of  the  Connection  Machine  router  can  prove  to  be 
a  bottleneck  in  the  application.  Dagum  (7)  introduces  several  novel 
algorithms  to  minimize  the  amount  of  communication  and  improve  the 
overall  performance  in.  such  a  decomposition.  In  particular,  steps  2 
and  3  of  the  particle  simulation  algorithm  require  a  somewhat  less  than 
straightforward  approach. 

The  enforcement  of  boundary  conditions  requires  particles  which  are 
about  to  interact  with  a  boundary  to  get  the  appropriate  boundary  in¬ 
formation  from  the  VP  set  storing  the  geometry  data.  Since  the  number 
of  particles  undergoing  boundary  interaction  is  relatively  small,  a  mas¬ 
ter/slave  algorithm  is  used  to  minimize  both  communication  and  com¬ 
putation.  In  this  algorithm,  the  master  is  the  VP  set  storing  the  particle 
data.  The  master  creates  a  slave  VP  set  large  enough  to  accommodate 
all  the  particles  which  must  undergo  boundary  interactions.  Since  the 
slave  is  much  smaller  than  the  master,  instructions  on  the  slave  VP 
set  execute  much  faster.  This  more  than  makes  up  for  the  time  that 
the  slave  requires  to  get  the  geometry  information  and  to  both  get  and 
return  the  particle  information. 

The  pairing  of  collision  partners  requires  sorting  the  particle  data 
such  that  particles  occupying  the  same  cell  are  represented  by  neigh¬ 
boring  virtual  processors  in  the  one  dimensional  NEWS  grid  storing  this 
data.  Dagum  [8]  describes  different  sorting  algorithms  suitable  for  this 
purpose.  The  fastest  of  these  makes  use  of  the  realization  that  the  par¬ 
ticle  data  moves  through  the  CM  processors  in  a  manner  analogous  to 
the  motion  of  the  particles  in  the  simulation.  The  mechanism  for  disor¬ 
der  is  the  motion  of  particles,  and  the  extent  of  motion  of  particles,  over 
a  single  time  step,  is  small.  This  can  be  used  to  tremendously  reduce 
the  amount  of  communication  necessary  to  re-order  the  particles. 

These  algorithms  have  been  implemented  in  a  two-dimensional  par¬ 
ticle  simulation  running  on  the  CM-2.  At  the  time  of  implementation, 
the  CM-2  at  NASA  Ames  had  only  64k  bits  of  memory  per  proces¬ 
sor  which  was  insufficient  to  warrant  a  three-dimensional  implementa¬ 
tion.  Furthermore,  the  shcewise  model  of  the  machine  did  not  exist 
and  the  machine  had  the  slower  32-bit  Weitek’s  which  did  not  carry 
out  any  integer  arithmetic.  Nonetheless,  with  this  smaller  amount  of 
memory  and  fieldwise  implementation,  the  code  was  capable  of  sim¬ 
ulating  over  2.0 -x  106  particles  in  a  grid  with  6.0  X  104  at  a  rate  of 
2.0/isec/particle/ timestep  using  all  32k  processors  (see  [7]).  By  com¬ 
parison,  a  fully  vectorized  equivalent  simulation  on  a  single  processor 
of  the  Cray  YMP  runs  at  1.0/rsec/particle/timcstep  and  86  MFLOPS 
as  measured  by  the  Cray  hardware  performance  monitor.  (Note  that  a 
significant  fraction  of  a  particle  simulation  involves  integer  arithmetic 
and  the  MFLOP  measure  is  not  completely  indicative  of  the  amount  of 
computation  involved;.  Currently,  work  is  being  tarried  out  to  extend 
the  simulation  to  three  dimensions  using  a  parallel  decomposition  which 
takes  full  advantage  of  the  slicewisc  model  of  the  machine. 


5.2  MIMD  Implementation  of  Particle  Simulation 

The  MIMD  implementation  differs  from  the  SIMD  implementation  not 
so  much  because  of  the  difference  in  programming  models  but  because 
of  the  difference  in  granularity  between  the  machine  models.  Whereas 
the  CM  2  has  32768  processors,  the  1PSC/8C0  has  only  128.  Therefore 
on  the  iPSC/860  it  is-natural  to  apply  a  spatial  domain  decomposition 


Table  2:  Performance  of  Particle  Simulation  on  the  Intel 
iPSC/860 _ 


Processors 

ps/prt/step 

MFLOPS 

efficiei.cy(%) 

2 

24.4' 

3.5 

97 

4 

12.5 

6.9 

95 

8 

6.35 

13.5 

93 

16 

3.25 

26.5 

91 

32 

52.8 

91 

64 

101 

87 

128 

215 

88 

rather  than  the  data  object  decomposition  used  on  the  CM-2. 

In  McDonald’s  [18]  implementation,  the  spatial  domain  of  the  sim¬ 
ulation  is  divided  into  a  number  of  sub-domains  or  regions  equal  to 
the  desired  number  of  node  processes.  Communication  between  pro¬ 
cesses  occurs  as  a  particle  passes  from  one  region  to  another  and  =it 
carried  out  asynchronously,  thus  allowing  overlapping  communication 
and  computation.  Particles  crossing  region  “seams”  are  treated  simply 
as  an  additional  type  of  boundary  condition.  Each  simulated  region  of 
space  is  surrounded  by  a  shell  of  extra  cells  that,  when  entered  by  a 
particle,  directs  that  particle  to  the  neighboring  region.  This  allows  the 
representation  of  simulated  space  (i.e,  the  geometry  definition)  to  be 
distributed  along  with  the  particles.  The  aim  is  to  avoid  maintaining 
a  representation  of  all  simulated  space  which,  if  stored  on  a  single  pro¬ 
cessor,  would  quickly  become  a  serious  bottleneck  for  large  simulations, 
and  if  replicated  would  simply  be  too  wasteful  of  memory. 

Within  each  region  the  sequential  or  vectorized  particle  Simula*' on  is 
applied.  This  decomposition  allows  for  great  flexibility  in  the  physical 
models  that  are  implemented  since  node  processes  are  asynchronous  and 
largely  independent  of  each  other.  Recall  that  communication  between 
processes  is  required  only  when  particles  cross  region  seams.  This  is  very 
fortuitous  since  the  particle  motion  is  straightforward  and  fully  agreed 
upon.  The  important  area  of  research  has  to  do  with  the  modelling 
of  particles,  and  since  this  part  of  the  problem  does  not  directly*  af¬ 
fect  communication,  particle  models  can  evolve  without  requiring  great 
algorithmic  changes. 

McDonald’s  implementation  is  fully  three-dimensional.  The  perfor¬ 
mance  of  the  code  on  a  3D  heat  bath  is  given  in  Table  2. 

At  the  present  time  the  domain  decomposition  is  static,  however  work 
is  being  wried  out  to  allow  dynamic  domain  decomposition  thus  per- 
mitting-a  good  load  balance  to  exist  throughout  a  calculation.  The 
geometry,  and  spatial  decomposition  of  the  heat  bath  simulation  exag¬ 
gerated  the  area  to  volume  ratio  of  the  regions  in  order  to  more  closely 
approximate  the  communication  expected  in  a  real  application  with  dy¬ 
namic  load  balancing.  The  most  promising  feature  of  these  results  is 
the  linear  speed  up  obtained,  indicating  that  the  performance  of. the 
code  should  continue  to  increase  with  increasing  numbers  of  processors. 


6  Conclusions 

On  the  unstructured  grid  code  the  performance  figures  are  summarized 
in  Table  3,  where  all  MFLOPS  numbers  are  Cray  Y-MP  equivalent 
numbers. 


Table  3  Performance  Comparison  of  Unstructured  Grid  Code 


Machine 

Processors 

secs/stcp 

MFLOPS 

Cray  Y-MP 

1 

150.0 

Intel  iPSC/860 

64 

1 

177.3 

128 

1- 1 

278.6 

CM-2  (32  bit) 

8192 

0.72 

81.3 

Fox  the  particle  methods  the  corresponding  summary  of  performance 
figures  can  be  found  in  Table  4.  The  figures  in  Table  4  should  be  in¬ 
terpreted  very  carefully.  The  simulations  run  on  the  different  machines 
were  comparable,  but  not  identical.  The  MFLOPS  are  Cray  Y-MP 
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equivalent  MFLOFS  ratings  based  on  the  hardware  performance  mon¬ 
itor. 


Table  4:  Performance  Comparison  of  Particle  Simulation  Code 


-Machine 

Processors 

/(sees  /  particle/step 

MFLOPS 

Cray  2 

1 

2.0 

43 

Cray  Y-MP 

1 

1.0 

86 

Intel  iPSC/860 

128 

0.4 

215 

CM-2  (32-bit) 

32768 

2.0 

43 

The  results  in  Tables  3  and  4  demonstrate  a  number  of  points.  Both 
unstructured  grid  computations  and  the  particle  simulations  are  appli¬ 
cations  which  a  priori  are  not  immediately  parallelized,  and  for  which 
both  on  SIMD  and  MIMD  machines  considerable  effort  must  be  ex¬ 
pended  in  order  to  obtain  an  efficient  implementation.  It  has  been 
demonstrated  by  the  results  obtained'at  NASA  Ames  that  this  can  be 
done,  and  that  supercomputer  level  performance  can  be  obtained  on 
current  generation  parallel  machines.  Furthermore  the  particle  simula 
tion  code  on  the  CM-2  is  a  production  code  currently  used  to  obtain 
production  results  (see  [9]).  The  iPSC/860  implementation,  should  be 
in  production  use  by  the  end  of  1991. 

-Our  results  aiso  demonstrate  another  feature  which  has  been  found 
across  a  number  of  applications  at  NASA  Ames:  massively  parallel  ma¬ 
chines  quite  often  obtain  only  a  fraction  of  their  peak  performance  on 
realistic  applications.  In  the  applications  considered  here,  the  require 
ment  for  unstructured,  general  communication  has  been  the  primary 
impediment  imobtaining  the  peak  realizable  performance  from  these 
machines.  Neither  the  CM-2  nor  the  the  iPSC/860  deliver  the  commu¬ 
nication  bandwidth  necessary  for  these  CFD  applications.  This  situa¬ 
tion  is  even  worse  for  implicit  algorithms  (see  e.g.  (2jj.  Experience  has 
shown  that  CFD  applications  require  on  the  order  of  one  memory  ref¬ 
erence  per  floating  point  operation  and  a  balanced  system  should  have 
a  memory  bandwidth  comparable  to  its  floating  point  performance.  In 
these  terms,  current  parallel  systems  deliver  only  a  fraction  of  the  re¬ 
quited  bandwidth. 
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Abstract 


References 


The  various  forms  of  parallel  numerical  algorithms  that 
speed  up  finite  element  computations  are  as  different  as  the  num¬ 
ber  of  researchers  working  on  the  problem.  However,  most  of 
the  recently  proposed  concurrent  computational  strategies  stem 
from  the  “divide  and  conquer”  paradigm  and  require  domain 
decomposition  or  mesh  partitioning.  In  this  talk,  we  present 
and  discuss  a  family  of  simple  and  efficient  nonrhumerical  al¬ 
gorithms  for  the  automatic  decomposition  of  arbitrary  finite  el¬ 
ement  and  finite  difference  meshes  into  a  specified- number  of 
adequatly  connected:  and  load  balanced  submeshes.  These  al¬ 
gorithms  cover  a  wide  spectrum  of  parallel  architectures  (lo¬ 
cal  memory,  shared1  memory,  massively  parallel)  and  feature  a 
large  range  of  approaches  (greedy  algorithms,  projection  meth¬ 
ods,  bandwidth-minimization).  In  particular  we  address  the  is¬ 
sues  of  communication  bandwidth  [2,  8],  interface  bottleneck  [3] 
and  element  recursion  [5] .  We  show  how  theaevarious  decom¬ 
posers  can  be  applied  to  implement  parallel,  massively  parallel, 
and  parallel/vector  explicit  and  implicit  direct,  frontal  and  iter¬ 
ative  finite  element  and  finite  difference  algorithms,. and  report 
on  their  performance  results  on  the  iPSC/2-32,  Connection  Ma¬ 
chine  CM2,  and  CRAY  Y-MP-  8.  For  local  memory  multipro¬ 
cessors,  each  partitioning  scheme  is  augmented  with  a  mapping 
algorithm  [1,  7,  4)  which  attempts  to  assign  directly  connected 
submeshes  to  directly  interconnected  processors. 

The  proposed  mesh  decomposers  arc  packaged  into  a  soft¬ 
ware  tool  which  is  hoped  to  relieve  the  burden  of  the  preprocess¬ 
ing  phase  from  the  methods  developers. 
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Abstract  :  We  want  to  compute  the  equilibrium  positions  of 
hyperelastic  bodies  under  large  strain  using  parallel  machines 
with  distributed  memory  architecture,  namely  a  hypervube.  We 
achieve  this  goal  by  using  a  domain-decomposition  method  at 
the  level  of  each  linearized  problem.  Assigning  one  sub-domain 
per  node,  the  computation  and  assembly  of  the  local  stiffness 
matrices  then  become  independent  tasks,  .avoiding  any  commu¬ 
nication  between  the  nodes.  The  remaining  computation  on  the 
linearised  problem  involves  a  mixed  solver,  meaning  that  we  use 
both  a  local  direct  solver  and  a  global  iterative  scheme.  Namely, 
a  preconditioned  conjugate  gradient  is  used  at  the  interface,  with 
a  preconditioner  that  has  been  chosen  in  sight  of  keeping  the 
high  granularity  of  the  parallelism.  The  taigel  machine  of  our 
experimentsis  an  Intel  iPSC/2  hypercube  32SX. 

1-  The  discretized  non-linear  problem  :  For  the  modeliz- 
ation  of  bodies  that  can  undergo  large  deformations,  we  choose 
the  Lagrangian  formulation.  This  means  that  all  variables  are 
defined  and  maintained  in  a  reference  configuration,  the  main 
unknown  being  the  displacement  field  u(i)  of  each  particle  of  the 
domain  Cl  once  the  loading  has  been  applied. 

The  equilibrium  equation,  once  discretized  on  a  Finite  Ele¬ 
ments  basis  {<?„},  is  solved  by  using  a  Newton-type  method.  For 
compressible  materials,  the  constitutive  law  takes  such  a  form 
that  each  step  can  be  described  as  : 

Step  n  — >n+ 1 


un+1  =  u"  -  [A"]"  (Gn  -  H°)  , 


where  F(x)  =  Id  +  Vu(s)  is  the  deformation  gradient  , 
and  W(f  )  is  the  specific  internal  elastic  energy  . 


In  turn,  for  isotropic  materials,  W  only  depends  on  the  invariants 
of  the  right  Cauchy-Green  tensor  F*F  : 

/,  =  Tr{  m  . 

h  =  Tr((adj/-’)Tadj/-')  . 

J  =  dcl(/'")  . 

A  typical  example  Is  given  by  the  fulluwmg  law  for  hyperelaslic 
materials  : 

fF(F’)  =  Ci(7i-3)+C2(/2-3)+«(J2-I)-(2C,  +  lC2+2o)!ogJ  , 

where  Ci,  Oi  and  a  arc  experimental  constants. 

To  enhance  the  Newton  scheme,  we  have  also  applied  the  fol¬ 
lowing  numerical  features  :  the  incremental  loading  and  the  arc- 
length  continuation,  which  enable  to  follow  awkward  problems 
like  buckling  (one  of  the  majui  needs  of  laige  deformations  mod 
elizations). 


2-  The  rrixecl  linear  solver  ■  At  each  iteiation  of  tills  pio- 
cess,  we  niuot  solve  a  linc-ai  system  of  equations  of  the  kind. 

An(UI>)  .  U,1+l  =  Fn(U")  . 

The  costly  steps  of  constructing,  assembling  and  factorizing  A" 
require  on  a  distributed  memoiy  machine  a  coarse-grained  paral- 
'elism,  in  order  to  avoid  overwhelming  communications.  There¬ 
for?,  the  domain  decomposition  methods  achieves  this  goal  by 
subdividing  ah  initio  the  geometiical  reference  domain  Cl  into 
non-overlapping  subdomains  Cl,,  separated  by  an  interface  F. 
Consequently,  the  computation  and  assembly  of  these  subdomain 
matrices  A,  become  fully  independent  tasks. 

As  we  could  have  stated  in  the  previous  paragraph,  the  global 
stiffness  matrix  A  is  symmetric,  positive,  and  most  often  definite 
(SPD).  It  is  composed  from  the  contributions  of  the  following 
submatrices: 

A,  .  trau.»  the  degiees  o!  ficv  doin  internal  to  0,, 

B,  :  interaction  between  Cl,  and  F, 

A,  :  contributions  due  to  the  elements  of  f),  on  F. 

By  performing  Gaussian  elimination  over  the  degrees  of  freedom 
related  to  the-interior  of  the  subdomains  Cl,,  one  obtains  a  lineal 
system  whose  unknowns  are  the  degrees  of  freedom  on  the  inter¬ 
face  and  whose  matrix  is  the  Schur  complement  matrix  S  on  the 
interface  F.  Then,  omitting  the  projections  and  the  mappings, 
one  might  observe  its  useful  additive  property: 

S--p,  =  Ai-BJA-'B,-  . 

i 

All  components  of  the  local  Schur  complement  matrices  can  be 
computed,  as  in  the  well  Known  subslntcluring  technique.  How¬ 
ever,  a  much  less  expensive  approach  consists  m  keeping  an  im¬ 
plicit  definition  of  the  local  Selim  complement,  and  solving  the 
interface  problem  using  a  Conjugate  Cmdient  method  (CG),  be¬ 
cause  S  in  turn  is  also  SPD.  At  sle,i  h  of  the  C  j,  one  has  to  form 
in  parallel  the  implicit  matrix-vector  product.  Sp*  where  p*  is 

the  L"1  descent  direction,  winch  requires  the  solution  of  a  linear 

* 

system  of  matrix  A,-. 

Based  on  an  LDLT  decomposition  of  A,,  a  direct  solver  is  used 
in  each  domain.  This  factorization  is  performed  once  and  for  all 
during  the  initialization  step  of  the  inner  CG  loop. 

However,  this  method acquires  a-  preconditioning  technique  to 

be  efficient.  Benefitting  from  our  experiments  with  the  linear 
three-dimensional  elasticity,  we  have  chosen  the  piccoiidilionur 
proposed  in  an  analytical  form  by  Glowinski  cl  al  in  [1  J.  Ibis 
amounts  to  approximating 

s-  =  (£s.r 

by  M-  =  ED.Sr'D:  . 

i 

where  D,  are  diagunal  weighting  mat i  ices.  I  his  pre-conditioner, 
is  often  referred  as  the  Neumann  pieconditioner,  because  of  the 
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analytical  boundary  conditions  described  at  the  inter  face.  Sim¬ 
ilarly,  using  the  Schur  complement  amounts  to  treat  a  Dirichlet 
problem  regarding  the  interface. 

Without  computing  the  local  Schui  Complement  S,  explicitly, 
there  exists  an  implicit  definition  of  theii  inveises  . 


/A; 

Bi 

V  0  \ 

YBT 

aJ 

V  l|r, ) 

Thus,  only  an  LDLT  factorization  of  the  local  stiffness  matrices 
has  to  be  performed,  in  order  to  compute  products  of  vectors  by 
the  preconditioning  matrix  M. 

In  the  lineal  fiaiuewcik,  tu-  Inn c  alicady  extensively  studied 
this  method,  m  [2],  It  st.ons  a  gleat  poleutnii  ioi  parallelism, 
especially  foi  distiibuled  iiieinoiy.aicliilectuie  and  it  proved  to  be 
robust  ill  plublems  «I  Ismg  flout  amsotiopic  and  uot-liuniugeiieous 
materials.  We  also  lia>'e  computed  tlieutctical  bounds  foi  the 
condition  number  of  the  iteration  matnx.  in  [3j,  we  proved  that  in 
a  general  partitioning,  it  grows  like  0  (l  -t-  !og(Jj)),  d  being 
the  average  diameter  of  a  subdomain  and  It  the  scale  of  the  mesh. 
The  weak  dependency'  ovei  li  means  that  the  preconditioner  is 
still  profitable  when  the  mesh  is  lefincd.  However,  the-number 
of  subdomains  should  not  increase  too  much,  and  a  limit  of  1G 
seems  reasonable,  especially  when d he  partitioning  is  peiformed 
in  the  three  dimensional  space. 

Withoutdhe  optimality  of  the  preconditioner  described  in  [5] 
by  Smith,  whose  condition  number  is  independent  of  d  and  li, 
the  “Neumann”  preconditioner  remains  local  and  easy'  to  con¬ 
struct  on  a  large  unstrucluied  inesh:  indeed  it  requires  neither 
the  explicit  Schui  Gomplcmeni  matrices  nor  any  coarse  mesh. 

This  vcrsatil.ty  of  .In-  "Neumann'’  precoiiditiouci  fauns  its 
implementation  in  non-linc-ai  rimte  Clement  pioblcm. 

Xhs?  data  Structure  for  the  interface  :  The  distributed  ar¬ 
chitecture  of  the  computer  must  be  taken  into  account  in  the 
choice  of  a  suitable  data  structure  for  the  interface. 

At  each  iteration  of  the  FOG.  there  arc  3  interface  vectors 
to  he  stored:  u*,  r*  and  p*  the  displacement,  the  residual  and 
the  descent  diiection,  respectively;  and  2  interface  vectors  to  he 
used  t  =  S,-p*  and  z  —  Mr*  the  conjugate  direction  and  the 

preconditioned-residual,  respect ively. 

We  describe  a  strategy  of  implementation,  called  global  in¬ 
terface,  wheieenrli  node  of  the  machine  redundantly  .-t ores  ihe 
whole  interface,  as  opposed  to  I  he  so-called  local  interface,  when* 
each  node  of  the  machine  only  knows  the  interface  degrees  or 
freedom  which  are  in  its  immediate  neighborhood. 

This  global  interface  also  induces  some  redundant  computa¬ 
tion,  but  reduces  the  nunibci  of  cuiiimuiinatiuns.  On  the  one 
h«.nd,  the  vectors  to  he  tiunsfcrrcd  aic  longer,  on  the  ,  u*r 
hand,  no  communications  an-  needed  lopcrfuim  thedol-producc. 
(whereas  in  the  other  approach,  local  weighted  subproducis  are 


computed-,.nd  thcn  gathered). 

With  this  data  structure,  the  only  exchanges  are  the  global 
summations:  those  arc  scheduled  to  ic  performed  by  physical 
directions  oi  links  (set  Saad  [ljj,  thus  no  „peual  mapping  of  the 
subdomains  onto  the  nudes  is  rei|iiircJ,  e.g.  by  a  binaiy  Gray- 
Code.  Thanks  to  the  unicitv  of  the  structure  of  the  inlerface.  one 
level  of  indirect  addiessiug  is  also  suppressed  at  Ihe  gathering 
operation. 

A  complex  splitting  becomes  more  dtffiiiill  to  handle  with  the 
global  data  structure.  However,  with  no  comolementary  com¬ 
munications,  the  code  has  been  implemented  with  the  following 
feature,  two  nodes  arc  dedicated  to  each  subdomain,  one  stor 
ing  and  using  the  Dirichlet  sulvci,  the  other  one  taking  care  of 
the  Neumann  solver.  Noticc  that  on  a  distributed -nitn.,.iy  ma 
chine,  ti  ts  approach  leads  to  a  good  p<ira!lt  lization  of  the  mem 
ory  management  and  postpone:  the  risk  •/,  lack  of  memory  for 
bigger  problems.  Of  cuuisc,  these  two  oKcrs  are  still  accessed 
sequentially,  but  it  implies  that  for  a  given  problem,  fitted  to  n 
processors  in  memory  requirements,  one  splits  the  body  into  | 
subdomains,  overcoming  some  difficulties  of  convergence  previ 
ously  quoted.  Examples  show  that  it  is  a  matter  of  trade  c.(f. 

The  results  that  will  be  shown  have  been  computed  on  the 
Intel  iPSC/2  32SX  of  ONERA,  thanks  to  a  cooperation  between 
the  Groupe  de  Calcul  Parallele  of  ONERA  and  the  Parallel  Al¬ 
gorithms  Group  at  CEREACS. 
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Abstract 

We  are  dealing  with  integral  equations  re¬ 
lated  to  Helmholtz  equation.  They  come 
from  scattering  problems  around  a  compact 
objet.  The  usual  way  of  discretizing  them 
leads  to  a  full  complex  non-hermitian  ma¬ 
trix.  This  drastically  limits  the  size  of  com¬ 
putable  problems  because  of  the  limited  size 
of  memory  on  computers  . 

1  Preconditioning 

The  algorithm  used  for  resolution  is  Gen¬ 
eralized  Conjugate  Residual  Algorithm.  It 
needs  to  store  all  directions  of  descent.  Pre¬ 
conditioning  has  two  advantages.  First  it  re- 
I vices  the  CPU  time  fu;  the  resolution  and 
jecond  it  leads  to  fewer  directions  to  be  sto¬ 
red,  so  that  we  can  test  meshes  with  more 
points  and  so  higher  frequencies. 

The  preconditioning  matrix  we  will  fo¬ 
cus  on  consists  of  a  subpart  of  the  full  ma¬ 
trix.  More  precisely  we  will  only  retain  coef¬ 
ficients  that  come  from  interaction  between 
points  near  from  each  other  (near  means  the 
distance  is  less  than  a  few  wavelengths). 

We  first  show  some  theoretical  results.  The 
point  is  that,  in  a  certain  extent,  we  can  ex- 
plane  how  that  preconditioner  acts.  Indeed 
it  tends  to  diminish  the  highest  eigenvalues 
of  the  matrix  with  no  precise  effect  on  the 
lower  ones  What  is  really  interesting  is  that 
these  results  remain  true  when  frequency 
grows  to  infinity. 

We  then  present  two  series  of  numerical 
issues  of  that  preconditioned  algorithm.  The 
first  one  aims  to  illustrate  the  reduction  of 
the  number  of  iterations.  We  can  see  in  ta¬ 
bles  1  and  2  that  the  most  rcmarquable  facts 
is  that  the  number  of  iterations  is  reduced 
from  typically  10  to  1  and  that  seems  not 


to  vary  . )  <  frequency.  Table  1  shows 
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Table  1:  Unpreconditioned  GCR.A. 

numbers  of  iterations  for  the  unprecondi¬ 
tioned  algoritb,.,  for  various  frequencies.  In 
these  tests,  the  scatterer  is  a  .sphere  of  radius 
1,  with  sound  speed  equals  to  333.  The  num¬ 
ber  of  degrees  of  freedom  is  1026.  The  inci¬ 
dent  wave -Is  spherical  harmonic.  In  table  2 
is  we  can  oee  the  number  of  iterations  needed 
to  achieve  convergence.  The  parameter  6 
is  the  maximal  distance  between  2  points 
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49 
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Table  2:  Preconditioned  GCRA. 

whose  m.fyal  interaction  is  taken  into  ac¬ 
count  in  the  preconditioning  matrix.  The 
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second  series  of  reoultspresents  comparisons 
between  a  monoptocessor  (Crayll)  and  a  par¬ 
allel  machine  (iPSG-2)  in  terms  of  CPU  time, 
in -table  3  we  present  tests  for  two  sizes  of 
mesh.  The  scatterer  is  the  same  as  before 
and  the  incident  wave  is  a  Mane  one.  In 
that  fable,  resolution  time  is  die  sum  of  the 
time  of  assembly  of  the  matrix  and  the  time 
of  the  GGRA. 

Mesh  n°l  :  168  points  and '968  triangles. 

Mesh  n°2  :  1026  points  and  2048  triangles. 

We  can  see  that  a  hypeicube  with  32  nodes 
is  about  the  fifth  of  a  processor  of  CRAYII. 
Next  we  will  'tudy  the  way  of  paralleliz¬ 
ing  sc*ne  cruc.al  pieces  of  the  code  on 
iPSC-2.  We  will- see  what  we  can  exp  e-.i  in 
terms  of  speed-up  related  to  local  granular¬ 


Test 

Assembly 

Iteration 

Resolution 

C-II 

5-Cube 

C-II 

5-Cube 

C-II 

5-Cube 

n°l 

00 

235,6 

0,95 

6,3 

100 

265 

n°2 

263 

021 

2 

17 

267 

1145  1 

Table  3.  Compared  times.  Cray-11  vs  n-Cube  (in  seconds). 


ity  of  the  calculus.  We  will  see  that  for  a  dot 


product  we  must  increase  this  granularity  to 
maintain  efficiency  as  we  inci  ease  the  num¬ 
ber  of  nodes  when  for  a  matrix- vector  prod¬ 
uct  it  can  remain  constant  if  we  take  care. 
In  table  4  we  present  actual  times  of  compu¬ 
tation  for  a  matrix-vector  product.  Nloc  is 
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Table  4.  Matrix- vector  product  (time  in  ms). 


the  size  of  a  vector  divided  by  the  number 
of  processor  used.  Tmt  and  Tcomm  are  re¬ 
spectively  the  time  due  to  computation  and 
communications. 
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Parallel  Grid  and  Multigrid  Methods  for 
Distributed  Memory  Architectures* 


Meanwhile  also  codes  basedon  irregular  grids  (as  used  by  Finite  El¬ 
ement  methods)  and  locally  refined  grids  have  been  implemented  on 
distributed  memory  parallel  computers.  Efficient  and  and  comfort¬ 
able  tuuls  for  these  struc.ures,  however,  have  to  be  developed  vet. 


KarlSokhenbach 


2.2  Parallel  grid  algorithms 


P\LLAS  GmbH,  Hohe  Str.  73,'D-5300Bonn 


1  Introduction 

Algorithms  for  the  numerical  solution  of  PDEs  are  typically  based  on 
grid  data  structures  (cither  regular  or  irregular  ones).  These  algo¬ 
rithms  are  characterized  by  inherent  parallelism  and  locality:  values 
at  different  grid  points  can  be  calculated  simultaneously  and  the  - 
usually  iterative  -  calculation  of  a  grid-point  value  involves  only  val¬ 
ues  at  certain  neighboring  points. 

Due  to  these  properties  grid  based  algorithms  (like  red-black  relax¬ 
ation)  can  be  implemented  on  distributed  memory  architecurcs  very 
efficiently.  Grids  are  decomposed  into  subgrids  (grid  partitioning) 
and  each  subgrid  is  connected  to  a  processor.  The  locality  of  the  grid 
operator  guarantees  that  the  communication  between  processors  is 
limited. 

The  implementation  of  standard  multigrid  methods  is  also  based  on 
the  grid  partitioning  approach.  The  parallel  efficiency  of  multigrid, 
however,  is.somew  hawless  than  that  of  the  corresponding  single  grid 
method.  This  is  mainly  due  to  the  high  communication/  calculation 
ratio  and  the  short  message  length  on  coarse  grids.  Nevertheless,  the 
numerical  efficiency  of  multigrid  outperforms  these  losses  easily. 
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Tig,..^ a.J.icobi  and  Gauss  Seidel  relaxation  schemes.  •  denotes  grid 
points  which  can  be  calculated  independently  in  parallel,  a  denotes 
grid  points  with  old  values,  and  □  denotes  grid  points  with  already 
calculated -new  values. 


2  Parallel  grid-based  applications 

TI:e  mathematical  model  of  many  different  supercomputer  applica¬ 
tions  arc  formulated  as  (systems  of)  partial  differential  equations 
(PDFs).  The  discretization  of  the  PDEs  most  naturally  leads  to  a 
grin  v-3Scd  formula  ion  of  the  problem,  i.e.  grid  data  structures  and 
grid-brsed  algorithms. 

The  implementation  on  distributed  memory  parallel  computers  re¬ 
quires 

•  the  patallelization  of  the  existing  algorithms  or  their  substitu¬ 
tion  by  new  parallel  algorithms; 

•  thedistr  hution  of  the  data  structure  to  the  local  memory  units. 
The  data  distribution  should  try  to  preserve  locality  (i.e.  mini¬ 
mize  communication)  and  to  achieve  load  balancing. 


A  grid  algorithm  is  a  (usually  iterative)  method  which  calculates  the 
value  of  a  grid  function  at  ..we  point  as  a  function  of  values  defined 
at  neighboring  points.  The  er.tion  (also  called  relaxation)  can  be 
characterized  as  Jacobi-type  jthc  new  iterate  at  a  grid  point  is  calcu¬ 
lated  u>jng  only  old  neighboring  values)  or  Gauss-Seidtl-lype  (using 
already  calculated  new  neighboring  values).  Obviously,  Jacobi-type 
methods  are  completely  parallel  since  the  calculation  in  each  grid 
point  can  be  performed  independently  (cf.  Figure  1  (a)).  If  the  num¬ 
ber  of  grid  points  is  A'  the  parallelism  is  also  jV. 

The  parallelism  of  GaussEeidcl  methods  depends  on  the  order  in 
which  the  grid  points  are  processed.  Lexicographic  ordering  implies 
that  only  points  on  diagonal  lines  can  be  calculated  in  parallel  (cf. 
Figure  1  (b)). 

For  Gauss-Scidcl  methods,  a  far-better  degree  of  parallelism,  namely 
.V/2,  is  obtained  by  “coloring"’  the  grid  points  appropriately  and  pro¬ 
cessing  all  points  of  the  same  color  simultaneously,  c.g.  the  so-called 
red-black  (RB-)  relaxation  (cf.  Figure  1  (c)). 


2.1  Grid  data  structures 

Distribution  strategies  and  tools  have  been  developed  for  two  classes 
of  grid  structu'.’-j: 

Ren  Jar  grids  are  v !  aractewd  by  direct  addressing  of  the  grid  points 
ar.d  a  rectangular  or  cuboid  address  space.  Geometrical  neighbors  arc 
also  logical  noighhjrs. 

Block-structured grids  arc  composed  of  several  regular  grids.  Each  sin¬ 
gle  block  sho«  •*  internally  a  regular  grid  structure;  the  block  structure 
itself,  however,  is  irregular  (witn  certain  restrictions!. 


’Pills  of  this  work  were  funded  by  ibe-GENESIS  (ESPRIT  .  iTn2J  project 


2.3  Grid  partitioning 

The  usual  way  to  implement  parallel  grid  algorithms  on  a  distributed 
memory  system  is  based  on  the  method  of  grid  partitioning.  The 
computational  domain  .«-g:«i)  is  di"idcd  into  several  subgrids  which 
are  assigned  to  parallel  processes. 

Each  relaxation  step  can  be  performed  on  a  subset  of  interior  points 
of  the  subgrid  (•  in  Figure  2)  independently.  Calculation  of  values  at 
interior  boundary  points  (o  in  Figure  2),  however,  needs  the  values 
from  neighboring  subgrids  (= processes).  Since  the  processes  have  no 
common  data  space  these  values  somehow  have  to  be  made  available, 
'nstead  of  transferring  the  values  individually  at  the  time  they  are 
needed  it  is  more  efficient  to  have  copies  of  neighboring  grid  points  in 
the  local  memory  of  e?-h  process  (O).  Hence,  each  process  contains 
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a  so-called  overlap  area  (surrounded  by  the  dashed  line  in  Figure  2) 
which,  of  course,  has  to  be  updated  after  each  iteration  step. 
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Figure  2;  Overlap  areas  and  their  exchange. 

Ihc  grid  partitioning  approach  can  be  extended  to  blcck-si.uctured 
grids  in  a  straight-forward  manner. 

2.4  Multigrid  methods 

Standard  iterative  multigrid  algorithms  process  a  cycle  from  the  fine 
to  the  coarse  grids  and  back  to  the  fine  grids  sequentially,  whereas  on 
each  grid  level  the  actual  problem  is  treated  in  parallel  similarly  to 
the  parallel  single  grid  algorithms  described  in  the  previous  sections. 

On  parallel  distributed-  memory  systems  an  efficient  implementation 
of  multigrid  algorithms  :s  not  trivial  since  the  performance  may  de¬ 
grade  due  to: 

•  idle  processors  on  very  coarse  grids. 

•  short  messages  and  dominant  influence  of  start-up  time. 

•  bad  communicalion/computalion  ratio. 

The  algorithinical  and  technical  details  of  parallel  multigrid  algo¬ 
rithms  arc  described  in  [3]. 

2.5  Communications  library 

For  grid  applications,  the  explicit  programming  of  the  communica¬ 
tion  can  be  hidden  from  the  user.  In  the  SUPRENUM  project,  for 
example,  a  library  of  communication  routines  has  been  deve!opcd  [l] 
which  ensures 

•  clean  and  error-free  programming, 

•  easy  development  of  parallel  codes. 

•  portability  within  the  class  of  distributed  memory  computers. 
Programs  can  be  ported  to  any  of  these  machines  as  soon  as 
the  communication  library  has  been  implemented. 

Ihc  library  supports  regular  Afid  biutK-slfudufcd  grids  Ahd  dtdu 
able  at  the  GMD  or  at  the  PALLAS  GmbH. 

3  Performance 

3.1  Performance  measures 

The  quantities  of  interest  in  evaluating  the  performance  of  parallel 
algorithms  are: 


•  Time  T(N,P).  time  to  solve  a  problem  of  size  N  on  a  multi¬ 
processor  system  using  P  nodes, 

•  speed-up  S(AT,.P)  :=  T(N,i)/T(N,P), 

•  efficiency  E(N<  P)  :=  S(N.P)/P. 

Note  that  on  the  MIMD/SIMD  architectures  the  utilization  of  the 
hardware  capabilites  is  the  product  of  the  “multiprocessor”  efficiency 
as  defined  above  and  the  efficiency  rclated  to  the  vector  processing 
unit.  The  total  problem  solving  time  -  which  is  the  only  interesting 
number  from  the  user’s  point  of  view  -  depends,  of  course,  addition¬ 
ally  on  the  numerical  efficiency  of  an  algorithm. 

In  practice  E  will  be  smaller  than  its  idea!  value  1,  mainly  because 
of  communication  (including  synchronization),  unbalanced  load,  and 
sequential  parts  in  the  algorithm. 

3.2  Performance  model  for  grid  applications 

Let  ,Y  be  the  number  of  grid-points,  D  the  dimension  of  the  grid 
(typically  2  <  D  <  4)  and  n  =  N/P  the  size  of  the  local  grid  on  each 
processor  The  total  grid  is  assumed  to  be  cubic.  Then  the  time  for 
the  arithmetic  calculations  is  To, <  =  Cj«.  On  homogeneous  parallel 
architccures  the  time  needed  for  communication  consits  of  two  com¬ 
ponents,  the  so-called  start-up  time  necdcd'for  the  initialization  of  a 
message,  and-thc  transfer  time  which  is  proportinionai  to  the  Icntgh 
of  ihc.  message. 

The  data  volume  to  be  communicated  depends  on  the  way  how  the 
grid  is  partitioned.  If  the  partitioning  is  performed  in  all  D  dimen¬ 
sions  and  cubic  subgrids  are  generated  the  communication  time  is 
Tamm  —  cjnlD-IP°  q-  C3.  The  speed-up  is 

S(N'P)  =  l+an(-i)/o+|in-i- 

The  asymptotic  behaviour  is 

S(N.  P)  —  P,  E(N,  P)  —  1  fom  —  00. 

The  efficiency  remains  constant  for  scaled  problems  fn  constant,  P  — * 
00). 

The  constants  c;  depend  on  the  particular  grid  algorithm  and  the 
properties  of  the  hardware  (communication  speed,  floating-point  per¬ 
formance  etc.).  A  detailed  analysis  can  be  found- in  [2J. 
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Abstract 

The  success  of  highly  parallel  distributed 
memory  multiprocessors  will  depend  mainly 
on  their  efficiency  when  running  realistic  ap¬ 
plication  codes.  This  paper  presents  the  main 
topics  discussed  in  the  session  dedicated  to 
the  use  of  massively  parallel  MIMD  systems 
in  the  field  of  scientific  computing. 

In  the  race  to  Teraflops  performances  a  new 
generation  of  highly  parallel  multiprocessors 
is  emerging,  which  is  based  on  the  use  of  a 
large  set  of  powerfull  microprocessors.  Nev¬ 
ertheless  the  acceptance  of  such  systems  in 
the  industry  will  depend  mainly  on  their  ac¬ 
tual  performance  when  running  realistic  ap¬ 
plication  codes. 

This  could  be  achieved  by  redesigning  nu¬ 
merical  methods  and  algorithms  that  are  used 
today  to  solve  partial  differential  equations 
in  areas  such  as  CFD,  structural  analysis  or 
electromagnetism  simulation. 

This  session  focuses  on  the  development  and 
the  implementation  of  these  methods  on  mas¬ 
sively  parallel  MIMD  architectures  (iPSC, 
NCUBE,  BBN  ...). 

On  such  systems  the  efficiency  is  often  the 
result  of  a  trade-off  between  the  reduction  of 
the  time  due  to  data  communication,  either 
in  the  communication  network  or  through 
the  memory  hierarchy,  and  the  reduction  of 
the  computation  time.  Then  parallel  algo¬ 
rithms  exploiting  data  locality  in  private  or 
local  memory  are  specially  stressed. 
Moreover,  the  use  of  a  geometric  parallelism, 
based  on  a  partition  of  the  computational 
domain,  pushes  the  development  of  software 
tools  that  provide  automatically  this  parti¬ 
tioning  and  the  corresponding  data  struc¬ 
tures. 


This  subject  has  been  studied  at  the  Uni¬ 
versity  of  Colorado  where  several  mesh  de- 
composers  has  been  developped  and  adapted 
to  various  machines  such  as  the  hypercube 
iPSC2,  the  CRAY  multiprocessors  and  the 
Connection  Machine. 

Furthermore  representatives  from  the  cen¬ 
ters  of  NASA  Ames  and  NASA  ICASE  pre¬ 
sent  their  last  results  about  the  utilization  of 
massively  parallel  computers  for  CFD.  The 
respective  advantages  of  SIMD  and  MIMD 
computers  are  particularly  discussed. 

Then,  the  experience  done  at  CERFACS  con¬ 
cerning  the  development  of  a  domain  decom¬ 
position  method  is  presented.  This  method, 
that  provides  a  coarse  grain  parallelism,  has 
been  implemented  with  success  on  the  iN- 
TEL  iPSC2. 

The  multigrid  technique  is  now  widely  used 
for  accelerating  the  convergence  of  iterative 
algorithms  on  structured  grid.  However  this 
technique  leads  to  non-local  memory  refer¬ 
ences  that  could  enter  in  contradiction  with 
an  efficient  implementation  on  a  distributed 
memory  architecture.  The  experience  gath¬ 
ered  at  SUPRENUM  on  this  subject  is  also 
adressed  in  this  session. 

At  last,  dealing  with  very  large  dense  ma¬ 
trices  issued  from  an  integral  equation  for¬ 
mulation,  recent  algorithmns  developments 
done  at  ONERA  adequated  to  the  numerical 
computation  of  Helmholtz  equation  are  pre¬ 
sented  with  implementation  results  on  CRAY- 
2  and  iPSC2  multiprocessors. 
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Abstract  The  two  most  popular  models  of  sequential  and  parallel  computation 
lead,  once  defined  precisely,  to  a  computational  parados.  Specifically,  we  show 
that  for  a  wide  family  of  problems  the  cost  of  a  PRAM  solution  is  smaller  than 
that  of  its  RAM  counterpart  This  contradicts  the  currently  established  belief,  and 
docs  not  appear  to  be  amenable  to  explanation  using  existing  approaches.  We  use 
the  term  parallel  synergy  to  refer  to  this  phenomenon. 

I.  INTRODUCTION 

Over  the  last  forty  years  the  Random  Access  Machine  (RAM)  has  established 
itself  as  the  most  widely  understood  and  used  model  of  sequential  computation 
(Engclcr,  Hoperoft.  Machtcy.  MandnohJ.  The  model  consists  primarily  of  a  pro¬ 
cessor  and  a  random  access  memory  The  processor  possesses  a  constant  number 
of  local  registers,  and  operates  under  the  control  of  a  sequential  algorithm.  Each 
step  of  such  an  algorithm  consists  of  (up  to)  three  phases: 

(i)  a  READ  phase,  where  the  processor  reads  a  datum  from  the  random  access 
memory  and  stoics  it  in  one  of  its  local  registers: 

(ii)  a  COMPUTE  phase,  when:  the  processor  performs  an  elementary  operation 
(such  as  comparison,  addition,  etc...)  on  data  in  its  local  registers: 

(iii)  a  WRITE  phase,  where  the  processor  writes  into  the  random  access  memory 
the  result  of  some  computation. 

Fach  of  the  phases  is  assumed  to  take  constant  time,  leading  to  a  constant  execu¬ 
tion  time  per  step,  it  is  important  to  emphasize  that  the  model  as  described 
assumes  that  each  of  the  operands  and  results  of  an  elementary  operation  fits  into  a 
single  memory  location.  Thus,  in  the  terminology  of  tAhoj,  we  arc  using  the  ‘uni¬ 
form  cost  criterion"  (not  to  be  confused  with  the  cost  of  a  compulation  defined 
below). 

In  parallel  computation,  the  Parallel  Random  Access  Machine  (PRAM)  appears  to 
be  the  preferred  model  among  theoretical  computer  scientists  [Akl  1,  Gibbons. 
Karp.  Parbeny],  Here  several  processors  share  a  common  random-access 
memory.  As  in  the  RAM.  each  processor  has  a  constant  number  of  local  registers. 
All  processors  simultaneously  execute  the  instructions  of  a  parallel  algorithm. 
Each  step  of  such  an  algorithm  consists  of  (up  to)  three  phases: 

(i)  a  READ  phase  where  processors  read  data  from  the  shared  memory  and 
store  them  in  their  local  registers: 

(ii)  a  COMPUTE  phase  where  processors  perform  elementary  operations  on 
local  data: 

(iii)  a  WRITE  phase  where  processors  write  results  to  the  shared  memory. 

Each  of  these  phases  requires  constant  time,  again  leading  to  a  constant  time  per 
step  of  the  algorithm.  Note  that  some  processors  may  not  execute  one  ot  two 
phases  of  a  given  step.  Also,  during  a  READ  or  WRITE,  every  processor  may  gain 
access  to  a  different  memory  location.  However,  the  PRAM  gives  nsc  to  a  number 
of  variants  depending  on  whether  two  or  more  processors  arc  allowed  to  gain 
access  simultaneously  to  the  same  memory  location  (for  reading  or  for  writing).  In 
this  paper  we  shall  be  concerned  solely  with  that  variant  of  the  PRAM  which 
disallows  such  simultaneous  access  to  the  same  memory  location.  This  model  is 
known  in  the  literatureas  the  Exclusive-Read  Exclusive-Write  (EREW)  PRAM. 

Let  us  define  the  cost  of  an  algorithm  as  being  the  product  of  the  number  of  pro¬ 
cessors  it  uses  and  its  running  lime  (Akl  I.  Quinn].  (Note  that  some  authors  use 
the  term  work  instead  of  cost  (Cormen].}  It  is  usually  said  that  if  c  is  the  cost  of 
running  an  algorithm  A  on  a  PRAM,  then  the  cost  of  simulating  A  on  a  RAM  is 
(asymptotically)  equal  to  c  [Akl  I.  Almasi.  Eager,  Faber  1.  Faber  2,  Fishbum. 
Modi],  We  argue  in  this  paper  that  this  statement  is  no  longer  tree  ooce  the  net¬ 
work  interconnecting  processors  to  memoty  locations  ts  taken  into  consideration 
by  the  cost  analysis.  More  precisely,  we  show  that  for  a  wide  family  of  computa¬ 
tional  problems,  the  cost  of  a  PRAM  solution  is  smaller  (asymptotically)  than  that 
of  tie  best  possible  sequential  solution.  Furthermore,  the  cost  of  the  PRAM solu- 
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tiun  grows  when  simulated  on  a  RAM.  VVe  emphasize  here  that  the  question 
addressed  in  this  paper  (.namely  inclusion  ol  the  interconnection  network  in  die 
cost  analysis)  is  distmct  from  the  problem  treated  in  (Akl  3.  Gnt,  Gustalson, 
Janssen.  Komfcld.  Lai.  Leach.  Li  1.  Li  2.  Mchrotra,  Parkinson.  Preiss.  Quinn. 
Wcidc],  where  various  issues  pertaining  to  speedup  (ire.  the  rano  ol  sequential  to 
parallel  running  time)  arc  discussed. 

2.  TRADITIONAL  COST  ANALYSIS 

Assume  that  a  problem  P  of  size  n  is  given,  for  which  is  a  scqucnual  algorithm 
running  in  sequential  time  ts(n)  on  a  RAM.  The  cost  of  As  is  cs(n)  s  i  x  ls(n)  = 
ls(n).  Note  that,  because  there  is  only  one  processor,  the  cost  ol  a  sequential  algo¬ 
rithm  is  exactly  its  tunning  time. 

Further,  let  Ap  be  a  parallel  algorithm  for  P  running  in  parallel  umc  tp(n)  =  ls(n)/n 
on  a  PRAM  with  n  processors.  The  cost  of  Ap  is  Cp(n)  =  nx  lp(n)  =  ts(n). 

As  cs(n)  and  Cp(n)  arc  derived  for  the  RAM  and  PRAM,  respectively,  they  do  not 

take  into  consideration  the  network  required  for  memory  access.  Indeed,  both  the 
P  \M  and  the  PRAM  ignore  that  network  despite  the  fact  that  ns  cost  ore.  the  pro- 
due*  of  th-  number  of  processors  it  uses  and  the  time  required  to  traverse  ily  dom¬ 
inates  that  of  many  computations.  We  now  propuse  to  examine  whal  happens  to 

c  (n)  and :  (n)  once  the  cost  of  the  interconnection  network  is  taken  into  account, 
s  p 

We  note  in  passing  that  an  interconnection  network  that  docs  not  allow  feedback. 
Ire.  a  network  where  each  processor  is  used  once  per  memory  access,  is  sometimes 
referred  to  as  a  circuit  [PsrbcnyJ.  Occasionally,  the  cost  (or  sire)  of  a  circuit  is 
expressed  simply  as  the  number  of  processors  it  uses,  without  multiplying  the 
latter  by  the  lime  it  takes  to  traverse  the  circuit  (also  know-n  as  the  circuit's  depth). 
In  this  paper,  we  prefer  to  adhere  to  the  standard  definition  of  cost  (namely, 
number  of  processors  x  running  lime),  in  onler  to  avoid  restricting  our  discussion 
to  circuits.  As  it  turns  out.  inclusion  of  the  memory  access  time  in  the  analysis 
alfccts  our  results  only  marginally. 

3.  TRUE  EFFICIENCY 

In  the  RAM.  in  order  to  gain  access  to  any  of  n  memory  locations,  the  processor 
issues  a  log  n  -  bit  address.  A  network  of  size  0{n)  decodes  this  address  m  0{fog 
n)  time  This  network  is.  foi  example,  a  binary  tree  ot  processors  (ire.  a  circuit’  in 
the  terminology  defined  earlier)  [Kuck.  Tanenbaumj.  Ii  has  a  east  ol  0(n  log  n ). 

In  the  EREW  PRAM,  n  processors  can  gam  access  to  n  memory  locauons  simul¬ 
taneous!)  (one  memory  fixation  per  processor;  in  G(tog3  n)  time  using  a  network 

of  0(n  !ogb  n)  processors  where  a  and  b  are  two  constants.  Typical  values  of  a  and 

b  arc  given  in  Table  I. along  with  references  to  the  corresponding  networks,  the 

cost  of  the  network  for  memory  access  is  therefore  0(n  log*1  n).  where  d = a + b. 


Network 

a 

_b 

[Batcher] 

2 

2 

[Stone] 

2 

0 

(Ajtail 

i 

1 

[Leighton] 

i 

0 

Table  1.  Values  of  a  and  b  for  typical  networks  used  in  memory 
access.  Note  that,  unlike  the  networks  of  [Stone!  and  I  Leighton], 
there  of  [Batcher!  and  [Ajtail  are  'circuits". 


706 


The  revised  cost  of  As  is  therefore. 


6.  DISCUSSION 


c‘s(n)  =  (1  +  0(n))  x  (ts(nj  x  0(tog  n«  =  t^n)  x  CHn  log  n>. 
while  the  revised  cost  of  Ap  is; 

t  p(n/  =  (n  +  0(.n  k>gb  t\»  x  O^ny/n  x  Otlog3  n »  ~  i^n;  x  Ovlugd  n,. 

In  other  words,  the  cost  of  the  parallel  algorithm  is  asympfotiedly  smaller  than 
that  of  the  sequential  algorithm!  Notice,  that,  because  ip^n,  is  defined  as  l^n^ti.  the 

exact  value  of  l^vn;  is  irrelevant  when  computing  ihe  fane  c  s\ii;,c  it  so 
needed,  one  may  of  course  assume  that  ts(n)  is  the  running  time  of  the  fastest  pos¬ 
sible  algorithm  for  P. 


It  should  also  be  clear  (hat  our  analysis  holds  lor  any  number  oi  ttradiliunaiy 
PRAM  processors,  provided  that  this  number  is  at  most  a  linear  function  ol  n  vihe 
number  of  PRAM  memory  locations  required  to  solve-  a  given  problem  oi  sere  ny. 
Indeed,  denoting  the  number  ol  PRAM  processors  by  N.  w  here  N  e  n,  *  e  see  that 
the  asymptotic  value  of  c  remains  unchanged,  namely. 

c*p<n)  =  (N  +  Of(n  +  N)  logb(n  +  N»  x  (t$(n)/n  x  O(iog3(n  +  N)) 
=  «s(n)xO(Iogdn). 


Traditional  analyses  of  cost  either  ignore  the  existence  of  a  network  to  intercon 
ncct  processors  to  memory  locations,  or  (implicitly)  assume  that  the  cost  of  such  a 
network  is  C{1).  Both  approaches  are  clearly  unrealistic;  any  reasonable  model  of 
compulation  must  include  as  an  integral  part  a  means  of  Unking  processors  to 
memory  locations,  whose  cost  is  a  function  of  the  number  of  these  processors  and 
memory  locations. 


cm  tile  other  hand,  in  deriving  C  in,  and  C  .n,  we  have  taken  into  account  I 


tne  number  ol  processors  required  for  such  a  network  and  the  ut  t  cLpsed  during 
memory  access.  It  may  be  argued  that  since  the  processors  used  to  build  the  inter¬ 
connection  network  are  simpler  than  those  actually  doing  the  arithmetic  and  logi¬ 
cal  computations,  the  two  ought  not  be  treated  equally  in  the  cost  analysts.  The 
fallacy  in  this  argument  is  that  the  complexity  (i-e.  size  and  number  of  internal 
components  such  as  registers,  ol  a  (RAM  or  PRAM)  processor  used  foe  .omput 
ing  is  only  a  constant  multiple  ol  that  ol  an  interconnection  network  processor 
ijincc  Doth  are  expected  to  handle  dura  ol  the  same  magnitude,.  It  is  therefore 
quite  reasonable  in  an  asymptotic  cost  analysis  to  lump  the  two  kinds  of  proecs 
sure  together  and  view  them  tas  we  did,  asucftitugexo  of  a  computational  model 
(memory  locations  being  the  passive  agents).  As  a  result,  we  arrived  at  a  conclu¬ 
sion  contradicting  the  established  belief  whereby  the  cost  of  a  parallel  algorithm 
for  a  given  problem  cannot  be  smaller  than  that  of  the  best  possible  sequential 
algorithm  for  that  problem. 


As  noted  above,  the  traditional  approach  to  analyzing  parallel  algorithms  does  not 
take  into  consideration  the  cost  of  the  network  interconnecting  processors  to 
memories.  In  that  approach,  the  efficiency  of  a  parallel  algorithm  for  a  given  prob¬ 
lem  is  defined  as  the  ratio  of  the  running  time  of  the  fastest  sequential  algorithm 
for  that  problem  to  the  cost  of  the  parallel  algorithm.  Because  of  the  assianption 
that  a  RAM  can  simulate  a  PRAM  algorithm  in  no  more  time  than  the  cost  of  the 
latter,  the  efficiency  of  a  parallel  algorithm  is  at  most  1.  By  contrast,  we  refer  in 
this  paper  to  the  ratio  c’  (n)V- (n)  as  the  trse  efficiency  of  a  parallel  algorithm. 
*  »  | 

This  ratio  in  the  ease  of  A^  ad  Ap  is  Opt/Iug  ny.  which  is  huger  than  i.  In 

what  follows,  we  assume  that  the  circuit  of  (Ajtai)  is  used  to  implement  the  EREW 
PRAM.Le.d=2. 


In  an  attempt  to  resolve  this  paradox,  we  may  use  the  following  compromise:  we 
(explicitly)  assume  that  the  interconnection  network  is  part  of  the  RAM  and 
PRAM,  but  that  its  cost  in  both  models  is  0(1).  However,  this  solution  bads,  m 
turn,  to  a  result  not  unlike  the  one  reached  in  the  previous  section.  Using  an 
approach  developed  in  [Akl  21.  [AU  51.  and  [Akl  61.  we  show  in  IAkl  4J  that  a 
model  significantly  more  powerful  than  the  PRAM  can  be  obtained  by  extending 
the  latter  to  include  a  network  whose  cost  is  asymptotically  equal  to  that  required 
to  interconnect  processors  and  memory  locations  in  the  EREW  PRAM.  Assuming 
that  the  cost  of  that  network  (as  in  the  PRAM)  is  0(1).  we  obtain  solutions  to  a 
variety  ol  problems  whose  cost  is  smaller  than  that  of  the  best  xnuwn  PRAM  Sofu 

(ions. 

7.  CONCLUSION 


4.  EXAMPLE 

Consider  the  following  problem.  We  arc  given  n  distinct  integers  Ij.  L,.  _  In  in 

the  range  nj.  stored  in  an  array  X|lj.  A,2|.  _  X.n,  in  such  a  way  (hat  Xu,  - 

Ij  for  all  i  a>  i  i  n.  It  is  required  to  modify  X  so  ilia.  it  satisfies  tin.  following  con 

ditioo:  for  all  I  £  i  £  n.  X[Ijl  =  I(.  if  and  only  if  I  £  S  n.  otherwise  XfiJ  =  I  [Akl 
31. 

Sequentially,  the  problem  can  be  solved  at  the  RAM  in  the  obvious  way  in  time 
<s(n)  =  0(n).  and  this  is  optimal  Knee  every  entry  of  X  roust  be  examined  once. 

Consequently,  c  s<n >  =  Otn'  log  ny.  In  parallel,  yny  =  CH1»  on  a  PRAM  with  n 

processors.  Thus.  c'p(n)  =  Ofn  log"  n).  Il  follows  lhat  C^nVe’^fn)  =  OCrvlog  n) 

Note  Uni  simulating  the  PRaM  algorithm  on  (he  RAM  tests  to  an  algorithm 

whose  cost  is 

0(nj  x  (c'p(n)  x  log  ny = CHn*  log  n). 


From  the  above  discussion  we  conclude  that  the  PRAM  allows  for  a  synergistic 
phenomenon  to  occur.  This  phenomenon  manifests  itself  by  a  redaction  in  corofxr- 
rational  cost  (as  defined  in  this  paper)  for  a  wide  vareety  of  problems.  These  prob¬ 
lems  are  characterized  by  an  insounc  movement  of  data  frees  and  into  memory 
dining  the  course  ol  a  compulation.  On  the  RAM.  each  access  to  one  of  n  memory 
locations  requires  Oflog  n)  lime,  and  uses  an  interconnection  network  of  size  0(h). 
The  PRAM,  on  the  other  hand,  allows  access  to  e.7  n  menxxy  locations  srmultane- 
oosly  (also  0(!og  n)  time)  via  an  interconnection  network  of  size  0(n  log  n). 
end  net  0{n~).  Through  what  we  call  parallel  synergy,  a  PRAM  with  n  proces¬ 
sors  is  therefore  more  efficient  than  n  RAM*. 

This  result  has  a  number  o!  enphcaaons.  Our  week  was  engmaUy 
mutnated  by  the  observation  that  both  the  RAM  &&  the  PRAM,  as  theoretics! 
models  of  companion,  are  severely  lacking.  Indeed,  neither  model  takes  into 
account  the  cost  ol  such  a  fundamental  operation  as  memory  access.  By  defining 
the  abstract  model  mure  precisely  tu  include  all  important  ujrrraticcs.  net  only  dr 
we  get  a  more  realistic  and  meaningful  analysis,  bet  me  iso  uncover  t&bato 
unknown  phenomena.  Rally.  as  noted  above,  both  the  RAM  and  the  PRAM  are 
idealized  computers.  From  the  rcnctkal  point  of  view,  it  may  be  useful  to  cocxluct 
analyses  of  true  efficiency,  as  defined  in  this  paper,  for  real  conpctcrs. 


This  cost  is  larger  than  the  (optimal)  costs  of  both  the  RAM  and  PRAM  solutions. 
5.  GENERALIZATION' 

In  generaL  for  any  computational  problem  of  size  n.  e*s(n),'c’  (n)  >  1.  Lc.  (yn)  x 
n  log  nj /  (tpfn)  x n  tog'  ny>  t.  provided  that  y  n*y  n,  j  log o. *xj  the, number 

of  steps  where  a  READ  andor  a  WRITE  phase  is  executed  dominates  the  tempo- 
tation.  This  condition  is  satisfied  by  a  wide  family-  of  problems.  These  pohfems 
include  selection,  merging,  sorting,  and  a  variety  of  computations  in  numerical 
analysis,  graph  theory  and  computational  geometry  IAkl  I). 
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Abstract  We  introduce.-amew  relational-structure  s^man- 
tics  of  concurrent  systems  which  is  asgeneralisation  of  the 
causal  partial  order  semantics.  The  new  semantics  is  con¬ 
sistent  with  the  operational  behaviour  of  inhibitor  and 
priority  netsiexpressed  ia  terms  of  step  sequences.  It  em¬ 
ploys  combined  partiahorders  -  composets  (eacn  ccmposei  »s 
a  relational  structure-consisting  of  a  causal  partial  order  and 
a  weak  causal  partial  order;.  We  outline  the  way-in  which 
composets  can  be  generated  for  1-safe  inhibitor  nets. 

I.  INTRODUCTION 

In  the  development  of  mathematicall-models  for concurrent 
systems,  the  concepts  of  partial  and  total  order  undoubtedly 
occupy  a  central-position.  Interleaving  models  use  total  or¬ 
ders  of  event  occurrences,  while  so-called  ’true  concurrency* 
models  use  step-sequences  or  causal  partial  orders  (comp. 
[BD87;Ho85,Pr86j).  Even-more  complex  structures,  such  as 
failures  [Ho85]  or  event-structures. [Wi32j,. are-ih-principle 
based  on  the  concept  of  a  total  or  . partial  order.  While  inter 
’-eav  ings  and  step  sequences  usually  i  epresent  executions  or 
observations- and  can  be  regarded  us  directly  representing 
operational  behaviour  of  aconcucient  system,  the  causality- 
relation  represents  a  set  of  executions  or  observations.  The 
lack  of  ordering  between  two  event  occurrences  in  the  case  of 
a- step  sequence  is  interpreted  as  simultaneity,  while  in  the 
case  of  a  causality  relation  it  is  interpreted  as  independency, 
which  means  that  the  event  occurrences  can  be  executed  (ob¬ 
served)  in  either  order  or  simultaneously.  In  other  words,  a 
causal  partial  order  is  an- invariant  describing  an  abstract 
history  of  a  concurrent  system.  Both  interleaving  and  true 
concurrency  models  have  been  developed  to  a  high  degree  of 
sophistication  and  proved  to  be  successful  specification,  veri¬ 
fication  and  property  proving  tools.  However,  there  are  some 
problems,  for  instance  the  specification  of  priorities  using 
partial  orders  alone  is  rather  problematic  (see  [La85,  Ja87, 
JB88]).  Another  example  are  inhibitor  nets  (see  [Pe81]) 
which  are  virtually  oomired  by  practitioners,  and  almost 
completely  rejected  by  theoreticians,  in  our  opinion  mainly 
because  their  concurrent  behaviour  cannot  be  properly 
defined  in  terms  of  causality  based  structures.  We  think 
that-these  kind  of  problems  follows  from  the  general  as¬ 
sumption  that  all  behavioural  properties  of  a  concurrent 
system  can  be  adequately  modelled  in  terms  of  causal  par¬ 
tial  orders-or  causality-based  relations.  We  claim  that  the 
structure  of  concurrency  phenomena  is  richer  and  there  are 
other  invariants  which  can  represent  an  abstract  history  of 
a  concurrent  system.  In  this  paper  we  will  show  how  one  of 
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such  invariants  (tvea/e  causal-partial  order)  can  be  defined 
and  derived.  Our  main  result  will  be  the  definition  of  a  rcla 
honal  structure  semantics  for  inhibitor  nets  which  employs 
combined  partial  orders  composets  to  model  the  interrela¬ 
tionship  between  event  occurrences  involved  in  a  concurrent 
history  (each composet  is  a relational  structure  consisting  of 
a  causal  partial  order  and  a  weak  causal  partial  order).  The 
resulting  semantics  m„del  is  consistent  with  the  operational 
behaviourof  such  nets  expressed  in  terms  of  step  sequences. 
We  also  show  that  the  way  in  which  composets  can  be  gener¬ 
ated  is  a  direct  generalisation  of  the  procedure  used  to 
generate  causal  partial  orders.  The  results  of  this  paper  are 
directly  applicable  to  systems  with  priorities,  nets  with  in¬ 
hibitor  arcs,  bounded  nets,  and  virtually  any  system  model 
whichsupports  the  notion  of  true  concurrency  semantics. 

2.  MOTIVATION 

In  this,  section  we  present  an  example  which  we  believe 
clearly  identifies  an  inability  of  the  causal  partial  order 
(.CEO;  semantics  to  cope  propel  1>  with  some  important  a_ 
pects-of  non-sequentiai  behaviour.  We  will  use  Petri  nets 
[Pe3I,Re85]  to  illustrate  our  discussion. 

Our  example  closely  follows  the  discussion  in  [Ja87,JL88J. 
We  consider  a  concurrent  system  Con  comprising  two  se¬ 
quential  subsystems  A  and  B  such  that: 

(1)  A  can  execute  event  a  and  after  event  b. 

(2;  B  can  either  engage  in  event  b,  or  engage  in  event  c. 
(3;  The  two  sequential  subsystems  synchronise  by  means 
of  the  handshake  communication. 

(4;  The  specification  of  Con  includes  a  priority  constraint 
stating  that  whenever  it  is  possible  to  execute  event 
b,  then  event  c  must  not  be  executed. 

One  can  model  Con  as  the  Petri  net  Nprwr  in  Figure  1.  Be¬ 
fore  analysing  the  behaviour  of  N prior,  we  look  at  the  beha¬ 
viour  of  net  N,  where  N  is  Npnor  without  the  priority  con- 


Figure  1 
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straint.  The  operational  behaviour  of  N  can  be  captured  by 
the  set  of  step  sequences  it  generates, each  step  being  a  set  of 
events  executed  simultaneously,  as  follows: 

steps(N)  ={  {a},  {c},  {a}{6},  {a}{c},  {a,c},  {c}{a} }. 

Note  that  \  denotes  the  empty  step  sequence.  A  fundamen¬ 
tal  result  of  the  theory  ofcausal  partial  orders  now  says  that 
there  is  a  set  of  partially  ordered  sets,  posets(N),  such  that 

steps(N)  =  U  poZposets(N)  steps(po)  (2.1) 

where  steps(po)  is  the  set  of  all  step  sequences  consistent 
with  a  pcset  po.  Figure  2  shows  the  elements  of  posets(N) 
together  with  the  sets  steps(po),  Note  that  each  po(.posets(N) 
is  interpreted  as  a  causality  relationship  (an  invariant)  in¬ 
volving  event  occurrences,  and  is  intended  to  represent  an 
abstract  history  of  net  N.  The  consistency  between  the  oper¬ 
ational  and  invariant  semantics  captured  by  (2.1)  is  a  cor¬ 
nerstone  of  the  theory  of  causal  partial  orders. 

Having  looked  at  the  two- level  (i.e.  operational  and  invari¬ 
ant)  description  of  the  behaviour  of  N,  one  might  attempt  to 
repeat  the  same  construction  for  the  priority  net  Npr ,or.  It  is 
relatively  easy  to  obtain  the  operational  semantics  of  Npr;or. 
We  simply  delete  form  steps(N)  those  step  sequences  which 
are  inconsistent  with  the  priority  constraint.  As  the  result 
we  obtain: 

steps{Nprl0r)={  X,  {a},  {c>,  {a}{6|,  {a,c},  {c}{a} }. 

Note  that  we  deleted  {a}{c}  since  after  executing  a,  event  b 
becomes  enabled  and  thus  c  cannot  be  executed.  We  should 
now  be  able  to  find  a  set posets(Npr;or )  such  that 

Steps(N prior)  =  U  Poiposets{Nprwr)  steps(po).  (2.2) 

However,  any  attempt  at  finding  such  a  set  has  to  fail. 
Proposition  1 

There  exists  no  set  of  partially  ordered  sets  pusets(N pnor) 
such  that  (2.2)  holds.  □ 

This  leads  us  to  a  conclusion  that  it  is  impossible  to  con¬ 
struct  a  CPO  semantics  of  the  priority  net  Npn0r  which 
would  be  consistent  with  the  full  operational  behaviour  of 
that  net,  steps(Npn0r)-  In  order  to  develop  an  invariant  se¬ 
mantics  for  Nprior  which  would  be  consistent  with 
steps{N Prior)>  we  must  go  beyond  the  CPO-based  framework. 
In  the  rest  of  this  paper  we  will  show  that  there  is  a  rela¬ 
tional  structure  semantics  of  Npn0r,  called  combined  partial 
order  semantics  -  composets(Npnor )  -  such  that 

Steps(N prior)  =  co^composetsih  prtor)  steps(co).  (2.3) 

We  will  show  that  the  composet  semantics  is  a  generalisa¬ 
tion  of  the  CPO  semantics,  and  that  the  way  it  may  be 


derived-is  very  similar  to  that  used  to  derive  the  standard 
CPO  semantics.  We  finally  note  that  in  this  paper  by  a  par¬ 
tially  ordered  set  (poset)  we  mean  a  pair  (X,R)  such  that  X  is 
a  set,  and  RcXxX  is  irrefiexive  (->aPa)  and  transitive 
(aRb  A  bRc  =$  aRc). 

3.  AN  OUTLINEiOF THE  COMPOSET  MODEL 

In  this  and  the  following  sections  by  a  step  sequence  we  will 
mean  a  special  kind  of  labelled  partial  order  (for  which  the 
un-ordering  relation  is  transitive)  rather  than  a  sequence  of 
sets  of  events.  The  two  representations  are  isomorphic,  and 
the  translation  from  the  latter  to  the  former  is  illustrated  in 
Figure  3  (see  [Ja87]  for  details). 

If  we  look  closer  at  the  CPO  model,  it'  turns  out  that  an  ab¬ 
stract  history  H  of  a  concurrent  system  can  be  represented 
in  either  of  the  following  two  forms: 

(3.1)  On  the  invariant  level  -  as  a  poset  which  captures  the 
causality  relationship  between  the  event  occurrences 
involved  in  history  H. 

(3.2)  On  the  operational  level  -  as  a  set  of  step  sequences 
being  underlain  by  the  same  causal  relationship,  i.e., 
as  steps(po)  for  some  po  from  (3.1). 

In  additii  n,  we  have  some  properties  which  establish  the 
consistency  between  these  two  different  views  on  H. 

(3.3)  Each  poset  po  can  be  realised  on  the  operational  level, 
i.e.,  s)eps(po)*0. 

(3.4)  Each  poset  is  uniqely  identified  by  the  step  sequences 
which  are  consistent  with  it,  i.e.,  steps(po)  —  stepsipo') 
implies  po=po\ 

(3.5)  Each  poset  po  is  indeed  an  invariant,  i.e.,  a  precedes  6 
in  po  if  and  only  if  a  precedes  6  in  every  step  sequence 
in  steps(po). 

The  main  reason  why  posets  are  adequate  representations  of 
concurrent  histories  in  the  CPO  model  is  that  the  whole  ap¬ 
proach  is  founded  upon  the  following  assumption  concerning 
the  relative  order  of  two  event  occurrences,  a  and  b,  involved 
in  a  concurrent  history  H. 

(3.6)  The  existence  of  a  step  sequence  in  H  in  which  a  and  b 
occur  simultaneously  is  equivalent  to  the  existence  of 
two  step  sequences  in  H,  one  in  which  a  precedes  b, 
the  other  in  which  a  follows  b. 

From  (3.6)  it  follows  that  a  poset  can  be  an  adequate  rep¬ 
resentation  of  a  concurrent  history  H.  There  are  exactly 
three  possible  invariant  relationships  between  two  event  t\.- 
currences,  a  and  6,  involved  in  H. 


Figure  2 
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(3.7)  In  all  step  sequences  in  H,  a  precedes  b. 

(3.8)  In  all  step  sequences  in  H,  a  follows  b. 

(3.9)  There  are  cr/,02,  03  in  H  such  that:  a  precedes  b  in  a/; 
a  follows  b  in  02;  and  a  is  simultaneous  with  b  in  03. 

Then  (3.7)  and  (3.8)  can  be  represented  on  the  invariant 
level  by  having  a  and  6  ordered  in  an  appropriate  way  (a  and 
b  are  causally  dependent),  while  (3:9)  can  be  captured  by 
having  no  order  between  a  and  b  (a  and  b  are  independent). 

As  we  have  already  seen,  Nprior  does  not  satisfy  (3.6),  since 
{a,c}(. steps(N prior)  while  {a}{c}(steps{Nprior).  More  precisely, 
the  left-to-right  part  of  (3.6)  may  fail  to  hold  in  systems  like 
Nprior,  while  the  right-to-left  implication  still  holds.  In 
[JK90]  and  [JK91]  it  has  been  shown  that  this  implies  that 
on  the  invariant  level  the  partial  orders  have  to  be  replaced 
by  more  complex  relational  structures,  which  we  will  call 
combined  partial  orders  (or  composets).  A  composet  is  a  rela¬ 
tional  structure  (see  [C08I])  co =(£,-.,/)  such  that  (2,->)  is 
the  standard  causality  invariant,  and  (2,/*)  is  a  weak  cau¬ 
sality  invariant.  The  weak  causality  essentially  means  that 
if  a/b  then  in  all  step  sequences  consistent  with  co,  a 
precedes  or  is  simultaneous  with  b.  In  this  way  it  is  possible 
to  capture  three  additional  invariant  relationships  between 
two  event  occurrences  involved  in  a  concurrent  history: 

(3.10)  In  all  a  in  IT,  a  is  simultaneous  with  b. 

(3.11)  There  are  step  sequences  in  H,  0/  and  02,  such  that:  a 
precedes  b  in  a/;  a  is  simultaneous  with  b  in  02;  and 
there  is  no  step  sequence  in  H  in  which  a  follows  6. 

(3.12)  There  are  step  sequences  in  H,  0/  and  02,  such  that:  a 
follows  6  in  o;,  a  is  simultaneous  with  b  in  02;  and 
there  is  no  step  sequence  in  IT  in  which  a  precedes  b. 

Indeed,  (3.1  lj  and  (3.12)  can  be  represented  on  the  invariant 
level  by  saying  that  a  and  b  are  weakly  ordered  in  an  appro¬ 
priate  way  but  not  causally  ordered,  and  (3.10)  can  be  cap¬ 
tured  by  having  both  weak  causal  orders  between  a  and  b  ( a 
and  6  are  synchronised). 

Having  extended  the  posets  to  composets  one  can  define  the 
set  of  step  sequences  consistent  with  a  composet  co,  steps(co), 
and  prove  that  (2.3)  holds  for  a  suitably  defined  set  of  compo¬ 
sets  of  Npri0r  (see  the  Section  5).  In  this  way  the  CPO  ap¬ 
proach  which  has  proven  to  be  so  fruitful  for  systems  satis¬ 
fying  (3.6)  can  be  extended  to  concurrent  systems  for  which 
(3.6)  may  not  hold.  For  a  detailed  discussion  and,  in  particu¬ 
lar,  the  proof  that  composet  is  an  adequate  notion  of  history 
invariant  for  systems  which  may  not  satisfy  the  left-to-right 
implication  in  (3.6)  but  satisfy  the^right-to-left  implication, 
the  reader  is  advised  to  refer  to  (JK90]  and  (JK91). 

4.  THE  MODEL 

We  define  a  composet  (or  combined  partially  ordered  set)  as  a 
relational  structure  (see  [C08I])  co  --  (X,->,/)  such  that  2  is 
a  finite  set  of  event  occurrences  and  /  are  relations  on  2 
satisfying  the  following. 

1.  ~'a/a 

2.  a/b  =>  ->b-*a 

3.  a-*b=$a/b 


4.  a/b  AbZc=$a=c\/  a/c 

5.  a/b  A  b-*c  =>  a-*c 

6.  a-*bAb/c=$a-*c. 

Corollary  2 

(2,->)  is  a  partially  ordered  set,  while  (2,/)  is  arpre-ordered 
set.  □ 

The  two  relations  constituting  a  composet  can  be  derived  as 
invariants  of  a  set  of  step  sequences  with  the  same  domain. 
Proposition  3 

Let~A  be  a  non-empty  set  of  step  sequences  with  a  common 
domain  2.  Let ->4  and  Zp  be  two  relations  on  2  defined  by 
a-+Ab  :£>Vo6 A.  a-*0b 
and  a/&b  :&\/o£&.a-*0b\/a*-*0b 
where  a->0b  and  a<-+06  respectively  means  that  a  precedes  b 
and  a  is  simultaneous  with  6  in  0. 

Then  co=(Z,,-*a,/a)  isacompose ...  □ 

I.e.,  a  composet  can  in  a  natural  way.be  derived  as  an  invari¬ 
ant  of  a  set  of  step  sequences.  To  show  that  a  composet  is  an 
adequate  invariant  representation  we  need  another  result. 

Let  co=(2,->,/')  be  a  composet.  The  set  of  step  sequences 
consistent  with  co,  steps(co),  comprises  ail  step  sequences  o 
with  the  domain  2  satisfying  the  following. 

1.  a-*b  =>  a-*0b 

2.  a/b  =>  a-*0b  V  a«-»06. 

Then  the  adequacy  of  the  composet  notion  follows  from  the 
following  result  (comp.  (3.5)). 

Theorem4 

If  co  is  a  composet  and  A  =steps{co)  then  co  ~(2  ,-*a,Za)  □ 

The  next  result  is  a  direct  generalisation  of  the  properties  of 
the  CPO  model  captured  by  (3.3)  and  (3.4). 

Theorem  5 

1.  For  every  composet  co,  steps{co)  *  0. 

2.  If  stepsico) — stepsico  )  then  co — co '.  □ 

The  composets  together  with  the  steps  operation  can  provide 
an  invariant  model  in  exactly  the  same  way  as  the  causal 
partial  orders.  To  show  that  the  new  model  overcomes  the 
shortcomings  of  the  CPO  model,  we  now  have  the  following. 
Proposition  6 

There  is  a  set  of  composets,  composets(N prior) ,  such  that  (2.3) 
holds.  □ 

In  this  way  we  have  solved  the  problem  from  Section  2,  i  e., 
we  have  found  an  invariant  semantics  of  Npn0r  which  in  a 
direct  way  generalises  the  CPO  semantics  (note  that  each 
poset  (2,->)  is  isomorphic  to  the  composet  (2, ^» ,-»)),  and  is 
consistent  with  the  full  operational  semantics  of  Apr,-or. 
Note  that  the  abstract  histories  of  Nprior  may  be  represented 
either  as  composets  or  as  sets  of  step  sequences  which  are 
consistent  with  those  composets. 

There  is  a  certain  similarity  between  our  definition  of  the 
composet  and  the  axioms  for  strong  and  weak  precedence  re¬ 
lation  presented  in  [La86].  However,  the  way  these  two  con¬ 
cepts  are  derived,  the  motivations,  and  the  reasons  for  their 
introduction  are  quite  different.  Hence  this  similarity  is 
either  accidental  or,  as  we  would  suggest,  the  composet  is  a 
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natural  generalisation  ofthe  concept  of  the  partial  order, 
and  it  may  be  useful  for  various,  perhaps  unrelated,  applica¬ 
tions. 

5.  THE  CONSTRUCTION  OP  COMPOSETS 
In  this  section  we  outline  an  algorithm  for  constructing  the 
set  of  composets  of  a  concurrent  system.  Since  in  our  con- 
structionswe  can  use  a  number  of  notions  which  have  been 
developed  for  ordinary  Petri  nets,  we  will  show  the  construc¬ 
tion  for  1-safe  inhibitor  nets[Pe81].  Note  that  1-safeness 
means  that  each  place  may:  hold  at  most  one  token,  and  an 
inhibitor  net  is  a  Petri  net  with  added  inhibitor  arcs.  An  in¬ 
hibitor  arc  between  place  p  and  transition  (event)  t  means 
that  t  can  be  enabled  only  if  p  is  not  marked.  In  the  diagrams 
an  inhibitor  arc  is  identified  by  a  small  circle  at  one  end. 

The  standard  approach  in  which  the  CPO  semantics  for  ordi 
nary  1-safe  Petri  nets  is  derived  employs  occurrence  nets  (see 
[Re85,  BD87]).  An  occurrence  net  is  a  representation  of  the 
causality  relation  on  event  occurrences  (or  single  abstract 
history  ofthe  net).  It  is  ah  unmarked  acyclic  net  whose  each 
place  has:at  most  one  input  and  one  output. transition.  Oc¬ 
currence  nets  can  be  obtained  by  unfolding  marked  nets  and 
resolving.the  conflicts  according  to  the  the  firing  rules.  This 
is  illustrated  in  Figure  4(a,b).  Each  occurrence  net  induces  a 
poset  on  event  occurrences  in  the  following  way:  First  an  au¬ 
xiliary  relation  ->aux  is  derived  by  transforming  each  three- 
node  path  eventl-*place-*event2  in  the  graph  of  the  occur 
rence  net  into  a  pair  eventl-*auxevent2.  Then  a  CPO  is  ob¬ 
tained  by,  taking  the  transitive  closure  of  - *aux ■  For  the  oc¬ 
currence  net  of  Figure  4(b),  the  auxiliary  relation  -*aux  is 


Figure  4 
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shown  in  Figure  4(c),  and  the  resulting  causal  partial  order 
is  shown  in  Figure  4(d). 

The  way  in  which  we  construct  composets  for  an  inhibitor 
net  will  closely  follow  the  above  procedure.  Let  IV/ be  the  in¬ 
hibitor  net  shown  in  Figure  5.  We  first  define  an  occurrence 
net  of  an  inhibitor  net  by  generalising  in  a  straightforward 
way  the  standard  definition  of  an  occurrence  net  of  an  ordi¬ 
nary  Petri  net.  The  only  new  element  is  the  handling  of  the 
inhibitor  arcs.iSince  in  the  occurrence  net  places  represent 
tokens,  it  is  not  possible  to  join  c  with  place  2  using  an  in¬ 
hibitor  arc.  However,  we  can  join  c  with  the  complement 
place  [Re85]  of  2,  i.e.  place  5,  using  an  activator  arc  (with  a 
black  dot  at  one  end).  Intuitively,  this  means  that  c  can  be 
executed  only  when  5  is  marked.  We  also  note  that  there  is 
no  restriction  on  the  number  of  activator  arcs  which  can  be 
adjacent  to  a  single  place.  A  possible  occurrence  net  for  the 
inhibitor  net  N/  is  shown  in  Figure  6. 

The  next  step  is  to  transform  the  structural  relationships 
embedded  in  the  graph  of  the  occurrence  net  into  two  auxil¬ 
iary  relations,  -><,„*  and  Saux,  from  which  the  composet  can 
be  derived.  There  are  three  structural  relationships  between 
event  occurrences  which  we  need  to  consider,  as  shown  in 
Figure  7.  For  the  occurrence  net  of  Figure  6  the  two  auxil¬ 
iary  relations  are  shown  in  Figure  8(a).The  final  step  has  to 
take  into  account  the  various  transitivities  from  the  defini¬ 
tion  of  a  composet.  More  precisely,  if  -*aux  and  / aux  have 
been  defined  for  an  occurrence  net  ON  with  2  being  the  set 
of  event  occurrences,  then  the  composet  induced  by  ON,  is 
defined  as  co(  ON) = (2, -*■,/),  where  (S,-*,/)  is  a-minimal 
composet  (w.r.t.  set  inclusion  for  both  -»  and  z')  such  that 


Figure  6 
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Figure  7 

a-*auxb  =>  a-*b  anda/,aitx6  =>  a/ b.  For  the  occurrence  net 
of  Figure  6,  the  resulting  -*■  and  /  are  shown  in  Figure  8(b). 
We  also  note  that  in  this  case 

steps{cc(ON))—{  {c}(a,c}{5},  {c}{c}{a}{6}  }. 

For  every  inhibitor  net  IN,  let  ON{IN)  be  the  set  of  its  occur¬ 
rence  nets.  We  define  the  invariant  semantics  of  /Af  as  fol¬ 
lows:  composets(IN )  -=  {co(ON)  |  ON£  ON(IN)}. 

Theorem  7 

steps{IN) — Uco icomposetsUN)  steps[co).  Q 
I.e.,  there  exists  an  invariant  semantics  for  inhibitor  nets 
which  is  consistent  with  their  operational  semantics.  We 
strongly  emphasise  that  it  is  not  possible  to  define  a  CPO  se¬ 
mantics  for  the  inhibitor  net  in  Figure  5,  which  would  satis¬ 
fy  the  same  consistency  criterion.  The  reason  is  that  we  have 
{a,c}€s£eps(N/)  while  {a}{c}€steps(A//).  The  construction  of 
the  relational  structure  semantics  for  inhibitor  nets  out¬ 
lined  in  this  section  gives  indirectly  the  relational  structure 
semantics  for  Npnor,  since  each  1-safe  priority  net  can  be 
transformed  into  an  operationally  equivalent  inhibitor  net. 
For  N prior  an  equivalent  inhibitor  net  can  be  obtained  from 
that  in  Figure  5  by  deleting  the  arc  joining  c  and  4.  The  con 
struction  described  in  this  section  can  be  extended  to  other 
kinds  of  nets  and  priority  models  (see  [  JL88]).  A  bridge  join¬ 
ing  the  net-based  model  with  other  models  for  concurrency 
could  be  provided  by  [Ta89]. 

Final  Comments 

We  believe  that  in  order  to  cope  properly  with  general  con¬ 
current  behaviours  one  should  not  restrict  ones  concerns 
only  to  structures  based  on  causal  partial  orders.  The  compo- 
sets  (i.e.  causality  and  weakicausality)  can  provide  an  in¬ 
variant  semantics  for  priority  systems  and  inhibitor  nets. 
Although  both  priority  nets  and  inhibitor  nets  have  the 
power  of  Turing  machines  as  far  as  their  interleaving  se¬ 
mantics  is  concerned  ([Pe81]),  one  may  show  that  their  com 
poset  semantics  are  different  (there  are  composets  which  can 
be  generated  by  inhibitor  nets  but  not  by  priority  nets).  By 
combining  the  above  approach  with  the  results  of  [Ja87, 
JL88]  we  can  obtain  a  model  successfully  dealing  with 
priority  systems,  as  for  instance  the  full  occam  programm- 


aux 

(a)  (6) 

Figure  8 


ing  language  (see  example  [Ro84]).  For  more  details  con¬ 
cerning  the  approach  presented  here,  the  reader  is  advised 
to  refer  to  [JK90]  and  [JK91]. 
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MINIMAL  STATE  CELLULAR  SEGMENT  GENERATION. 
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60-965  Poznart,  Poland 


Abstract .  A  5-state  solution  of  the  problem 
of  generating  the  stable  segment  of  length  L 
with  1-D  scope-3  cellular  automaton  is  pre¬ 
sented.  L  is  represented  by  the  initial  con¬ 
figuration  in  binary  form  of  some  poly¬ 
nomial  R(.L) .  Here  L  >  0  and  simply  R(L)  =  L. 
Carry-free  counter  with  states  in  RNS  form 
and  two  waves  transmitting  the  information 
were  used  in  the  solution.  The  generation 
needs  T  =  2L  +  3  steps  of  time.  Further,  it 
is  shown  how  R(L)  is  related  to  the  speed  of 
the  front  wave.  A  comparison  of  some 
solutions  is  also  given. 


I.  INTRODUCTION. 


We  focuse  here  on  generating  a  stable  1-D 
final  pattern,  called  the  segment  and  compos¬ 
ed  of  L  consecutive  states  x  starting  from  an 
initial  configuration  which  contains  certain 
encoded  information  about  L.  The  problem  is 
to  design  a  minimal  state  ID  scope-3  cellular 
automaton  (C/1)  capable  to  realize  such  trans¬ 
formation.  This  will  be  reffered  to  as  CSG 
(cellular  segment  generation)  problem.  The 
problem  was  posed  and  partially  solved  in 
1975  [1].  The  immediate  application  of  the 
CSG  arise  in  VLSI  circuits  when  L  is  assumed 
In  its  binary  form;  then  the  CSG  actually 
performs  highly  regular  parali-.  1  conversion 
of  binary  number  L  to  its  unary  form. 

An  effort  was  undertaken  on  looking  for 
the  minimal  state  space  in  parallel  produc¬ 
tion  systems,  especially  in  2-D  and  1-D  CAs. 
In  2-D  the  29-state  scope-5  CA  was  first  used 
by  von  Neumann.  Soon,  a  system  capable  of 
universal  computation  has  been  improved  and  a 
4-state  solution  has  been  given  (5) .  Also, 
Conway's  2-state  scope-9  cellular  "game  of 
life"  was  shown  to  be  universal.  Recently,  a 
3-state  scope-5  universal  CA  was  proposed 
(6).  In  1-D  the  'simple'  computation-univer¬ 
sal  CAs  have  been  recognized  quite  early.  An 
18-state  scope-3  CA  was  proved  (7)  to  belong 
to  that  class.  In  order  to  implement  prac¬ 
tically  the  embedding  of  computations  in  C/1s 
some  other  problems  are  under  research,  too. 
The  techniques  intented  to  synchronize 

various  events  in  1-D  CAs  were  mastered,  as 
well  (4):  an  8-state  scope-3  and  a  17-state 
scope-3  CAs  for  a  firing  squad  problems  were 
proposed  (4) .  Also  a  medium  for  performing 
computations,  namely  1-D  2-state  scope-(2r+l) 
filter  automata,  a  modification  of  CA  model, 
was  proposed  [8] ,  and  even  its  VLSI 

implementation  given. 

The  CAs  capable  of  generating  certain 
particular  patterns  are  extensively  searched 
for.  Many  configurations  called  "primitive 
elements",  "basic  organs'  or  "general-purpose 
components"  were  successfuly  created  to  sup¬ 
port  simple  computations.  This  effort  is 
mainly  motivated  by  expected  VLSI  implementa¬ 
tions  and  applications;  in  computer  graphics, 
code  number  conve'-sion,  random  numbers  (3) 


and  possibly  in  VLSI  layout  generation. 

There  are  two  solutions  [2)  for  the  CSG 
problem  since  1985.  One,  with  7-state  cell, 
generates  segments  of  length  L  >  1  in  eime  T 
=  3L  +  r  -  2,  when  initialized  from  configu¬ 
ration  given  by  r-digit  binary  form  of  R(L)  = 
2(L  -  1).  The  other,  based  on  6-state  cell, 
valid  for  L  >  2,  completes  generation  in  I  = 
3 (i.  -  1)  steps  and  requires  initial  configura 
tion  to  be  given  by  R(L)  =  2(L  -2)  in  binary. 


II.  FORMAL  DESCRIPTION  OF  THE  CSG  PROBLEM. 


Let  CA  =  (C,p,A)  denote  a  cellular  automa¬ 
ton,  where  C  =  (e£)  is  a  set  of  cells,  p:  C 

— >  Cp  is  a  neighborhood  function  and  A:  Sp  — » 
S  is  a  local  function  of  CA.  The  natural  num¬ 
ber  p  >  1  determines  what  is  called  a  scope 
(index)  of  neighborhood. 

By  a  cell  c  =  (S.S^^.A)  the  finite  auto¬ 
maton  is  meant  such  that  S  is  its  finite, 

o—l 

nonempty  state  set,  denotes  its  input 

alphabet  and  A  is  its  transition  function. 

Only  1-D  CAs  are  considered  here,  so  the 
cells  c£  e  C  are  ordered  according  to  their 

position  £  c  Z;  Z  is  the  set  of  integers. 
We  assume  in  the  paper  that  p  =  3. 

Consequently  for  each  t  <=  2  we  have  p(c£)  = 

(c£_1,c£ ,c£+1)  with  left  and  right  neighbors. 

The  input  alphabet  Sp  *  of  c£  is  determined 

by  the  states  of  its  neighbors. 

Any  4-tuple  ( a.b.c.d )  of  elements  from  S 
for  given  CA.  such  that  A(a,6,c)  =  d  will  be 
called  the  elementary  rule  (ER)  of  CA  and 
will  be  denoted  by  abc/d ■  here  the  term 
"production"  was  also  in  use  (41 .  The  local 
function  A  of  CA  may  be  described  then  by  the 

set  of  all  its  ERs.  A  state  denoted  by  . 

will  be  called  the  quiescent  state  with  a 
property  that  is  the  ER  of  CA .  A  con¬ 

figuration  of  CA  =  (C,p, A)  is  defined  as  the 

r 

function  /.  C  — >  S,  so  S  denotes  the  set  of 
all  configurations.  Then,  /(p(c))  is  the 
state  of  neighborhood  of  given  cell  c.  The 
configuration  /  is  called  finite  if  and  only 
if  /(c£)  =  •  for  all  but  finitely  many  i’s. 

We  shall  represent  finite  configurations 
£ 

as  follows,  if  /  e  S  is  such  that  for  some  i 
the  equality  "  holds  for  all  j'  <  0 

and  for  all  j  >  k  -  1  then  /  will  be  denoted 
by  ■■■w--  where  u »  *•  /(«t) . .  ./.(c£+fc-1)  and  h 

>  0.  The  configuration  /  will  be  said  to  have 
the  length  A  and  to  occur  at  the  position  i. 

Suppose  now  that  binary  digits  0  and  1  are 
in  state  set  5.  Let  R(L)  =  aL  +  b  be  a  linear 
polynomial  with  R{L)  >  0  for  all  integers  L  > 
0.  Assume  some  L  >  0  and  u>  =  (R(L))2,  where 

the  binary  form  of  R(L)  has  r  digits  with  1 
as  the  leftmost  digit.  Then  the  configuration 
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— w ■ •  will  be  called  either  the  simple 
representation  of  1  (if  a  =  1  and  i>  =  0)  or 

the  encoded  representation  of  1,  otherwise. 

Let  x  *1  S  and  let  ■  ■  ■  (x)L ■  ■  •  denotes  a 
configuration  of  1  consecut-ive  cells,  all 
occuring  in  state  x.  It  wild  be  called  the 
segment  of  length  1.  C  C 

By  global  transition  function  y.  S  — r->  S 
of  CA  such  a  function  is  understood  that  r (/) 
=  e  implies  r (/(c£) )  =  X (f(v (e£ ) ) )  =  g(c£) 

for  all  t  e  Z.  If  rlf)  then  we  say  that 

CA  passes  from  /to  g. 

Let  /q  =  •■•»•••  be  some  representation  of 

given  integer  L  >0.  If  CA  with  global 
transition  function  y  Fasses  from  given 
initial  /n  to  the  final  stable  configuration 

'  (x)  '  •  •  in  a  such  way  that: 

y(/0)  =  ix.  r(f1)  =  /2 .  ^(/r_i)  =  fT 

where  /£_1  *  /£  for  all  i  =  1,  2 .  T, 

then  we  say  that  C/l  generates  the  segment  of 
length  1.  T  is  the  time  of  CSG  process. 

Now  we  can  state  the  CSG  problem:  one 
might  determine  'simple'  CA  =  (C ,v ,>.)  capable 
to  generate  segments  for  any  given  length  1  > 
0.  Since  p  =  3  has  been  chosen,  then  £  and  X 
rest  to  be  searched  for  in  the  problem. 


III.  SOLUTION. 


Tne  solution  presented  here  for  the  CSG 
behaviour  assumes  two  levels  of  organization. 
On  the  higher  level  two  groups  of  cells  are 
distinguished  in  transient  configurations, 
namely  a  counter  and  a  sphere  of  two  waves. 
Initial  state  of  the  counter  is  determined  by 
R(l) .  During  generation  process  the  states  of 
counter  are  decremented  until  the  zero  state 
is  reached.  The  role  of  counter  is  to  control 
the  waves.  The  emmision  of  waves  occurs 
twice,  at  the  beginning  with  the  speed  v,  and 
at  the  end  of  counting  with  the  speed  1/1,  to 
assure  that  the  waves  can  meet.  Vie  have. 

Theorem  1 .  Let  there  be  given  CA  -  a 
solution  of  the  CSG  problem  with  a  counter 
and  two  waves  distinguished:  a  front  one  of 
speed  v  and  a  final  one  of  speed  1/1.  Let  the 
representation  of  number  L  is  determined  by 
R(L).  Then:  T  =  1/v  and  K(l)  =  1( l-v)/v. 

Proof,  Is  not  presented  here. 

The  lower  level  of  organization  (still 
above  X)  with  a  set  of  13  smaller  components 
was  also  used  in  order  to  systematize 
computer  aided  searching  of  the  solution.  It 
is  not  explained  here. 

A  number  of  5-state  solutions  have  been 
found.  One  of  them  is  given  in  Table  I.  In 
Fig-  1 .  some  parallelograms  are  shown;  rows 
are  shifted  to  have  all  counters  synchroniz¬ 
ed.  Following  the  general  idea  of  solution 
the  counter  states  are  represented  in 
transient  configurations  by  RN3  form.  Thus 


TABLE  1.  Function  X  for  our  solution  (h  =  73). 
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Eig.l.  Parallelograms  of  the  CSG  processes. 


the  counter  state  number  is  created  by  either 
adding  (symbol  1)  or  subtracting  (symbol  +) 
the  proper  weights  according  to  i . 

Analysing  the  roles  of  all  states  in  the 
frame  of  assumed  idea  for  solution  we  may 
conclude  its  minimality. 

Theorem- 2.  Assume  a  solution  of  the  CSG 
problem  as  previously.  Then  a  5-state 
solution  is  the  minimum  state  one. 

Proof.  Is  not  presented  here. 

In  Table  2  we  show  some  comlpexity  factors 
of  found  CA;  Q  is  a  number  of  cells  involved, 
h  -  a  number  of  ERs  and  1 (X)  =  1-h/hmax  de¬ 
termines  a  logical  circuit  spare  of  X. 


TABLE  2.  A  comparison  of  some  solutions. 
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COMPUTING  HOMOMORPHISMS  OF  LABELLED  DIRECTED  GRAPHS 
IN  PARALLEL  USING  HYPERCUBE  MULTIPROCESSORS 
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Southeastern  Massachusetts  University 
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Abstract  -This  paper  deals  with  computing  of  vertex-edge 
humoinorphisms  of  deterministic  labelled  directed  graphs  in  parallel. 

A  new  algorithm  is  presented  and  ns  time  computational  complexity 
is  evaluated.  A  decomposition  of  a  graph  with  respect  to  different 
labels  is  used.  Number  of  processors  required  during  various  stages 
of  the  algorithm  is  assessed. 

I.  INTRODUCTION 

Traditionally,  time  and  memory  were  the  only  resources  considered 
when  the  computational  complexity  ot  an  algorithm  had  to  be 
evaluated.  The  architecture  of  the  computing  machine  was  a  single 
processor  sequentially  addressing  the  memory  ceils.  This  was  a 
reasonable  model  as  long  as  processors  are  much  more  expensive 
than  storage  space.  Recent  developments  in  VLSI  technology 
substantially  reduced  the  processor-to-memory  cost  ratio,  in  this 
technology  the  cost  of  each  feature  is  proportional  to  the  area  it 
consumes  on  the  silicon  wafer,  and  processors  and  memory  ceils 
have  area  of  comparable  sue.  The  tradeoff  between  time  and  memory 
is  extended  to  a  tittv.  hardware  tradeoff,  where  the  hardware  is  a 
combination  of  processors  and  memory.  Another  justification  for 
introducing  parallelism  has  even  deeper  rer  .on  than  technological 
innovations.  We  notice  that  thc.rcmedy  which  sheltered  the  length  of 
computation  time,  required  by  the  sequential  algorithm,  was  the 
introduction  of  parallelism.  Clearly,  every  search  problem  is 
amenable  to  a  single  time-hardware  tradeoff  of  the  to»-n  HJ-N. 
Simply  partition  ihe  A  points  of  the  search  space  .mo  tt  equal 
subsets,  and  assign  a  processor  to  search  over  the  T=/V///  points  of 
each  subset.  So,  if  parallelism  is  essential  in  overcoming  some 
fundamental  limitations  of  sequential  algorithms,  n  is  woi inwhile  to 
explore  better  ways  of  exploiting  a  multiprocessor  system. 

In  parallel  computations  wc  have  four  major  stages  of  algorithm 
development: 

(!)  choose  the  algorithm  indicating  the  elementary  computations  and 
their  interdependence 

(ii)  choose  a  particular  multiprocessor  architecture 
(ill)  find  a  schedule  whereby  .he  algorithm  is  executed  on  .he 
processors  (  so  that  a!!  necCssary  data  are  j.uilubL  at  .he  appropru.c 
processor  at  the  time  of  each  computation ) 

(h )  evaluate  performance  of  the  algorithm,  measured  as  the 
makespan  of  the  schedule. 

In  attacking  various  problem.,,  i«o  approaches  seen,  mutual  me 
more  practical  approach  is  to  insist  on  a  polynomial  bom.d  on  the 
number  of  processors,  and  then  try  to  obtain  the  best  mne,  perhaps 
themore  theoretical  approach  is  to  insist  on  a  pciylog  bound  or.  the 
time,  and  then  try  to  obtain  the  best  processor  count. 

By  an  efficient  parallel  algorithm  we  mean  one  that  takes 
polylogarithmic  time  using  a  polynomial  number  of  processors,  in 
practical  terms,  at  most  a  polynomial  number  oi_  processors  .s 
reckoned  to  be  feasible.  A  polylog.inihniic  time  u.guw.mn 
O(logk  n)  parallel  time  foi  some  constant  integer  k,  where  u  i'  the 
problem  size.  Problems  which  can  be  solved  within  these  constraints 
arc  universally  regarded  as  having  efficient  parallel  solutions  and  are 
said  to  belong  to  the  class  NC.  .  . 

A  subclass  of  problems  of  particular  interest  arc  those  which  nave 
optimal  parallel  algorithms.  An  optimal  parallel  algorithm  is  an 
algorithm  for  which  the  product  of  the  parallel  time  t  with  the 
number  of  processors  p  used  is  linear  in  the  problem  size  n  Hiatts, 
pt-Vini.  Upumamy  may  also  mean  that  the  product  pi  is  cqu.u  to  me 
computation  time  or  the  lastest  known  sequential-lime  algorithm  101 
the  problem.  We  specifically  refer  to  the  problem  as  having  optimal 

SPFor  any  problem  for  which  there  is  no  knowr  polynomial-time 
sequential  algorithm,  for  instance,  any  NP  complete  problem  we 
cannot  expect  to  find  an  efficient  parallel  solution  using  a  polynomial 
number  of  processors.  However,  wc  might  wish  to  find  such  a 
parallel  solution  for  a  problem  with  a  polynomial-time  sequential 


algorithm,  i.c.  a  problem  in  class  P .  2  ->erc  are,  however,  many  such 
problems  which  do  not  seem  to  admit  parallelisation  readily.  These 
problems, which  we  refer  to  as  being  hardly  purallelizablc,  form  the 
class  of  P  complete  problems  If  an  efficient  parallel  solution  for  any 
P  complete  problem  could  be  found  then  :  similar. solution  would 
exist  for  any  other.  There  is  no  proof,  but  a  great  deal  of 
circumstantial  evidence,  that  classes  P  and  NC  differ. 

Ail  known  sequential  algorithms  for  NP-complete  problems  run  in 
exponential  time,  and  all  known  parallel  algorithms  have  exponential 
cost  For  these  problems  three  general  solutions  are  in  place,  fast 
approximation  algorithms,  good  probabilistic  algorithms,  and  parallel 
approximation  algorithms. 

N’P  completeness  of  the  automata  homomorphism  problem  follows 
from  considerations  presented  in  Levin,  Gurey -Johnson,  and 
Mikolajczak  [3,6,8],  and  polynomial  reducibility  is  from  GRAPH  K- 
COLORABIL1TY.  All  concepts  not  defined  in  this  paper  are  taken 
from  Mikolajczak  [10]  We  assume  .hat  u  concept  of  homomorphism 
discussed  here  includes  transformation^  both  on  vertices  (states)  <md 
edges  (inputs)  Such  homomorphism  is  said  to  be  the  generalized 
homomorphism. 

II.  PARALLEL  ALGORITHM 

In  this  what  follows  we  will  apply  the  following  assumptions. 

(!)  The  available  lumber  of  processors  .s  adequate  for  dealing  with 
Ac  whole  widtn  of  the  directed  acyclic  graph  (dag)  which  represents 
the  algorithm  (thus  the  number  of  processors  involved  is  no  longer  a 
parameter). 

(ii)  A  communication  delay  t  between  the  time  when  some 
information  is  produced  at  a  processor  and  the  time  it  can  be  used  by 

another  processor  is  measured  in  elementary  steps  of  the  processors 
tor  nodes  of  the  dag),  t  is  u  parameter  of  the  architecture. 

(Hi)  The  optimum  makespan  of  the  scheduling  problem,  being  a 
function  of  t,  is  a  fair  measure  of  the  parallel  complexity  of  the  dag, 
the  scheduling  problem  is  NP-complete. 

(iv)  We  assume  as  a  model  of  parallel  computations  the  shared 
memory  computer,  in  which  a  number  of  processors  work  together 
synchronously  and  communicate  with  a  common  random  access 
memory,  in  the  event  of  read  or  wnte  conflicts  in  this  shared  memory 
wc  assume  that  both  conflicts  are  .mowed,  and  the  lowest  numbered 
processor  succeeds  in  the  case  of  a  write  conflict. 

In  our  approach  we  apply  a  decomposition  of  domain  and  range  of 
directed  labelled  graphs  with  respect  to  different  labels.  There  exists 
also  a  second  possibility  to  decompose  directed  labelled  graphs  into 
primaries  (see  Bavcl  [1]).  Unfortunately,  in  the  second  case  a 
decomposition  of  a  graph  is  not  a  part, tion  but  a  .  over  on  a  set  of 
vertices,  this  makes  load  balancing  more  difficult  (dynamic  load 
balancing). 

In  algorithm  description  we  apply  the  following  notation. 
nA-IS  A!,  nQ-iSgl  number  of  vertices  (states)  of  graph  A  and  B, 

m,v=l£Al,  mg=ll[jl  -  number  of  different  labels  (inputs)  of  graph  A 
and  B,  n-number  of  processors,  Aj=(SA,£A,i>J>A,i)' 
BjKSb.Tb.jvSbj)'  autonomous  labelled  directed  graphs  A  and  B, 
respectively,  where  l<=t<=mA,  l<=j<=mB,  Sa.i  and  8b, j  are 
transition  functions  of  graph  A  and  B,  respectively. 

SIMP  parallel  nlt’oriUim  comnutinp  a  set  of  generalized. 
homoniornhisnis  between  deterministic  complete  labelled 
directed  graphs 

Inniil:  Deterministic  complete  labelled  directed  graph  A=(Sa,£a,5a) 

and  B=(Sb,Ib,5b)  with  disjoint  vertex  sets  and  edge  sets. 

Output:  Set  of  all  generalized  homomorphisms  from  A  to  B  denoted 
as  GHom  (A.B),  i.c.  set  of  state-input  homomorphisms  with 
transformations  on  set  of  vertices  and  on  input  semigroups. 
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Step  1:  Decompose  dcte-ministic  complete  labelled  graphs  A  and  B 
into  inA  arid  :V»jj  autonomous-factors,  respectively;  allocate  these 
autonomous  Factors  to  mA+mB  SIMD  processors. 

Step  2:  Fcr  each  autonomous  factors  of  A;  and  Bj,  respectively, 
compute  in  parallel  a  set  of  all  a;  connected  components  of  A;,  and 
a  set  of  all  bj  connected  components  of  Bj. 

Step  3:  For  each  connected  component  of  A;  and  Bj  compute  in 
parallel,  using,  at  most  aimA+bJmB  processors,  the  following 
topological  characteristics: 

a)  lengths  of  cycles  d;''  for  each  connected  component  C;r  of  A;, 
where  i<=i<=mA,  andl<=i'<=a; 

b)  lengths  of  cycles  d/  for  each  connected  component  Dy'  of  BJ( 
where  l<=j<=mB,  ana  l<=j!<=bj 

c)  level  enumerations  for  each  vertex  belonging  to  every  connected 
component  Cj*'  of  autonomous  factor  A;  and  Dy  of  autonomous 

factor  Bj  (  substeps  a,b,c  are  independent  and  can  also  be  performed 
in  parallel?). 

Step  4;  For  each  connected  component  of  A;  and  Bj  compute  in 
parallel  using  at  most  ajmA+bjmB  processors: 

(i)  a  set  of  generators  using  maximum  function  ( a  set  of  generators 
for  connected  component  is  defined  as  a  set  of  ail  states  of  this 
component  which  have  maximum  value  of  vertex  level  enumeration, 
if  a  connected  component  is  strongly  connected  then  arbitrary  .state  of 
this  component  can  be  treated  as  a  generator ) 

(ii)  check  divisibility  property  of  the  lengths  of  cycles  dy'  of  -ach 
connected  component  Dy  of  autonomous  factor  Bj  with  respect  to  the 
lengths  of  cycles  d;’1  of  each  connected  component  C;‘of 
autonomous  factor  A;. 

Step  5;  For  each  pair  of  connected  components  (C;*-,  Dy)  such  that 
cycle  length  dji'  divides  d;1'  generate  nondeterministically  and  in 
parallel  using  at  most  a;bjmAmB  processors  a  set  of  all  possible 
mappings  betwean  set  of  generators  of  Cjr-  and  set  of  generators  of 

For  each  mapping  computed  in  step  5  generate  in  parallel 
using  at  most  (mBnB)(mAnA>  processors  a  binary  relation  of 
successors  implied  by  transition  functions  of  connected  components 
Cj1’  and  Dy  ;  this  binary  relation  should  be  computed  modulo  length 
of  cycle  dy  of  connected  component  Dy  . 

Step  7:  For  all  binary  relations  generated  In  Step  6  check  in 
paraild  usiiig  at  most  (mBnB)(mAnA)  processors  whether  :t»s 
relation  is  a  function,  if  such  relation  is  a  function  then  thi.  i.  a 
generalized  homomorphism. 

The  dependency  graph  of  this  algorithm  is  presented  on  Fig.  1 .  As 
an  example  we  provide  a  pseudocode  of  the  parallel  connected 
components  algorithm.  Implementations  of  other  steps  of  the 
algorithm  are  not  provided  because  of  the  lack  of  space. 

Parallel  connected  components  algorithm: 

Step  1.  Broadcast  data  to  all  processor  nodes  by  distributing  vertices 
and  edges  evenly,  i.e.  nIN  vertices  and  e..V  edges  among  A 
active  processors. 

Initialize  each  vertex  to  be  the  root  of  the  tree  which  contains  it. 

Step  2.  For  each  vertex  i  andj  do  in  parallel 
If  vertex  i  and  vertex  j  are  in  processor 
then  process  edge  (i  j) 

Find  the  root  of  vertex  i. 

Find  the  root  of  vertex  j. 

Merge  (union)  tree  for  i  and  tree  for  j. 

If  processor  node  is  not  a  collector  node 

then  pass  parent  array  and  all  unprocessed  edges  to 
appropriate  nodes  with  minimal  Hamming  distance. 
Step  3:  For  collector  nodes  do  in  parallel 

Combine  the  information  in  the  current  parent  array  with  the 
parent  array  passed  to  node  from  sender  node. 

Repeat  steps  2  and  3  for  all  unprocessed  edges  and  parent  arrays. 


decompoie  «utom*U  A  and  B1 
eutenomoue  lectors  / 


compute  connected  component/ 
for  each  autonomous  itti or  i/o 1 
automaton  A  and  etpnautoi^mous 
lector  o i  autocneMn  3  / 


[  Cialpli«i 


€> 


compute  level  numbering 
lor  each  state  belonging  to y 
a  connected  component  or 
automaton  A  and  B  / 


compute  sets  ol  geneUtor* 
loz  each  connected  component 
of  automaton  A  and  B  hxi ng 
level  numbering and  maximum, 
operator 

(  gen  ) 


ioz  each  pair  of  connecte^ycomponents 
Irom  corresponding  autoronous  factors 
satisfying  cycle  divisibility  level  / 
r-umberingcondition#  do  in  parallel  / 
generate  arbitrary  mapping  betveVn  sets/f 
generators  r" 

(mapping^ 


compute  cycle  length 
for  each  connected  compo 
of  automaton  A  and  B  / 


\  chs<x  divisibility  pjppperty  between 
^^cjrcle  length  ol  each  connected  component 
*■’  vol  automaton  A/sno  0  zoz  corresponding 
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Abstract:-  We  propose  an  algorithm  for  the  parallel  LU  decom¬ 
position  of  an  upper  llessenberg  matrix  on  a  shared  memory  multi 
processor.  We  consider  the  general  case  of  p  processors,  where  p  is  not 
related  to  the  sire  of  the  matrix  problem.  We  show  that  the  LU  de¬ 
composition  of  an  (m  +  l)-banded  llessenberg  matrix  can  be  achieved 
in  0(37-)  operations,  where  n  is.the  dimension  of  the  matrix  and  p  is 
the  number  of  processors.  For  tridiagonal  matrices  this  algorithm  has 
a  lower  operation  count  than  those  in  the  literature  and  yields  the  best 
existing  algorithm  for  the  solution  of  tridiagonal  systems  of  equations. 


1.  Introduction 

A  number  of  authors  over  the  last  two  decades  have  written  on  par¬ 
allel  algorithms  for  solving  tridiagonal  systems.  These  articles  have 
considered  the  problem  of  solving  tridiagonal  systems  for  the  form 
Ax  =  bi,  1  <  i  <-k  where  A  and  all  of  the  b;,  are  known  at  the  start  of 
the  process.  In  such  cases,  the  computations  can  be  arranged  to  pro¬ 
duce  highly  ctlicicnt  parallel  solutions  to  all  m  systems  simultaneously. 
It  should  be  noted,  however,  that  there  are  a  number  of  common  nu¬ 
merical  situations,  for  example  the  ADI  method,  where  one  needs  to 
solve  tridiagonal  systems  where  A  is  known  ah  initio  but  the  6;’s  are 
not  all  known  at  the  start  of  the  computation  but  rather  arise  as  a 
result  of  an  iteration  process. 


2.  LU  Decomposition  Algorithm 

We  shall,  in  fact,  consider  the  LU  decomposition  of  an  n  X  n  upper 
llessenberg  matrix,  since  the  analysis  is  not  significantly  more  diffi¬ 
cult  and  the  additional  generality  leads  to  insights,  which  produce  a 
more  efficient  algorithm.  Let  A  =  (al})  be  a  banded  n  x  n  upper 
llessenberg  matrix  with  band  width  m  -t-  1,  i.c.,  a,,  0  only  when 

min{l,t-l}  <  j  <  max  {n,  m  + 1  -  1},1  <  ,  <  n.  It  suffices  to 
consider  the  case  where  a;+j,i  r  0, 1  <  i  <  n  -  1,  since  otherwise  the 
matrix  is  reducible,  and  we  may  consider  the  LU  decomposition  of  the 
subproblcms  resulting  from  the  reduction.  Throughout  this  paper  we 
will  use  the  convention  that  any  clement  with  a  nonpositive  index  has 
value  zero. 

As  in  most  algorithms  for  shared  memory  multiprocessors,  the  ob¬ 
ject  here  is  to  partition  the  problem  into  a  number  of  subproblems 
suitable  for  solution  by  tasks  running  on  the  available  processors.  We 
shall  consider  the  general  case  of  p  processors,  where  p  is  not  related 
to  the  size  of  the  matrix  problem.  Clearly  A  has  an  LU  factoriza¬ 
tion,  A  —  LU,  where  L  is  a  unit*  lower  bi-diagonal  n  a  n  matrix  and 
V  ~  (u,j)  is  a  banded  n  x  n  upper-triangular,  with  m  non  zero  diago¬ 
nals,  including  the  main  diagonal.  The  special  form  of  L  allows  one  to 
readily  determine  L~l.  One  finds  that  L~l  =  (I,,)  is  an  n  x  n  lower 
triangular  matrix  given  by 


/..._{  ri(-« 

1  0  '  <  j- 

Thus  the  elements  of  U  =  L~lA,  satisfy  I  <  i,j  <  n 


(1) 


can  be  used  to  simplify  (2).  Since  u,+ij  —  0,  for  1  <  j  <  n  -  1,  (2) 
•  iclds  the  following  linear  systems  fur  the  unknowns  y,. 

Vi  =  0,  j  <  0  ,  yi  =  l 

w+wj+ij  =  J2  v>a*i>  i<  y  <  n  - 1.  O 

l=;-m+l 

It  is  clear  that  (1)  defines  an  mil  banded  triangular  linear  system 
Ty  =  e.  (5) 


where 


f  .i,  if  *'  =  i  =  i 

U]  =  <  (-l)'-^;,,.,  j  <  i  ,  r  >  1 
{  o  j  >  i 


Thus  the  problem  of  finding  an  LU  factorization  of  an  upper  IIos- 
senberg  matrix  reduces  to  solving  the  banded  triangular  system  de¬ 
scribed  in  (5)  to  obtain  the  y;’s  and  then  using  the  solution  of  that  sys¬ 
tem  to  evaluate  L  and  U.  In  practice,  L  may  be  determined  from  equa¬ 
tion-^).  To  determine  U ,  note  first  that  the  elements  of  the  (m  -  l)’1 
diagonal,  u,-.,+m-i  satisfy  uj>1+m_i  =  aill+m_i,  fort  =  l,...,n-m  +  l. 
Also  Uj j  =  aij  for  j  =  l,,..,m.  Thus  these  elements  do  not  re¬ 
quire  any  calculation.  The  y,h  super-diagonal  is  given  in  terms  of  the 
(j  +  l)u  by 


^•■i-ly+i  +  ui.j+i  —  ai,j+n  t  =  2, ... ,  it  —  j.  (6) 

Mote  that  each  element  depends  only  on  a  single  element  of  the  next 
superdiagonal  and  on  known  values  from  L  and  A-  Thus,  the  ealeu 
lation  of  each  super  diagonal  of  U  is  perfectly  parallclizablc.  In  fact, 
the  main  diagonal  may  be  obtained  using  1  division  rather  than  the 
multiplication  and  subtraction  in  (6)  by 

t ii,i  =  fliyi1i/f,fi,i-=  2,...,s.  (7) 

Further,  the  calculation  of  the  super-diagonals  can  be  chained. 

Thus  the  calculation  of  L  using  (3)  requires  n  -  1  divisions.  The 
total  computations  for  U  is 

m— 2 

(n  -  1)  -r  2  (n  -  ;  -  1)  =  n  (2m  -  3)  -  (m2  -  m  — 1).  (8) 

/=! 

The  iatter  term  is  negative  for  m  £  1.  Hence  we  get  the  following 
upper  bound  for  the  complexity  of  calculating  U 


n  (2m  -  3). 


Note  that  in  the  case  of  a  tridiagonal  system,  m  =  2.  (8)  reduces 
exactly  to  n  -  1.  Hence  using  p  processors  L  and  U  can  be  calculated 
in  the  general  case  in 


2n(m  -  I) 
P 


(9) 


operations  and  in  the  special  tridiagonal  case  in 


tninfi.j+l }  min{,'o+I)  i 

=  2Z  6 ><h)  =  J2  n  <2) 

is/-m+ 1  tsi-M 

As  in  the  tridiagonal  case,  the  well  known  substitution  (cf.  [2],  pp. 
173  -  171  ) 

fZX  ,  _9,  «) 

f*  —  Ui-ihji  i—  2,3,’**,u 


2(n  -  l)/p  (10) 

operations.  There  remains  onlv  the  solution  of  the  triangular  system 

Ty  =  e. 

3.  Algorithm  for  the  Triangular  System 
In  [3J,  Lakshmivarahan  and  Dhall  present  an  algorithm  for  calcu¬ 
lating  the  LU  factorization  of  a  tridiagonal  matrix.  Their  algorithm 
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used  the  substitution  given  m  ^3/  to  produce  a  linear  system,  which 
is  equivalent- to  that  described  by  (5)  with  m  =  2.  Our  algorithm  is  a 
generalization  to  the  upper  Hessenberg  case  of  the  algorithm  presented 
in  [3].  Waremark  that  the  improvement  produced  in  the  generalization 
leads  also  to  a  more  efficient  algorithm  for  the  tridiagonal  case. 

In  order  to  partition  the  problem  we  set 

zj  =  (jb-m+l»y,J-m+2»  lib)  1  1 
and  let  B},  1  <  j  <  n  -  1,  be  the  m  x  m  matrix 

0  1  0  O' 

0  0  1  : 

By.=  :  ...  ...  0  (11) 

0  0  1 

A  -  tL-i 

where  fr|  :=  ( - l)m~;aj_m+lj-/a/+1,;  j  =  1,2,.--  ,n  -  1.  We  obtain 
from  (4)  the  m-vector  iteration 


?/+ 1  -  3  —  1,2,-  -  -  ,n  —  1. 

In  order  to  evaluate  y  1,7/2,  ,y„,  one  must  compute 


Zkm+l 


(12) 


F  =1,2,3,  -  ■■  ,JV  :=  f(n  —  l)/m].  (13) 


In  the  tridiagonal  case,  by  \10}  and  (15;,  the  cost  ofprodacing  an  LU 
factorization  is 

j[T+3l»8(f)]+0(D.  (17) 


If  one’s  goal  is  to  solve  the  linear  system  Ax  =  6,  in  addition  to 
solving  (5),  one  must  also  perform  the  backsolve  by  solving  the  banded 
triangular  systems  Lz  =  b  and  Ux  =  z.  In  the  tridiagonal  case,  this 
may  be  done  by  casting  it  as  the  solution  of  two  linear  recurrences, 
similar  to  (2.3)  and  (2.4)  in  (3).  The  recurrences:  may  then  be  cast 
in  the  form  z,  =  a,z,_i  +  0,  and  solved  using  Algorithm  A  and 
Algorithm  Y from  [3].  The  complexity  involved,  in  the  tridiagonal  case, 
is  2 n/p,  to  cast  the  analogue  of  (2.3)  in  [3)  in  the  appropriate  form, 
and  3n(2  +  iog(2p/3))/p  to  solve  the  two  recurrences,  using  Algorithm 
A  and  Algorithm  Y.  Adding  these  gives  a  total  of 

^(8  +  31og(|)).  (18) 


The  cost  of  solving  for  one  righthand  side,  given  by  (17)  and  (18),  is 
thus 

j[f«log(|)]+0(l).  (19) 


4.  Conclusions 

In  the  tridiagonal  case,  the  algorithm  is  not  only  better  than  ex¬ 
isting  algorithms  in-the  literature  for  LU  decomposition,  but  also  has 
better  computational  complexity  for  the  solution  of  a  single  tridiagonal 
system,  as  indicated  in  Table  1,  where  m  =  n  +  1  =  2*. 


where  C,-:=  Dj,  1  <  i  <  N  -  l  and  Cn  :=  JJ  #;'• 

;=(i-I)ra+l  "  ;=(iV-1)m+l 

k 

To  calculate  the  required  products  Ct,  k  =  1,2,-. -,N,  one  uses 

1=1 

a  variant  of  recursive  doubling.  Let  Zx  -  Cxzx  and  Z,  =  C„  i  = 
2,... ,  jY,  then,  assuming  we  have  g  processor  groups,  each  group  first 
calculates 

(<fc-l)A/+Z 

A.*  =  II  £i,  k=  1, /  =  2,...,M  =  N/g. 

i=(Jb-l)Af+2 

Then  the  p  processor  groups  execute  the  following  algorithm: 
for  i  :=  0  thru  log(g)  -  1  do 

{distribute  the  g/2  independent  calculations  found  in  the} 

{  j  and  k  loops  below  among  the  g/2  groups  of  processors  } 
for/  :=  2'  thru  g  -  2'  step  2i+I  do 
for  k  :=  j  +  1  thru  j  +  2'  do 

{using  2  groups  calculate  } 
for  l  =  1  thru  M  do 

Di.k  :=  Di'kD.uj 

It  is  easily  seen  that  after  the  execution  of  the  above  algorithm  = 
(njtal*W+l  Cj)x i  -  For  the  purpose  of  simplifying  the  complexity  anal¬ 
ysis,  assume  that  n  =  jVm  +  1  ,p  —  g(2m  -  1)  where  g  is  a  power  of  2, 
and  /V  =  gM. 

An  analysis,  the  details  of  which  appear  in  [1],  yields  the  following 
time  complexity  estimate.  For  a  general  upper  Hessenberg  matrix 
with  band  width  m  +  1,  the  time  required  to  calculate  its  y,'s  in  this 
fashion  is 

^  |6m2  -2m+  I  +  m(2m-  I) log  +  0(m).  (M) 

In  the  tridiagonal  case  m  =  2,  and  this  reduces  to 

j[jt0loS(|)]-  (15) 

Thus,  from  (9)  and  (14),  the  total  cost  of  an  LU  factorization  is 
i  |6m*  +  2m  -  3  +  (2mJ  -  m)Iog  (2>^;  ,)]  4-  0(m).  (16) 


Method 

Processors 

Time 

Serial  Gaussian 
Elimination 

1 

8n 

Recursive 

Doubling  (2) 

n 

24  log  n 

Odd;Even 
Reduction  [2] 

nr/ 2 

19  log  nt  —  14 

Odd-Even 
Elimination  [2] 

nt 

14  log  71/  +  1 

Lakshmivarahan 
Dhall  (3) 

n/2 

18  log  n 

Lakshmivarahan 
Dhall  [3] 

P 

3  <  P  < 

(n/p)(25+91ogp/3j-3 

Algorithm 

P 

(n/p)[47/2  +  61ogp/3j 

Table  1:  Complexity  of  the  solution  of  a  single  linear  system  for  tridi* 
agonal  matrices. 

Further  let  us  consider  again  cases,  such  as  the  ADI  method  dis- 
cussed  in  the  introduction,  where  A  is  known  in  advance  but  the  6; 
are  not.  Comparing  this  algorithm  with  methods,  such  as  Recursive- 
Doubling,  which  do  not  perform  the  LU  decomposition,  a  further  im¬ 
provement  in  computational  efficiency  results,  since  one  need  only  per- 
form  the  forward  and  back  solves,  for  each  right-hand  side,  rather  than 
performing  the  full  elimination. 
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Abstract  —  The  biconjugatc  gradient  (BCG)  method  is  the 
“natural”  generalization  of  the  classical  conjugate  gradient  algo¬ 
rithm  for  Hcrmitian  positive  definite  matrices  to  general  non-Hcr- 
mitian  linear  systems.  -Unfortunately,  the  original  BCG  algorithm 
is  susceptible  to  possible  breakdowns  and  numerical  instabilities. 
Recently,  Freund  and  Naclitigal  have  proposed  a  novel  BCG-type 
approach,  the  quasi-minimal  residual  method  (QMR), -which  over¬ 
comes  the  problems  of  BCG.  Here,  we  present  an  implementation 
of  QMR  based  on  an  s-step  version  of  the  nonsymmetric  look¬ 
ahead  Lanczos  algorithm.  The  main  feature  of  the  s— step  Lanczos 
algorithm  is  that,  in  general,  all  inner  products,  except  for  one, 
can  be  computed  in  parallel  at,  the  end  of  each  block;  this  is  unlike 
the  standard  Lanczos  process  where  inner  products  are  generated 
sequentially.  The  resulting  implementation  of  QMR  is  particularly 
attractive  on  massively  parallel  SIMD  architectures,  such  as  the 
Connection  Machine. 


Introduction 

We  arc  concerned  with  the  iterative  solution  oflargc  sparse  linear 
systems 

Ax  =  b,  (1) 

where  A  is  a  nonsingular,  in  general  non-Hcrmitian  N  X  N  matrix. 
Some  01  the  most  efficient  iterative  schemes  for  (1)  are  Krylov  subspacc 
methods:  for  any  initial  guess  x0  e  CjV,  they  generate  approximations 
to  A~*b  of  the  form 

r»£i o+A'n(ro,A),  n=l,2,...,  (2) 

where  r0  =  5  -  Ax o  and 

Kn(r0,A)  =  span  {r0,  Ar0, . . . ,  An~l  r0)  (3) 

is  the  nth  Krylov  subspace  generated  by  r0  and  A.  For  example,  the 
generalized  minimal  residual  algorithm  (GMRES)  of  Saad  and  Schultz 
[8]  and  the  biconjugatc  gradient  algorithm  (BCG)  of.Lanczos  [CJ  both 
satisfy  (2).  Unfortunately,  for  methods  like  GMRES,  work  and  stor 
age  requirements  per  iteration  grow  linearly  with  n  and,  therefor'-, 
versions  with  restarts  are  used  in  practice,  which  often  results  in  slow 
convergence.  In  contrast,  for  BCG,  work  and  storage  requirement* 
per  iteration  are  constant  and  low.  However,  BCG  typically  exhibits  a 
rather  irregular  convergence  behavior  and  the  method  cap.  even  break 
down. 


The  QMR  Approach 

In  (3],  Freund  and  Naclitigal  have  proposed  a  BCG-type  appreach, 
the  quasi-minimal  residual  algorithm  vQMIlj,  which  overcomes  the 
problems  of  BCG.  The  method  uses  an  implementation  developed  by 
Freund,  Gulknccht,  and  Nachligal  (I,  2]  of  the  nonsymmetric  Lanczos 
algorithm  [5]  with  look-ahead  [7j  to  generate  basis  vectors 
for  the  Krylov  subspaces  (3).  More  precisely,  with 

Vf")  =  [vi  t-2  fn]  =  (Vi  Vj  •••  V<J,  «,) 

vt  —  [t',,1  k  ~  1, — ,1  —  l(n), 

we  have 

A’„(r0t  A)  -  {V(n,z  1  z  6  C"}  for  n  =  1,2 .  ('•» 

■  this  work  WM  supporicd  in  p«l  by  Cooprraiire  Aijrrrm-niM  C  ;  3‘ 
iwh,  NASA  and  the  Univeoitits  Space  R-wakIi  Assodation  (PSRAJ 


The  blocks  V*  in  (4)  just  contain  the  vectors  corresponding  to  the 
Ath  look-ahead  Lanczos  step  of  length 


hk  =  n*+l  ~  «*• 


In  the  sequel,  we  refer  to  the  first  vectors  v„k  in  each  block  as  regular 
rectors,  while  the  remaining  vectors  are  called  inner  lectors.  Further 
more,  the  relation 

yty(n)  =  i/(n+I)//('t)  (6) 

holds.  Here  II M  is  an  (n+ljxn  upper  Hesscnberg  matrix  which  is  also 
block  tridiagonal  with  /  diagonal  blocks  of  size  A*  x  Ajt,  A  =  1,2,...,!. 
In  addition,  to  the  right  Lanczos  vectors  uj,U2,...,  the  look-ahead 
Lanczos  algorithm  generates  left  Lanczos  vectors  such  that 

Kn(wuAT)~  span{to,,te2,...,tcn}  for  n  =  l,2,...  , 

and,  as  in  (4),  we  set 


IV*  —  [kin,  U?n*+l  ton4+1_i],  A—  1, 


These  vectors  arc  just  constructed  such  that  right  and  left  Lanczos 
vectors  corresponding  to  different  look-ahead  steps  arc  biorthogonal, 


0  if  j  ^  A, 
Dk  if  j  =  A, 


7,  A  —  i, . . .,/, 


(7) 


and,  moreover,  the  matrices  Dk  arc  all  nonsingular. 

By  means,  of  (5)  and  (6),  the  nth  iterate  (2)  of  any  Krylov  sub¬ 
spacc  method  and  the  corresponding  residual  vector  can  be  written  as 
follows: 


xn  =  x0  +  V^zn  for  some  zn  g  C",  (8) 

rn  =  b  -  Ax„  =  V<"+'>  (|jr0||sc,  -  7/(")zn)  .  (9) 

Here  c,  denotes  the  first  unit  vector  in  It'1*1. 

For  the  QMR  method  the  parameter  vector  z„  in  (t>)  is  chosen  such 
that  the  Euclidean  norm  of  the  coefficient  vector  in  the  representation 
(9)  is  minimal,  i.c.,  as  solution  of  the  least  squares  problem 

mm[|fiB(||r0||Jc,-;/f")z)Sl,  (10) 

where  -  diag(||ui|(j,|icji(2,...,||i’„ti||j).  Here,  fl„  is  chosen  such 
that  all  basis  vectors  tj/|It;||j,  j  =  l,...,n+  1,  in  the  representation 
(9)  of  r„  have  the  same  Euclidean  length.  Notellial  Slnll 1"'  is  an 
upper  Ucssenbcrg  matrix  with  full  column  rank  n.  Hence  (JO)  always 
has  a  unique  solution  and  the  QMR  iterate  xn  is  wcil  defined  by  (Si 
and  (10)  Finally,  wc  remark  that  z„  tan  be  easily  updated  from  step 
!-■  -’cp,  and  the  resulting  QMR  alguiithm  tan  be  implemented  using 
anil  short  r-rnrrenres  (sec  (3]  for  details!. 

An  s-Stf.p  Lanczos  algorithm  with  Look-Ahead 

To  enforce  the  biorthogonality  conditions  (7),  inner  products  or 
vectors  of  length  jV  need  to  be  computed.  In  the  implementation 
of  the  look-ahead  Lanczos  algorithm  described  in  (1,  2],  this  is  done 
sequentially,  i.c.  inner  products  are  calculated  in  each  iteration  step  n. 
On  a  massively  parallel  machine,  such  as  the  Connection  Machine,  the 
sequential  computation  of  these  inner  products  represents  a  bottleneck. 

In  this  section,  wc  sketch  a  version  of  the  look-ahead  Lanczos  algo¬ 
rithm  which  oveiiomcs  this  |irn5'.'-m  ami  is  more  suited  for  a  parallel 
m  whine.  In  contrast  to  the  sequential  algorithm,  where  look-ahead 
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steps  of  size  hk  >  1-arc  performed  onlj  if  necessary  to  avoid  break 
dowps  of  the  Lanczos  process,  the  philosophy  of  the  5 -step  Lanczos 
algorithm  is  to  construct  Lanczos  blocks  of  given  size  —  when 
ever  possible.  This  is  done  by  first  generating  s  -  1  intermediate  inner 
vectors  by  means  of  simple  three-term  recurrences 

Vh-frl  =  ~  (^) 

!Tn+l  =  ATWn-<;nWn-V*Wn-ti  02) 

with  suitably  chosen  coefficients  and  i]nt  =  0.  The  biorthogo¬ 
nality  conditions  (7)  arc  then  enforced  only  at  the  end  of  each  block. 
This  has  the  advantage  that  all  inner  products  arising  in  the  biorthog- 
onalization  process  for  the  inner  vectors  of  a  whole  block  can  be  com¬ 
puted  in  parallel.  We  remark  that  to  enforce  (7)  for  the  inner  vectors  in 
block  /,  it  is  sufficient  to  biorthogonalize  them  only  against  the  vectors 
from  the  previous  blocks  /  =  /(n),/ -f  1 ,...,/  using 

r„  =  Vn-V/D]lWfvn-...-Vl-lDr.\Wf_lvn  (13) 

wn  =  w„  -  WjDfVjZ*  -  ...  -  lV?_iZ>,I^I?I,t5„.  (14) 

Moreover,  in  general,  only  one  previous  block  occurs  in  (13)  and  (14), 
i.e.,  f  =  1  —  1. 

In  [4j,  Kim  and  Chiuiiupuulus  proposed  aa  u  -  step  Lanczos  algo 
nvhm  using  a  fixed  block  size  a  throughout  the  whole  protess.  Our 
numerical  tests  show  l!,,..  such  an  approach  is  not  liable.  In-order  to 
obtain  a  robust  inipIcuiw.tat.on  of  the  a  -step  Lanczos  algorithm,  it  is 
crucial  to  keep  the  blow,  siac  variable  and  combine  the  process  with  a 
suitable  look-ahead  strategy. 

In  the  following  algon.hin,  we  outline  the  a  atop  look  ahead  Lane 
zos  method  which*  we  propose.  In  each  block  step,  the  algorithm  tries 
to  build  a  block  of  size  a.  If  the  construction  of  such  a  block  would 
lead  to  a  singular  or  a  nearly  singular  matrix  !),  in  (7)  ol  to  a  new  pair 
c„,t,  and  teni+I  of  regular  vectors  which  have  dominant  components  in 
the  old  Krylov  subspaccs  A'r.,vCi,A)  or  A'ni(u:i,AT),  we  cither  build  a 
smaller  block  or,  by  performing  sequential  steps,  a  bigj,  r  block 

Algorithm.  Sketch  of  s—  step  Lanczos  algorithm  with  look-ahead 

0)  Set  Ci  =  ro/ljroj^  and  choose  tej  e  CV  «n th  jjnqjjj  -  1' 

Set  ni  =  1,  /  =  1,  f0  =  tr0  =  0; 

Forl  =  1,2,..-* 

1)  Compute  s  -  l  intermediate  inner  vectors  via  (I  J)  and  (IS)  for 
n  =  n[,...,ni+s  —  2; 

Set  l?  —  [ I V.,  ■  cn,+j— ij,  I W  —  [rtn,  *  '  s]» 

2)  Construct  the  symmetric  matrix  l?; 

3)  (Riorthogonalizalion  of  inner  vectors .) 

Determine  f  by  nj  =  max{n^  |  n,  <  »i  -  s  h  1}. 

For  n  =  nj  +  l,...,nj  -r -s  -  I,  compute  r„  and  tr„  via  (13)  and 
(14);  If\Kh  =  0  or  =  0,  stop; 

Set V,  =  (rr„  r„I+J_ij,  11?  =  [trn,  •••  rr„J+1_,]; 

4)  Construct  the  symmetric  matrix  Di  =  Iff  l); 

5)  Decide  whether  to  construct  cB)+,  and  ,  as  regular  vectors 
or  to  reduce  the  block  size  and  go  to  S)  or  $).  respectively; 

6)  If  it  is  possible  to  construct  regular  vectors  rr..t,  end  wmit,  for 
s  <  s: 

set  n;+,  =  n.-a-j.  1?  =  (rnf  ---  r^+,_ij.  IV?  =  [tr„, 
and  go  to  S); 

Otherwise,  try  to  increase  the  block  size  s  by  sequential  steps: 
set  s  a  s; 

Loop: 

Set  s  =  s  +1,  n  =  nt-rs-  2.  compute  rr.n  and  sra+l  no  (It) 
and  (12),  and  biorthogonalize  immediately; 
determine  f  by  nj  =  rn*x{n,  j  nt  <  nt  at!)  and  compute 
r„+|  and  rrBBl  using  formulas  (131  and  (If)  (with  r.  replaced  by 
n-f  1);  //Hr,.+iPj  =  0w  D^ntiPz  -  0. 


Stl  V?  —  [Vj  rn+,J,  II?  -  [II?  u>n+i)  ond  update  the  matrix  If'/V,, 
This  Iwp. is  terminated  r /  ire  can  cu.vatmct  regular  rectors  Int--i 
and  iCnj-.j  or  if  tre  have.:  reached  tht  maximum  blade  sue.  In  the 
first  cast,  go  to  8),  in  the  second  case ,  go  to  7), 

7)  Determine  the  smallest  value  which  failed  the  checks  and  up¬ 
date  the  upper  bound  n(A)  to  this  value.  The  block  is  now 
enforced  to  close.  Let  its  size  be  3  and  set  ni±\  =  nj  -f  5, 
V»  =  [«?„(  ---  cn(a;_i j  II?  =  [tr„£  ---  rr^aj.ij; 

S)  (Construct  regular  vectors  v„ttl  and  wr.,fl.) 

Set  n  -  nj+i,  f„  =  Af„_i,  try,  =  ATtEB-i,  and  compute 

in  =  c„  -  Vl-xD&Wl^  -  VtDflWfvn, 
wa  =  wn-Wl.lD;JlVllirn-\VlDf\fwn-, 

VWi’nWt ■=  0  or  I|tr„||j  =  0,  stop; 

Otherwise,  set  r„  =  fn/|lrn|]2  and  wn  =  «W|]rr„[!,, 

3}  Construct  tht  lih  blocks  of  the  block  tndtagonal  malrtx 
and  set  1  =  1+ 1. 

We  note  that  the  quantity  n(A)  in  step  7)  is  an  estimate  of  the 
norm  of  the  matrix  zl  which  vs  used  for  our  checks  to  guarantee  that 
the  Lanczos  vectors  remain  sufficiently  linearly  independent.  Asiimlai 
concept  w-s  first  introduced7 for  the  sequential  rook  ahead  Lara..  > 
algorithm  in  [ij.  These  checks,  the  entena  for  the  decision  in  step  5;, 
and  further  details  of  the  algorithm  will  be  presented  m  a  furthcoming 
paper.  Here,  we  only  remark  that  the  important  properties  (5),  (6), 
and  i7y,  which  were  used  m  the.  derivation  of  the  QMR  method,  remain 
valid  also  for  the  a  -  step  Lanczos  algorithm  with  look  ahead.  Also,  we 
nolo  that  the  above  algunthm  can  be  realized  with  the  same  number 
of  mnci  products  as  m  the  classical  nonsymmelnc  Lanczos  method 
without  lookahead.  In  particular,  the  s  its  matrix  lf,T  Vj  in  step  2) 
can  be  constructed  by  computing  only  2s  -  l  inner  products,  rather 
than  a7  as  the  straightforward  approach  would  suggest.  Moreover, 
in  step  4),  the  matrix  Z>*  can  be  updated  from  H?rV?,  using  only 
already  available  inner  products.  Finally,  numerical  experiments  with 
an  implementation  of  the  resulting  QMR.  algorithm  on  the  CM  2  will 
be  reported  elsewhere. 
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Abstract  We  consider  parallel  solution  of  a  sparse  system  Lx  =b  with 
triangular  matrix  L,  which  Is  often  a  performance  bottleneck  in  parallel 
computation.  When  many  systems  with  the  same  matrix  are  to  be 
solved,  we  can  improve  parallel  efficiency  by  representing  the  inverse  of 
L  as  a  product  of  a  few  sparse  factors.  We  construct  the  factorization 
with  the  smallest  number  of  factors,  subject  to  the  requirement  that 
no  new  nonzero  elements  are  created.  Applications  are  to  iterative 
solvers  with  triangular  preconditioners,  to  structural  analysis,  or  to 
power  systems  applications.  Experimental  results  on  the  Connection 
Machine  show  the  method  to  be  highly  valuable. 

I.  INTRODUCTION 

There  are  two  possible  approaches  to  the  parallel  solution  of  trian¬ 
gular  systems  of  equations.  The  usual  approach  is  to  exploit  whatever 
parallelism  is  available  in  the  usual  substitution  algorithm  [4].  The  sec¬ 
ond,  which  requires  preprocessing,  works  with  some  representation  of 
L-1. 

If  L  is  sparse,  its  inverse  is  usually  much  denser.  Here  we  consider  a 
factorization  L~l  =  Qk  with  sparse  factors.  Such  a  factorization 
is  possible  in  which  the  factors  have  no  more  nonzeros  than  L  (2).  The 
chief  advantage  of  a  factorization  of  X-1  is  that  all  the  necessary  mul¬ 
tiplications  for  the  computation  of  Qkx  ran  be  performed  concurrently. 
Thus,  it  is  possible  to  take  advantage  of  more  parallelism  in  the  solution 
/t  •'.hese  equations. 

We  review  the  use  of  partitioned  inverses  of  L.  Any  triangu¬ 
lar  matrix  L  can  be  expressed  as  a  product  of  elementary  matrices: 
L  =  L1L2  •  •  -in- 1-  The  factor  Lj  is  unit  lower  triangular  and  nonzero 
below  the  diagonal  only  in  column  j,  i.e.  it  is  elementary  lower  trian¬ 
gular. 

Regrouping,  we  may  write 

£=n p*  a) 

*=i 

where  Pk  =  Xei_,+iXe4_l+ 2  and 

0  =  e0  <  ei  <  ■■•  <  em  =  n  —  1.  (2) 

Here  {et}£l0  *s  a  nuraotonieally  increasing  integer  sequence.  The  factor 
Pk  is  lower  triangular  and  is  zero  below  its  diagonal  in  all  columns  except 
columns  e*_i  +  1  through  ek,  where  it  is  identical  to  L. 

The  solution  of  the  partitioned  problem  proceeds  as  follows.  From 
(1)  it  follows  that 

*  =  L-'b=i[Pk-'b.  (3) 

k=m 

In  computing  the  matrix  vector  products,  we  may  exploit  parallelism 
fully,  using  as  many  processors  as  there  are  nonzeros  in  Pk  and  summing 
the  results  in  logarithmic  time. 

A.  Problems  Addressed 

We  say  that  the  matrix  X  is  invertible  in  place  if  *y  0  <4- 
(X~x)l}  ^  0.  The  elementary  lower  triangular. matrices  are  invertible 
in  place,  There  therefore  always  is  at  least  one  partition  (1)  of  X  with 
factors  that  invert  in  place. 

‘This  work  wss  supported  in  pert  undcr  NSF  Contracts  ECS-8822654  and  ECS- 
8907391. 
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Agreement'NCC  2-387  between  NASA  and  the  University  Space  Research  Asso¬ 
ciation  (USRA). 
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Figure  1:  Best  no-ffil  partition  for  a  graph  without  reordering.  Five 
factors  are  required. 


Figure  2:  Best  no-fill  partitionfor  a  reordered  graph.  Only  three  factors 
are  required. 

Definition  1  A  partition  (l)  m  which  the  factors  Pk  are  invertible 
in  place  is  called  a  no-fill  partition.  A  no-fill  partition  of  L  with  the 
smallest  possible  number  of  factors,  is  a  best  no-fdl  partition. 

Let  <7(X)  be  the  digraph  with  vertices  V  =,{1,2 and  directed 
edges  E  —  E(L)  s  {(t ,j)  j  i  ,>  j,  Lt)  /  0}.  G(L )  is  an  acyclic  digraph, 
or  DAG.  Consider  the  matrix  L  with  graph  G(L)  illustrated  in  Figure  1. 
L  has  a  best  no-ffil  partition: 

X  =  (X,)(L2)(I3)(X4)(XS)(L6L7). 

This  partition  has  six  factors.  It  is  possible  to  symmetrically  permute 
the  rows  and  columns  of  X  such  that  L  remains  a  lower  triangular 
and  G{L)  is  as  illustrated  in  Figure  2.  A  best  no-ffil  partition  of  this 
reordered  X  is 

x  =  (x1x2)(x3x4)(isi;6i;7), 

which  has  only  three  factors. 
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Definition  2  A  best  reordered  partition  of  L  is  a  symmetric  permu¬ 
tation  of  ihe.rovis  arid  columns  of  L  such  that  ihe:permuted  matrix  is 
triangular  and  has  a  best  no-fill  partition  with  the  fewest  possible  fac¬ 
tors. 

The  aims  of  this  work  are  as  follows.  We  shalldevelop  a  theory  of 
efficient  algorithms  for  computing  best.no-fill  (Section  II)  and  best  re¬ 
ordered  (Section m)  partitions.  Second,  we  shall  determine  how  useful 
these  ideas  are  in  practice  by,  means  of  some  experiments  (Section  IV). 

n.  BEST  NO-PILL  PARTITIONS 

The  ,  transitive  closure  of  a  digraph  G  =  (F,  E)  is  the  graph  Gi  =  (F,  El) 
where  El  =  {(i,  y)  |  there  is  a  j  -*  i  path  in  G}.  The  digraph  G  = 
(V,  E)  is  transitivelycl'osed  if  it  is  equal  to  its  own.  transitive  closure. 

We  shall  state  our  results  and  refer  the  reader  to  the  full  paper  [lj 
for  proofs. 

Lemma  1  If  L  is  a  nonsingular  lower  triangular  matrix,  then  G(L~l) 
is  the  transitive  closure  of  G(L). 

Let  G  =  {V,E)  be  a  digraph  associated  with  a  triangular  matrix 
L.  Given  a  subset  S  of  F,  define  the  column  subgraph  Gs  =  (V,Es) 
(where  Es  S  {(t,  j)  G  E\j  6  £})  as  the  graph  of  the  lower  triangular 
matrix  obtained  by  zeroing  all  columns  of  L  not  in  S. 

Theorem  2  Let  a  partition  (2)  and  corresponding  factorization  (1)  be 
given.  The  factors  Pk  are  invertible  in  place  iff  each  column  subgraph 
G(Pk)  =  <?{e».i+il„.,ei}  **  transitively  closed. 

•Proof:  By  Lemma  1  (P£"l)y  yt  0  iff  there  is  a  j  -*  i  path  in  G(Pk). 
The  following  are  therefore  equivalent: 

•  Pk  is  invertible  in  place; 

•  (Pfc_1)>V  5^0  =►  (Pkh  £  0; 

•  for  every  j  -»  i  path,  {Pk),,  0; 

• G(Pk )  is  transitively  closed.  □ 

The  following  algorithm  was  proposed  by  Alvarado,  Yu  and  Betan¬ 
court  (2]: 

Algorithm  Pi: 

Input:  L  =  L1L2  •  •  -Ln-i 
Output:  A  best  no-fill  partition  of  L. 

t  <—  1;  k  ♦—  1; 
while  (i  <  n  -  1)  do 

let  r  be  the  largest  integer  greater  than  i  such  that  L\---Lr 
is  invertible  in  place; 

Pk  <-!/,•••  -L, ; 
k  t~  fc-f*  1;  t «—  r  +  1; 
od 

We  have  shown  [lj  that  Algorithm  PI  determines  a  best  no-fill  par¬ 
tition.  (There  may  be  others.  Best  no-fdl  partitions  are  not  unique.) 

HI.  BEST  REORDERED  PARTITIONS 

This  section  describes  a  straightforward  “greedy”  algorithm  for  finding 
best-reordered  partitions. 

For  ( i,j )  G  E  we  say  that  j  is  a  predecessor  of  i  and  i  is  a  successor 
of  j.  Let  G  -  (F,  E)  be  a  DAG.  We  define  level(i),  i  C  F  to  be  the 
length  of  the  longest  path  in  G  ending  at  i. 

The  algorithm  works  by  finding  a  partition  F  -  U”=1S*  for  which 
the  column  subgraphs  G$k  arc  transitively  closed.  Moreover,  S,  is  a 
source  node  in  the  quotient  graph,  i.e.  there  arc  no  edges  directed  into 
St-  If  Si  and  its  out  edges  are  removed,  then  S2  is  a  source  node,  etc. 
We  shall  call  the  subsets  Sk  in  this  partition  factors  in  analogy  with 
the  corresponding  factors  Pk  of  L. 


Algorithm  RPl  (Re-order,  Permute  1): 

Input:  A  directed,  acyclic  digraph  G(L). 

Output:  A  permutation  v-t-V  — ►  {l,...,n}  and  a  partition  of  L. 

Compute  level(v)  for  all  y  G  F; 
max-level «-  maXvev(level(v)); 
i  *—  1;  k  r-  1;  eo  <—  0; 
while  i  <  n  do 
Sk  0;  ek  <-  i; 

l  *-  min{j  |  there  is  an  unnumbered  vertex  at  level  j}‘, 
repeat 

for  every  vertex  v  at  level  l  do 
if  (([Condition  1]  v  is  unnumbered  )  and 
([Condition  2]  Every  predecessor  of  v  has  been  numbered  )  and 
([Condition  3)  Every  successor  of  v  is  a  successor  of  all 
ti  G Sk  such  that  u  is  a  predecessor  of  v) )  then 
v(y)  «—  i;  i  «-  i  +  1; 

Sk  Sk  U  {v};  ek*-ek+ 1; 
ft 

od 

t  l  + 1; 

until  l  >  max-level  or  no  vertices  at  level  l  -  1  are  in  Ski 

Pk  «-  LCi_,  bt-fc  +  l; 

od 


Theorem  3  Procedure  RP1  finds  a  best  reordered  partition  of  of  L. 

-  I 

The  complexity  of  Algorithm  RP1  can  be  large.  Consider  a  dense 
lower  triangular  matrix  of  order  n.  RP1  takes  0(n3)  time  in  this  case, 
since  the  cost  of  checking  whether  all  successors  of  vertex  j  are  also 
successors  of  its  predecessors  is  0(j(n-j)).  In  [l]  we  refined  Algo¬ 
rithm  RPl,  producing  an  improved  algorithm  for  which  we  can  prove 
an  0(  nonzeros(X))  complexity  bound.  Furthermore,  A.  Pothen  has 
developed  a  method  with  an  O(n)  complexity  bound  for  the  case  where 
the  undirected  graph  G(L  +  Lr)  is  chordal  (this  happens  when  L  is  a 
Cholesky  factor)  [8j. 

While  our- work  is  related  to  the  use  of  clique  and  clique  tree  repre¬ 
sentations  of  sparse  matrix  factors  [7],  the  partitioning  of  this  paper  is 
not  the  same  as  the  partitioning  into  simplicial  cliques  or  supemodes 
that  has  appeared  previously.  Indeed,  all  members  of  a  simplicial  clique 
of  G(L)  are  included  in  the  same  factor  by  Algorithm  RPl,  but  several 
simplicial  cliques  may  belong  to  the  same  factor;  see  [1]. 

TV.  EXAMPLES 

This  section  illustrates  the  performance  of  the  proposed  algorithms. 
Several  examples  compare  PI  and  RPl  with  respect  to  the  number 
of  factors  in  the  partitions  they  find.  We  also  examine  the  effect  of 
the  initial  ordering  of  rows  and  columns  of  a  matrix  A  on  the  number 
of  factors  in  a  best  reordered  partition  of  its  Cholesky  or  incomplete 
Cholesky  factor  L.  An  experiment  shows  that  on  the  Connection  Ma¬ 
chine,  the  solution  process  (3)  can  be  faster  than  substitution  by  orders 
of  magnitude. 

First,  we  compare  algorithms  Pi  and  RPl.  Table  1  uses  five  power 
system  matrices  ranging  is  size  from  118  to  1993.  Table  2  gives  results 
for  matrices  arising  from  five-point  finite  difference  discretizations.  In 
each  case,  the  original  coefficient  matrix  is  first  ordered  and  its  Cholesky 
factor  L  is  found.  We  need  to  distinguish  this  first  fill-reducing  ordering 
of  A  from  the  reordering  of  L  found  by  RPl.  We  call  the  ordering  of  A 
the  primary  ordering.  Three  primary  ordering  procedures  are  used:  the 
minimum  degree  algorithm  [8j,  the  multiple  minimum  degree  ^MMDj 
algorithm  [5j,  and  the  minimum  level,  minimum  degree  (MLMD;  algo¬ 
rithm  [3]. 

For  each  matrix  and  primary  ordering  algorithm,  two  partitioning 
methods  arc  compared:  Algorithm  PI,  which  simply  partitions  L  op¬ 
timally  without  reordering  it,  and  Algorithm  RPl  which  reorders  the 
matrix  and  generates  an  optimal  partition.  In  most  cases,  Algorithm 
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Min.  Degree  | 

MMD 

MLMD 

k a 

RPl 

m 

IMS 

PI 

RPl 

■nil 

ia 

14 

m 

mm 

IO 

mm 

fff-i 

21 

K9 

mm. 

L8_ 

8 

WMM 

26 

ESI 

mm 

EH 

mm 

mga 

giliBl 

26 

33 

24 

in 

mm 

1HS1 

Em 

IEH 

ill 

m 

mm 

Table  1:  Effect  of  primary  ordering  on  number  of  factors  in  best  no  fill 
partitions  (Pi)  and  best  reordered  partitions  (RPl)  for  power  system 
matrices. 


Min.  Degree 

MLMD 

Grid  Size 

PI 

RPl 

E9 

ESI 

m 

EMI 

5  by  5 

Til 

7 

O 

6 

IB 

mm 

10  by  10 

ESI 

12 

E3 

mm 

9 

7 

15  by  15 

ESI 

12 

m 

mm 

EH 

8 

Table  2:  Effect  of  primary  ordering  on  number  of  factors  in  best  no  fill 
partitions  (PI)  and  best  reordered  partitions  (RPl)  for  5-point  differ¬ 
ence  operators  on  grid  graphs. 

RPl  gives  a  smaller  number  of  factors  than  PAl,  while  in  a  few  cases 
both  algorithms  give  the  same  number  of  factors. 

We  observe  that  RPl  reduces  the  number  of  factors  at  no  expense 
in  added  fills.  Its  effect  is  most  dramatic  if  the  underlying  primary 
ordering  is  the  minimum  degree  algorithm.  On  the  other  hand,  the 
best  results  are  obtained  when  the  MLMD  algorithm  is  used  for  the 
primary  ordering,  even  though  the  relative  improvement  attainable  by 
Algorithm  RPl  over  Algorithm  PI  is  small.  The  results  for  the  MMD 
algorithm  fall  somewhere  between  minimum  degree  and  MLMD.  The 
reduction  in  the  number  of  factors  achieved  by  RPl  in  comparison  with 
PI  is  quite  dramatic  when  MMD  is  the  primary  ordering. 

The  second  experiment  we  report  compares  the  solution  proce¬ 
dure  (3)  with  the  usual  forward  substitution  method  on  the  Connection 
Machine  model  CM  2,  a  highly  parallel  SIMD  computer.  We  begin  with 
a  large  sparse  matrix  A  of  order  4037,  obtained  from  a  triangular  mesh 
in  the  region  around  a  three-clement  airfoil.  Three  matrices  £j,  £2, 
and  £3  are  obtained  by  approximate  factorization. 

£1  is  obtained  by  an  incomplete  LU  factorization  of  A;  we  carry  out 
the  Gaussian  elimination  process,  but  we  allow  nonzeros  in  £  (and  !7) 
only  where  there  is  a  nonzero  in  A2.  The  ordering  of  A  is  obtained  from 
a  lexicographic  sort  of  the  (z,  y)  coordinates  of  the  grid  which  leads  to 
the  matrix;  this  ordering  produces  a  large  number  of  levels  in  G(L). 

Lt  Is  the  incomplete  LU  factor  obtained  when  a  variant  of  MLMD 
is  used  as  the  primary  ordering  of  A. 

£3  is  the  exact  lower  triangular  factor  of  A,  with  the  same  primary 
ordering  as  foi  £2. 

La  Table  3  we  give  the  size  of  these  factors,  the  number  of  levels, 
which  is  proportional  to  the  time  required  for  our  parallel  substitution 
algorithm,  and  the  number  of  partitions,  which  is  in  practice  propor¬ 
tional  to  the  time  required  by  the  partitioned  solution  algorithm  (3). 


The  computations  used  8192  processors  on  the  Connection  Machine 
the  NAS  Systems  Division,  NASA  Ames.  From  these  results,  as  well  as 
those  above,  we  see  that  unless  £  has  a  fairly  rich  structure  there  is  no 
great  advantage  to  the  use  of  the  partitioned  method.  The  use  of  an 
MLMD  primary  ordering  improves  both  substitution  and  partitioned 
methods.  However,  with  the  introduction  of  the  additional  fill  in  the 
exact  factor  £3  (compared  with  £2),  the  number  of  levels  in  (?(£)  in¬ 
creases  sharply  (as  docs  the  time  for  substitution)  while  the  number  of 
factors  in  the  best  reordered  partition  drops  dramatically.  The  differ¬ 
ence  in  the  solution  time,  even  for  this  problem  of  modest  size,  is  about 
a  factor  of  twenty.  Thus,  we  conclude  that  the  method  can  be  quite 
useful  in  highly  parallel  machines  when  the  matrix  £  has  a  rich  enough 
structure,  as  happens  when  it  is  an  exact  triangular  factor. 

V.  CONCLUSIONS 

An  algorithm  for  best  reordered  partitioning  of  lower  triangular  matri 
ces  has  been  presented  and  proven  to  be  optimal. 

Experiments  have  shown  the  method  to  be  very  valuable  in  practice 
on  highly  parallel  machines. 

For  a  lower  triangular  factor  of  a  sparse  matrix  A,  the  number  of 
partitions  attainable  is  strongly  influenced  by  both  the  ordering  of  rows 
and  columns  of  A  and  the  method  of  computing  £. 
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Matrix 

Ordering 

Factor¬ 

ization 

nonzeros 

H2S2J1I 

Substitution 

Time 

Factors 

Partitioned 
soln.  time 

£1 

RCM 

ELU 

23,526 

823 

16,17  secs 

15.73  secs 

l2 

MLMD 

ILU 

26,793 

78 

2,20  secs 

66 

1.84  secs 

MLMD 

exact 

118,504 

311 

28.89  secs 

16 

1.51  secs 

Table  3.  Comparison  of  CM-2  execution  times  for  substitution  and 
partitioned  solution. 
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Abstract:  The  prototype  supercomputer  and  some  leading  archiiectures  including 
massively  parallel  computers  are  discussed,  A  performance  formula  explains  the 
gap  between  theoretical  peak  and  real  performance. -The  pricc/pcrformance 
relation  for  the  discussed  computers  is  presented. 

1.  THE  PROTOTYPE  VECTOR  COMPUTER 

In  Fig  1  the  ‘prototype’  vector  computer  is  depicted  The  technology  is 
characterized  by  the  cycle  time  in  nsec.  The  floatingpoint  units  are  pipelines, 
thus  have  a  startup  time  and  need  long  vectors  for  efficient  use.  Chaining  means 
coupling  and  overlapped  operation  of  different  pipelines,  c.g.  load,  multiply,  add, 


Fig:  1  ‘Prototype’  vector  computer. 


store.  There  may  be  internal  parallelism  by  multi-track  pipelines,  c.g.  4-track 
pipelines  deliver  4  results  per  cycle. 

In  this  paper  we  denote  by  ‘word’  64  bits  *»  8  bytes  and  by  ‘pipe  group’  an 
addition  and  multiplication  pipe.  Critical  points  of  vector  computers  arc: 
memory  bandwidth  in  words  per  cycle  and  pipe  group;  memory  size  in  Mwords 
(million  words);  size  and  bandwidth  of  extended  memory  (the  two  sizes  limit  the 
problem  size);  i/o  bottleneck:  disks  arc  extremely  slow  compared  to  the  pipeline 
speed. 


CRAY  Y-MP8/S256.  cycle  time  6  nsec,  theoretical  peak  performance  2.67 
GFi-OPS,  8  processors  (MIMD  shared  memory  computer;,  256  Mwords  MM 
(main  memory).  256  banks,  5  cycles  bbt  (bank  busy  time),  bandwidth.  2  load  and 

1  store  per  cycle  and  pipe  group,  2  Gwords  EM  (extended  memory):  bandwidth 

2  *  13  GB/scc. 

Fujitsu  VP260Q  (Siemens  S600),  cycle  time  3.2  nsec,  theoretical  peak 
performance  5.0  GFLOPS,  monoproccssor,  but  internally  2  4-track  pipe  groups, 
256  Mwords  MM.  512  banks,  14  cycles  bbt,  bandwidth,  one  word  per  cycle  and 
pipe  group,  1  Gword  EM.  bandwidth  2  GB/scc.  Model  VP2600/20  with  two 
scalar  processors,  model  VP2400/4Q  with  two  vector  (2  2-track  pipe  groups;  and 
4  scalar  processors. 

NEC  SX-3.  Model  44.  cycle  time  2.9  nsec,  theoretical  peak  performance  22 
GFLOPS,  4  processors  (MIMD*  shared  memory),  8-track  pipe  group,  256 
Mwords  MM:  1024  banks,  7  cycles  bbt,  bandwidth:  0.5  words  per  cycle  and  pipe 
group  globally  (between  memory  and  memory  access  unit),  but  1  load  and  0.5 
store  per  cycle  and  pipe  group  locally  (between  memory  access  unit  and 
processor),  2  Gwords  EM:  bandwidth  2.75  GB/scc.  One  or  two  control 
processors  for  operating  system,  with  separate  memory.  Remark.  Only  the  two 
processor  Model  24  can  be  recommended  (11  GFLOPS)  if  at  least  1  word  per 
cycle  and  pipe  group  global  memory  bandwidth  is  requested. 

IBM  Eg 9000/720  with  6  VFs  (Vector  Facilities-  integrated  vector  processors), 
corresponds  to  former  3090/600J,  basically  general  purpose  computer,  cycle  time 
14.5  nsec,  theoretical  peak  performance  828  MFLOPS,  6  processors  (MIMD 
shared  memory),  64  Mwords  MM:  transparent  (no  banking),  bandwidth:  one 
word  per  cycle  and  pipe  group,  512  Mwords  EM:  bandwidth  2  *  138  MB/scc. 
Cache  of  256  KB,  danger  of  cache  stumbling  for  long  vectors.  Announced:  ES 
9000/900,  cycle  time  9.5  nsec,  2526  MFLOPS,  6  processors,  improved  cache, 
two-track  pipes. 

CONVEX  C240.  Minisupcrcomputcr,  cycle  time  40  nsec,  theoretical  peak 
performance  200  MFLOPS,  4  processors  (MIMD  shared  memory),  256  Mwords 
MM:  128  banks,  8  cycles  bbt,  bandwidth:  one  word  per  cycle  and  pipe  group,  no 
EM.  Soon  expected:  C300,  cycle  time  16  nsec,  8  processors,  1  GFLOPS 
theoretical  peak  performance,  512  Mwords  MM. 

IBM  RISC  SYSTEM  6000.  Model  550.  Super- Workstation,  cycle  time  24.4  nsec, 
theoretical  peak  performance  82  MFLOPS  (can  ‘simulate’  vector  operations), 
64  Mwords  MM,  transparent,  bandwidth:  one  word  per  cycle. 


2.  ARITHMETIC  OPERATIONS  AND  MEMORY  BANDWIDTH 


4.  PARALLEL  COMPUTERS 


Dyadic  operations  like 

Cj  =  3i  +  bj  (1) 

need  2  loads  and  1  store  per  cycle  and  pipe  group.  Triadic  operations  allow 
parallel  operation  of  the  addition  and  multiplication  pipeline  and  deliver  two 
results  per  cycle  and  pipe  group,  called  sunervector_snced_.  The  vector  (or  full) 
triad 

dj  =  a;  +  bj  *  C;  (2) 

needs  3  loads  and  1  store  per  cycle  and  pipe  group.  This  is  the  most  important 
operation  and  thus  nnr  key  operation.  More  special  is  the  linked  triad  with  one 
scalar  operand 

c;  “  a;  +  s  *  bi  (?) 

with  two  loads  and  one  store  and  still  more  special  is  the  (repeated)  contracting 
linked  triad 

b;  =  bj  +  s  *  a;  (4) 

that  needs  only  one  load  if  b  is  fixed  in  a  vector  register.  This  is  the  basic 
operation  of  matrix  multiplication.  A  vector  computer  with  a  memory  bandwidth 
of  one  word  per  cycle  and  pipe  group  fils  only  to  (4)  and  delivers  only  1/4  of 
the  peak  performance  for  (2). 

Because  of  the  different  number  of  memory  references  one  should  not  count 
fur  vector  computers  merely  additions  and  multiplications  bui  count  operations 
likc  c.g.  linked  triads. 

3.  SOME  VECTOR  COMPUTER  ARCHITECTURES 

In  [1]  detailed  discussions  of  the  most  relevant  supercomputers,  including  kernel 
program  measurements,  are  presented.  Present  supercomputers  arc  the 
continuation  of  these  architectures.  In  the  oral  presentation  overviews  like  f  ig. 
1  arc  presented  for  the  different  supercomputers.  Here  vve  present  unly  their 
main  characteristics  for  the  maximal  configurations.  Wc  discuss  3  real 
supercomputers,  an  integrated  vector  processor,  a  mini-supcrcoinputer  and  a 
super-workstation. 


Wc  denote  by  ‘parallel  computer’  an  architecture  that  can  be  extended  to  ‘many* 
processors.  With  parallel  computers  the  real  problems  arc  shifted  from  the 
hardware  level  to  the  software  level,  i.e.  to  the  user.  Wc  discuss  only  M1MD- 
type  parallel  computers.  There  arc  three  basic  types,  see  Fig.  2. 
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Fig.  2  Three  basic  type  parallel  architectures. 


The  -  l  L  -  of  shared  memory  computers  is  the  memory  bottleneck  thal  hmils 
the  number  of  processors,  and  the  memory  contention.  The  user  has  to 
distribute  only  the  processing. 

The  problem  of  the  message  passing  system  is  the  distribution  of  the  data  t- 
the  local  memories,  and  the  resulting  communication  overhead.  Idling  processors 
of  a  dedicated  (sub)systcm  cannot  be  used  by  other  jobs,  ihus  vve  have  a 
OTLOPS  PC  The  dream  uf  the  message  passing  community  is  the  virtual 
share  J  memory,  but  this  is  just  contrary  lo  the  communication  clfrcicncy. 
Hybrid  systems  are  the  worst  of  all  wurlds  because  they  combine  the 
disadvantages  of  both  inherent  systems. 

An  Csser  tial  drawback  of  parallel  computers  is  thal  efficient  programs  must  bo 
tailored  to  the  special  architecture.  In  the  following  wc  discuss  briefly  two 
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representative  hypercube  architectures,  in  the  oral  presentation  detailed  overview 
graphs  will  be  presented. 


Sequential  (nun-paiallehzable;  voile,  pari  q  of  operations  is  paialleliiablc,  part 
(1-q)  is  sequential  (fine  grain  parallelism).  Then  we  get 


NCUBE2:  max.  13-dimensionaT  hypcrcubc,  8  -  8192  scalar  64-bit  processors, 
max.  20  GFLOPS  for  64  bit.  The  basic  processor  is  a  1.2  micron  CMOS  custom 
processor  with  0.5  M  transistors,  20  MHz,  50  nsec  cycle  time,  delivering  2.4 
MFLOPS  (the  pipeline  formula  is  not  applicable),  with  14  bidirectional  DMA 
channels  with  2.2  MB/scc,  each  (one  is  for  i/o).  One  node  has  lor  4  or  16  MB 
local  memory.  Subcubes  can  :be  allocated  to  different  users  (space  sharing. 
'PCs').  The  job  management,  the  compilers  and  the  tools  are  running  on  the 
SUN  workstation  that  serves  as  host  computer. 

INTEL  iPSC/860:  max.  7-dimensional  hypercube,  8  - 128  i860  vector  processors, 
max.  5.1  GFLOPS  for  64  bit.  The  basic  i860  processor  is  a  0.5  micron  CMOS 
custom  processor  with  1  M  transistors,  40  MHz,  25  nsec  cycle  time.  The 
pipelined  floating  point  units  deliver  40  MFLOPS  ‘supcrvcctor  speed'  because 
the  multiply  unit  needs  2  cycles  for  one  result.  Unfortunately  presently  the 
software  is  far  behind  the  hardware,  and  Fortran  compilers  are  unable  to  reach 
this  performance.  There  is  a  one-word  (64  bits)  per  jwfl  cycles  memory 
bottleneck  between  i860  chip  and  memory.  The  node  has  8  or  16  MB  local 
memory  and  8  bidirectional  communication  links  with  2.8  MB/scc,  each  (one  is 
for  i/o).  Subcubes  can  be  allocated  to  different  users  (space  sharing:  ‘PCs').  The 
job  mangement,  the  compilers  and  the  tools  arc  running  on  an  INTEL  80386  PC 
that  serves  as  host  computer. 

5.  PERFORMANCE  FORMULA 

In  this  section  wc  want  to  explain  why  there  is  such  a  large  gap  between 
theoretical  peak  performance  and  real  performance  for  present  supercomputer 
architectures.  If  wc  take  1000/x  ,  where  we  measure  the  cycle  time  t  in  nsec, 
we  get  the  (vector)  speed  of  a  single  pipeline  in  MFLOPS,  times  two  yields  the 
supervector  speed,  times  the  number  P  of  total  pipe  groups  in  the  system  yields 
the  theoretical  peak  performance.  But  unfortunately  the  latter  is  reduced  by 
several  reduction  factors  f;  that  vyc  want  to  discuss  below.  Thus  our  formula  for 
the  real  performance  of  a  pipelined  supercomputer  is 

1000 

r„d.  ■  .2  I MFLOPS]  .  (5) 


thtOTtt.  peak  reduction  factors 

Repeatedly  internally  lost  cycles  (c.g.  section  loop  organization):  for  m  cycles 
we  have  in  the  mean  m  *  d  lost  cycles,  thus 


h 


1 
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(10) 


This  is  Amdahl  s  law  for  parallelization,  compare  to  (9),  e.g.  p  »  64,  q  =  0.95, 
f5  =  0.24. 

ehared  memory  MIMD  parallel  computer,  memory  contention.  If  a  denotes 
the  lulio  of  available  over  minimal  number. of  memory  banks  and  c  denotes  the 
part  of  operations  with  contiguous,  (1-c)  with  random  elements  (indirect 
addressing),  then  a  model  yields 


/  1 
JtA  =  l+2(l-c)/a  ’ 


(U) 


c.g.  a  =  2,  c  =  0.95,  f6iSh  =  0.95. 

Message  passing  (disuibutcd  memory/  MIMD  parallel  computer,  wailing  for 
communication.  For  m  useful  cycles  m  the  mean  m  *  b  additional  cycles  arc 
needed  for  non-overlapping  communication.  Then  wc  get 


fcjHp  “ 


1 

1  +b 


(12) 


c.g.  b  =  0.05,  f6  mp  =  0.95. 

If  we  calculate  up  to  this  point  f,  *  ...  *  (6  -  0.034,  wc  see  that  wc  get  with 
those  ‘reasonable’  assumptions  finally  not  more  than  3.4  %  of  the  peak 
performance,  >.c.  wc  have  lost  96.6  %  of  our  supercomputer’! 

Load  balancing  (coarse  gram  parallelism;,  we  assume  that  a  user  has  reserved 
p  processors  (e.g.  his  subcube;,  t,  is  the  lime  that  processor  i  is  active.  Then  we 
get  his  ‘personal’  utilization  factor 
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(13) 


e.g.  f7  =  0.9. 

Long-range  continuous  usage:  an  idling  computer  produces  no  GFLOPS.  Thus 
the  global  utilization  factor 

f8  =  (hours  of  usage  per  ycar)/8760  (14) 


/.  = 


(6)  is  of  decisive  importance.  For  a  workstation  that  is  used  (as  number  cruncher) 
for  8  h  on  5  days  a  week  f8  =  0.24. 


e.g.  d  =  0.05,  f,=  0.95. 

Memory  bottleneck  for  vector  triad  (2).  only  the  vector  triad  has  full  flexibility 
of  multiplication  and  addition  as  ‘assumed’  in  the  peak  pcrformacc,  all  other 
triads  are  'exceptions".  Therefore  we  select  a.-,  kev  unciatmn  the  vector  triad  that 
needs  4  memory  references  per  cycle  and  pipe  group.  If  we  have  instead  of  4 
only  m,  wc  get 

A  '  j  .  0> 

c.g.  m  °  1,  f2  =  0.25. 

Finite  vector  length  n  (startup  cycles  lost  once;.  If  we  denote  by  n\j2  Hockney  s 
half  performance  length,  see  (1,2],  we  get 


e.g.  n  =  1000,  nj^  =  1000,  f3  =  0.91, 

Scalar  code,  part  v  of  operations  is  vccturizablc,  part  (1  v;  is  scalar,  w  is  the 
ratio  vcctor/scalar  speed  for  infinitely  long  vectors.  Then  we  get 

(1  -v)w+v  '  (9) 

This  is  Amdahl's  law  for  vcctorization,  see  [1,2],  c.g.  w  -  10,  v  -  0.95, =  0.69. 
Up  to  now  wc  have  discussed  monoproccssor  vector  computers.  For  the 
examplary  values  we  get  fj  *  f2  *  f3  *  (,  -  0.15,  i.e.  our  supercomputer  would 
deliver  only  15  %  of  its  theoretical  peak  performance  for  the  vector  triad. 

In  the  following  wc  discuss  parallel  computers  with  p  processors. 


6.  PRICE/PERFORMANCE  RELATIONS 

The  price,  performance  relation  has  two  components.  The  price  is  determined 
by  the  selected  configuration  that  is  strongly  determined  by  the  size  of  the 
memory.  Wc  select  a  configuration  for  the  solution  of  large  problems,  else  a 
supercomputer  is  not  an  appropriate  tool.  Therefore  wc  select  (as  far  as 
possible)  1 GB  MM  (main  memory),  1 GB  EM  (extended  memory)  and  100  GB 
disks.  P  denotes  the  purchase  price,  given  in  MDM  (million  dcutschmark),M+L 
denotes  maintenance  and  licence  costs,  given  in  MDM/a  (per  annum  =  year). 
All  prices  arc  commercial  list  prices  (no  university  discount),  without  VAT,  valid 
January  1991.  The  software  for  a  FORTRAN  environment  with  operating 
system,  compiler  and  tools  is  included. 

The  performance  is  given  by  the  peak  performance  and  the  reduction  factors. 
Wc  determine  the  performance  for  the  vector  triad.  Wc  note  only  the  reduction 
factors  *  1  that  arc  applied. 

We  attribute  some  personnel  to  the  computer.  SE  denotes  system  engineer  with 
78  KDM/a,  OP  denotes  operator  with  52  KDM/a.  We  do  not  consider  cost  for 
housing,  electricity,  climatization. 

The  price, 'performance  relation  is  given  in  MDM;  a  per  GFLOPS,  i.e.  the  cost 
to  be  paid  pci  yea.  to  have  1  GFLOPS  .sustained  vector  triad.  For  this  purpose 
the  purchase  price  is  distributed  onto  four  years,  i.e.  wc  assume  a  four  year  life¬ 
cycle  of  our  supercomputer.  In  the  following  wc  give  the  data  for  the  different 
computers. 

CRAY  V-MP8/8128: 1  GB  MM,  1  GB  EM,  100  GB  disks,  P  =  48.05  MDM  (31 
MS),  M  ♦  L  =  2.16  MDM/a,  2  SE,  3  OP,  peak  performance  2.67  GFLOPS,  f2 
=  3/4,  f6,h  =  0.9  (estimated). 

Fujitsu  Kicmcns  VP2600/10. 1  GB  MM,  1  GB  EM,  100  GB  disks,  P  -  28.65 
MDM,  M '  L  -  1.48  MDM/a,  2  SE,  3  OP,  peak  performance  5.0  GFLOPS,  f, 
=  1/4. 


NEC  SX-3.- Model  24: 1  GB  MM,  1  GB  EM,  100  GB  disks,  P  -  30.48  MDM, 
M+L  =  1.37  MDM/a,  2  SE,  3  OP,  peak  performance  11.03  G FLOPS,  f2  =  1/4, 
=  0.95  (estimated). 

IBM  ES9000/720  (30901/600).  6VFs:  0  5  GB  MM  (max ),  1  5  GB  EM,  100  GB 
disks,  P  =  38.24  MDM,  M  +  L =  1.829  MDM/a,  2  SE,  3  OP,  peak  performance 
0.828  GFLOPS,  f2  =  1/4,  fMchc  slumb!ing  =  0.8  (estimated). 

CONVEX  G240: 1  GB  MM,  8  GB  disks,  P  =  3.9  MDM,  M+L  =  0.39  MDM/a, 
1  SE,  peak  performance  0.2  GFLOPS,  f2  =  1/4,  f0^h  =  0.9  (estimated). 
(Remark:  !  GB  MM  is  unusually  large  for  a  CONVEX  and  brings  the  price  up, 
but  for  the  solution  of  large  problems  we  need  a  large  MM.) 

IBM  RISC  SYSTEM  /6000.  Model  550  Workstation:  0.5  GB  MM  (max.),  2.5  GB 
disks,  P  =  953  KDM,  M+L  =  26.5  KDM/a,  0!  SE,  peak  performance  0.081 
GFLOPS,  f2  =  1/4,  fg  =  0.24  or  0.75.  (Remark:  The  maximal  MM  of  0.5  GB 
excludes  this  workstation  from  the  solution  of  very  large  problems.  The  price  for 
the  memory  brings  the  price  for  the  workstation  up.) 

NCUBE  2.  Model  10:  512  processors  h  4  MB  -  2  GB  MM,  50  GB  disks,  P  - 
7.0  MDM,  M+L  =  0.70  MDM/a,  2  SE,  peak  performance  1.23  GFLOPS,  f2  = 
1  (scalar!),  f5  =  0.95  (q  =  0.9999),  f„  =  0!  or  0.24  or-0.75.  (Remark.  The  2.4 
MFLOPS  per  processor  arc  based  on  parallel  scalar  execution  of  addition  and 
multiplication  and  arc  met  for  the  vector  triad  by  the  80  MB/scc  between  CPU 
and  its  local  memory.) 

INTEL. iPSC/860.  Model  128:  128  processors  d  16  MB  -2  GB  MM,  50  GB 
disks,  P  =  9.8  MDM,  M  +  L  =  0.98  MDM/a,  2  SE,  peak  performance  5! 
GFLOPS,  f2  =  1/4.5,  f5  =  0.99  (q  =  0.9999),  f8  =  0!  or  0.24  or  0.75.  (Remark. 
The  value  f2  =  1/4.5  results  from  the  fact  that  a  load  for  64  bits  needs. two 
cycles,  but  an  immediately  following  store  needs  3  cycles,  thus  9  -  4.5  *  2  cycles 
arc  needed  for  the  vector  triad  and  40/4.5  =  8.9  MFLOPS  per  i860  chip  result. 
An  assembler  program  should  come  close  to  this  value,  a  vectorizing  compiler 
in  a  test  has  obtained  7  MFLOPS  according  to  INTEL.  But  the  software  that 
has  been  delivered  up  to  now  is  far  behind  the  hardware  possibilities.) 

Everybody  is  free  to  choose  his  own  parameters  in  this  play.  In  Fig.  3  the 
price/performancc  relation  for  our  parameters  is  depicted.  The  results  speak  for 
themselves.  The  general  purpose  computer  ha.,  its  own  merits,  but  it  is  an 
expensive  number  cruncher.  Nevertheless  the  purchase  of  VFs  pays  if  the 
ES9000  is  used  in  scientific  computations.  The  mini-supercomputer  is  ‘relatively* 
expensive  in  spite  of  the  'cheap'-technology  because  of  the  relatively'  large 
memory.  For.  the  workstation  and  the  parallel  computers  the  utilization  factor 
is  decisive  for  the  pricc/pcrformance  relation.  These  computers  have  (not  yet) 
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a  batch  environment  that  allows  the  continuous  usage  of  the  computer  like  for 
a  conventional  computer. 

We  have  presented  list-prices.  A  discount  may  change  the  relations 
correspondingly.  Note  that  the  software  results  in- additional  losses  that  may 
increase  the  price/performance  relation  considerably.  But  finally  an  efficient  use 
of  any  type  of  supcrcomputcr-is  possible  only  with  data  structures  that  are 
tailored  to. its  architecture.  If  the  data  structure  does  not  allow  sufficient 
vcctorization  and/or  parallchzauon,  Amdahl’s  law  (9)  and/or  (10)  will  destroy 
any  efficiency. 


7.  CONCLUDING  REMARKS 

The  cycle  time  for  the  ECL-technology  of  the  large  supercomputers  will 
continue  to  decrease  from  now  2.9  nsec  (NEC  SX-3)  to  perhaps  2  nsec 
(CRAY-3  ?)  and  eventually  1  nsec  for  1995+  +  and  0.5  nsec  in  the  year  2000. 
The  CMOS-Tcchnology  of  presently  40  MHz/25  nsec  (i860  chip)  will  evolve  to 
50  -  80  MHz/20-125  nsec  (12.5  nsec  was  the  cycle  time  of  the  CRAY-1), 
INTEL  expects  for  the  year  2000  200  MHz/5  nsec.  Thus  the  usual  factor  of  10 
in  speed  between  ECL  and  CMOS  may  be  maintained. 

The  engineers  want  (sustained)  performances  of  100  GFLOPS,  then  1000 
GFLOPS  =  1 TFLOPS.  This  can  be  obtained  only  bv  parallelism.  But  there  arc 
two  main  problems: 

Problem  1.  Can  we  pay  the  memories  that  arc  needed  to  store  the  operands  in 
order  to  use  TFLOPS2  The  answer  is.  We  have  to  wait  until  we  can  afford  these 
memories,  increased  parallelism  does  not  solve  this  problem. 

Pioblum  2.  How  can  we  organize  a  user-friendly  parallelism  on  the  hardware 
level?  The  answer  is  presented  in  [3]. 
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Abstract 

Different  numerical  libraries  from  hardware  manufac¬ 
turers  and  software  houses  are  available  for  supercom¬ 
puters.  Contents  and  performance  of  these  libraries  on 
CRAY  2,  GRAY  Y-MP,  Fujitsu/Siemens  VP-series  and 
IBM  3090  VF  is  discussed  and  a  proposal  for  future  li¬ 
brary  development  is  given. 

1  Introduction 

Numerical  subprogram  libraries  are  important  tools  in  developing 
scientific  software.  With  the  increasing  use  of  supercomputers,  in 
most  cases  pipclinedvector  computers,  there  is  an  increasing  need 
for  reliable  and  efficient  collections  of  numerical  subprograms. 
This  frees  the  application  programmer  from  recoding  numerical- 
algorithms  and  increases  the  reliability  and  maintainability  of  ap¬ 
plication  programs. 

This  paper  will  concentrate  on  discussion  of  efficiency  of  libraries 
oh  supercomputers  but  will  not  include  a  general  evaluation  of 
different  libraries  since  this  must  comprise  a  detailed  discussion 
of  the  numerical  algorithms,  their  robustness  and  their  implemen¬ 
tation  which  is  beyond  the  scope  of  this  paper. 

In  section  2  a  brief  review  of  different  libraries  foe  supercomputers 
will  be  given.  Since  most  work  on  adapting  libraries  to  supcrcom 
puter  architectures  has  been  done  in  the  area  of  linear  algebra 
this-is  discussed  in  greater  detail  in  section  3.  In  the  concluding 
remarks  some  items  missing  in  todays  subroutine  libararies  are 
listed  and  a  proposal  for  future  library  developments  on  super¬ 
computers  isgiven. 

2  Numerical  Libraries.for  Supercomputers 

Iwo  groups  of  numerical  subroutinedibraries  for  supercomputers 
must  be  distinguished: 

•  Libraries  developed  by  hardware  manufacturers  and  being 
a  part  of  the  software  environment  on  a  given  computer 
system, 

•  Libraries  developed  by  software  vendors  (c.g.  IMSL  and 
NAG)  which  arc  in  general  available  on  a  wide  range  of 
different  computer  systems. 

2.1  Libraries  from  Computer  Manufacturers 

Cray:  SCILIB  The  Scientific  Library  (SCILIB),  release  5.0, 
contains  programs  from  three  different  areas:  linear  algebra,  Fast 
Fourier  Transforms  (FFT)  and  searching  and  sorting.  The  linear 
algebra  chapter  comprises  all  level  1,  level  2  and  level  3  BLAS 
as  described  in  [6,  I,  2)  except  those  level  2  BLAS  for  packed 
matrices.  Also  optimized  versions  of  LINPACK  and  EISPACK 
arc  included  in  SCILIB.  There  arc  routines  for  single  and  multiple 


FFT’s,  the  routines  doing  multiple  transforms  are  of  mixed  radix 
type  allowing  radices  2,  3,  5  and  7.  A  random  number  generator 
is  included  in  the  runtime  library  of  the  compiler. 

IBM:  ESSL  The  Engineering  and  Scientific  Subroutine  Library 
(ESSL)  from  IBM  is  available  in  a  vector  as  well  as  in  a  scalar  ver¬ 
sion  running  on  any  IBM  mainframe.  In  addition  to  the  chapters 
on  linear  algebra,  FFT,  sorting  and  searching  some  other  routines 
for  interpolation,  numerical  quadrature,  random  number  genera¬ 
tion  and  parallel  processing  are  included  in  this  library.  Only  a 
subset  of  level  2  and  level  3  BLAS  are  available.  But  the  linear 
algebra  chapter  contains  some  routines  for  solving  sparse  linear 
systems  by  direct  or  iterative  methods. 

Fujitsu/Siemens.  SSL  II  and  supplemenents  Fujitsu's 
SSL  II  library  is  supplemented  by  Siemens  with  a  complete  set  of 
all  three  levels  of  BLAS,  a  set  of  FFT  routines  and  random  num¬ 
ber  generators.  Together  with  these  supplements  SSL  II  seems  to 
be  the  most  comprehensive  library  from  a  supcrcomputer^manu- 
facturcr.  The  linear  algebra  chapter  contains  several  routines  for 
solving  linear  systems  and  eigenvalue  problems.  There  are  routi¬ 
nes  for  nonlinear  equations,  minimization,  interpolation  and  ap¬ 
proximation,  Fourier  and  Laplace  transforms,  differentiation  and 
quadrature,  ordinary  differential  equations,  special  function  ap¬ 
proximation  and  random  number  generation. 

2.2  Standard  Numerical  Libraries 

While  the  manufacturer  supplied  subprogram  libraries  are  avai¬ 
lable  only  on  specific  computer  systems,  standard  mathematical 
subprogram,  libraries  like  IMSL/MATII  library  from  IMSL  Inc. 
and  NAG  Fortran  library  from  the  Numerical  Algorithms  Group 
Ltd.  are  available  on  a  wide  range  of  computer  systems  ranging 
from  PC’s  to  supercomputers.  So  program  development  and  small 
production  runs  can  be  done  on  a  workstation  while  large  produc¬ 
tion  runs  are  executed  on  a  supercomputer.  The  identical  program 
can  be  executed  in  differciit  supercomputer  environments. 
Versions  of  these  libraries  arc  available  for  the  most  important 
supercomputers  like  CRAY  Y/MP,  CRAY  2,  IBM  3090  VF,  NEC 
SX-scries  or  Fujitsu/Siemens  VP-scrics. 

These  libraries  have  not  been  designed  for  use  on  supercompu¬ 
ters  from  their  starting  point.  But  during  the  last  years  IMSL  as 
well  as  NAG  have  spent  much  work  in  adapting  the  libraries  to 
achieve  efficient  implementations  on  supercomputers.  This  must 
been  done  while  maintaining  the  portability  of  the  library,  i.c. 

•  The  user  interface  of  library  routines  must  not  be  changed. 
But  the  user  interface  of  new  routines  which  arc  introduced 
into  the  library  may  be  choosen  to  allow  efficient  vcctoriza- 
lion. 

•  The  source  code  of  library  routines  should  be  identical  on 
all  cumputcr  systems  as  far  as  possible.  This  is  necessary 
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in  order  to  guarantee  the  quality  of  the  software  and  to 
maintain  the  software  over  a  long  life  cycle. 

Both  libraries,  IMSL  as  well  as  NAG,  have  a  much  broader  con¬ 
tents  than  the  libraries  from  supercomputer  manufacturers.  They 
comprise  programs  for  solving  systems  of  linear  or  nonlinear  equa¬ 
tions,  eigensystem  analysis,  interpolation  and  approximation,  in¬ 
tegration  and  differentiation,  differential  and  integral  equations, 
Fourier  and  Laplace  transforms,  linear  and  nonlinear  optimisa¬ 
tion,  special  function  approximation  and  a  lot  of  utility  functions. 
Besides  this  many  statistical  capabilities  for  data  analysis  are  in¬ 
cluded.  The  routines  from  linear  algebra  chapters  in  most  cases 
handle  dense  matrices,  and  a  few  routines  in  NAG  library  are  avai¬ 
lable  for  sparse  matrices,  and  IMSL  library  contains  two  routines 
for  iterative  solution  of  linear  systems  which  operate  on  sparse 
matrices. 

3  Adapting  Libraries  for  Supercomputers 

Work  on  adapting  standard  numerical  libraries  to  the  architecture 
of  supercomputers  must  concentrate  on  those  areas  where  most 
computing  time  is  spent.  These  are  linear  algebra,  FFT  and  so¬ 
lution  of  differential  equations.  An  overview  of  vectorizing  NAG 
and  IMSL  library,  is  given  in  [3]  resp.  (7). 

Besides  rcstucturing  of  existing  library  routines  new  programs 
have  been  introduced  into  the  libraries,  especially  into  the  NAG 
library,  which  are  well  suited  for  vcctorization.  So  new  routines 
for  numerical  quadrature  and  solution  of  differential  equations 
have  been  incorporated  which  evaluate  function  values  at  many 
grid  points  in  one  subroutine  call.  Calling  an  external  subprogram 
to  evaluate  only  one  function  value  would  disturbe  vcctorization 
and  would  increase  the  CPU  time  significantly.  Also  new  routines 
for  FFT,  doing  several  transforms  in  parallel  have  been  included. 
This  gives  in  general  greater  vector  lengths  and  higher  speed  ups 
on  vector  computers. 

In  order  to  improve  the  efficiency  of  library  routines  on  supercom¬ 
puters  a  hierarchical  programming  concept  must  be  applied.  It  is 
necessary  to  identify  the  most  time  consuming  parts  of  programs 
which  arc  general  enough  to  be  put  into  a  library  subset  that  can 
be  modified  and  tuned  for  a  specific  supercomputer. 

3.1  Linear  Algebra 

Basic  Linear  Algebra  Subprograms  (BLAS)  have  been  defined  in 
[6,  1,  2]  and  arc  widely  recognized  as  a  standard.  Level  2  BLAS 
contain  routines  for  matrix-vcctor-multiplicalion  of  rectangular, 
triangular,  symmetric  or  hermitian  matrices,  rank-one-  and  rank- 
two-  updates  of  rectangular,  hermitian  or  symmetric  matrices  and 
solufion  of  linear  systems  with  triangular  coefficient  matrix.  Ma¬ 
trices  may  be  stored  in  different  storage  modes  (general,  banded 
or  packed).  Level  3  BLAS  contain  similar  routines  for  matrix- 
matrix-operalions:  matrix-matrix-multiplication  of  rectangular, 
symmetric,  hermitian  or  triangular  matrices,  rank-k-  and  rank- 
2k-updatcs  of  hermitian  or  symmetric  matrices  and  solution  of 
linear  systems  with  triangular  coefficient  matrices  and  multiple 
right  hand  sides.  Carefully  optimized  versions  of  these  routines 
arc  being  supplied  by  most  supercomputer  manufacturers.  Usage 
of  these  optimized  BLAS  will  result  in  portable  and  very  efficient 
software. 

In  the  current  vc  <vn  of  IMSL-  and  NAG-library  linear  algebra 
routines  arc  based  on  level  2  BLAS  and  a  few  routines  already 


use  levcl  3  BLAS.  In  the  next  releases  level  3  BLAS  will  be  used 
more  intensively. 

Table  1  shows  the  performance  of  some  library  routines 
for  solving  a  system  of  linear  equation  based  on  LV 
factorization.  L2TRG/LFSRG  from  IMSL,  F0-1AAF  from  NAG, 
SGEFA/SGESL  from  SCIL1B,  DLAX  from  SSL  II  and 
DGEF/DSEL  from  ESSL.  In  all  cases  the  array  containing  the 
matrix  has  been  defined  with  an  i  id  leading  dimension  in  order 
to  minimize  memory  bank  conflicts. 


Computer 

Library 

matrix  size 

100 

200 

300 

400 

500 

Siemens 

SSL  II 

155 

322 

439 

518 

577 

S400/10 

NAG 

147 

395 

638 

816 

972 

IMSL 

120 

354 

582 

762 

918 

CRAY  Y-MP 

SCILIB 

100 

128 

137 

145 

145 

NAG 

104 

168 

202 

223 

238 

IMSL 

114 

197 

238 

258 

267 

IBM  3000  S 

ESSL 

46 

65 

75 

80 

83 

VF 

NAG 

29 

50 

61 

67 

72 

IMSL 

34 

51 

60 

63 

65 

CRAY  2 

SCILIB 

134 

214 

228 

253 

284 

NAG 

35 

34 

41 

75 

80 

IMSL 

24 

31 

54 

40 

67 

Table  1.  Performance  of  LU-factorization  in  MFLOP/s 

Table  2  shows  similar  results  for  Cliolesky-factorization,  using 
LF1DS/LFSDS  from  IMSL,  F03AEF/F04AGF  from  NAG, 
SP0FA/6P0SL  from  SCILIB,  DVLSX  from  SSL  II  and 
LPPF/DPPS  from  ESSL.  Again  the  leading  dimension  of  the 
array  is  odd  except  DVSLX  and  DPPF/'DFPS  which  accept  the 
matrix  in  packed  storage  mode  in  a  one-dimensional  array. 


Computer 

Library 

matrix  size 

100 

200 

300 

400 

500 

Siemens 

SSL  11 

144 

316 

434 

518 

582 

S  400/10 

NAG 

96 

240 

366 

458 

538 

IMSL 

99 

308 

507 

580 

672 

CRAY  Y-MP 

SCILIB 

51 

80 

85 

10S 

108 

NAG 

119 

191 

226 

248 

261 

IMSL 

119 

208 

246 

267 

277 

IBM  3090  S 

ESSL 

48 

71 

80 

86 

89 

VF 

NAG 

40 

63 

60 

59 

59 

IMSL 

26 

47 

58 

60 

57 

CRAY  2 

SCILIB 

26 

35 

38 

41 

42 

NAG 

44 

55 

67 

114 

126 

IMSL 

40 

80 

63 

62 

72 

Table  2-  Performance  of  Cholcsky-factorization  in  MFLOP/s 

In  order  to  study  the  behaviour  of  these  routines  in  case  of  badly 
dimensioned  arrays  the  same  programs  have  been  executed  on 
Siemens  S  100/10  and  CRAY  Y  MP  for  matrices  of  size  256  and 
512  with  different  leading  dimensions.  The  results  arc  given  in 
table  3  and  indicate  that  the  right  selection  of  leading  dimensions 
in  tiic  calling  program  can  increase  the  performance  significantly. 

Similar  results  as  those  reported  in  tables  1,  2  and  3  can  be  obtai 
ned  for  other  linear  algebra  routines  showing  that  the  performance 
of  routines  from  standard  numerical  libraries  like  IMSL  and  NAG 
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Computer  Library 

LDA  =  N 

LDA  =  -N+l 

256 

512 

256 

512 

LU-factorization 

Siemens  SSL  II 

59 

64 

393 

578 

S  400/10  NAG 

259 

465 

539 

978 

IMSL 

256 

491 

487 

926 

CRAYY-MP  SCILIB 

136 

153 

139 

148 

NAG 

175 

227 

190 

239 

IMSL 

127 

147 

226 

272 

Cholesky-factorizafcion 

Siemens  SSL  II 1 

388 

5S8 

3S8 

588 

S  400/10  NAG 

236 

426 

307 

543 

IMSL 

233 

479 

428 

676 

CRAYY-MP  SCILIB 

42 

46 

96 

125 

NAG 

210 

258 

216 

262 

IMSL 

203 

255 

235 

279 

1  This  routine  uses  a  one 

-dimensional  array  to  store  ] 

the  matrix. 

Table  3:  Effect  of  leading  dimension 

is  in  general  as  good  or. even  Letter  Ilian  the  perfurmanee  of.rou 
tines  from  other  libraries.  In  most  cases  these  routines  give  good 
performance  over  a  wider  range  of  parameters  (e.g.  array  dimen¬ 
sioning).  But  a  prerequisite  is  the  usage  of  carefully  optimized 
BLAS.  Only  on  IBM3090  VF  the  routines  from  ESSL  run  about 
20%  faster  than  routines  from  other  libraries. 

3.2  Fast  Fourier  Transforms 

A  comparison  of  the  performance  of  different  library  routines  for 
FFT  shows  much  greater  differences  than  in  the  area  of  linear 
.algebra  [5).  Table  <1  gives  timings  for  one  complex  FFT  of  varying 
length  on  a  Siemens  S  400/10.  Similar  performance  ratios  can  be 
found  on  other  supercomputers. 


N 

FFTVPLIB 

DFTCB1 

NAG 

C06FRF 

IMSL 

DF2TCF 

64 

0.029 

0.0  IS 

0.176 

128 

0.039 

0.056 

0.209 

256 

0.041 

O.OG8 

0.225 

512 

0.054 

0.103 

0.336 

1024 

0.092 

0.171 

0.531 

2048 

0.154 

0.382 

0.922 

4096 

0.322 

0.740 

1.698 

8192 

0.656 

1.495 

3.382 

15625 

1. 468 

1.602 

6.062 

16384 

1.203 

3.009 

6.598 

19683 

2.14S 

2.121 

9.966 

32768 

2.6S5 

12.216 

12.960 

65536 

5.456 

24.585 

25.874 

131072 

10.636 

50.105 

53.865 

262144 

21.746 

101.230 

108.094 

Tabic  4.  Timing  of  different  FFT-routmes  on  Siemens  S400/10 


4  Conclusion 

Subroutine  libraries  from  supercomputer  manufacturers  cover 
only  a  small  range  of  applications,  most  attention  has  been  gi¬ 
ven  to  linear  algebra  and  FFT.  But  in  the  field  of  linear  algebra 


standard  numericaF  libraries  give  equivalent  or  even,  better  per¬ 
formance.  This  demonstrates  that  well  defined  and  optimized  low 
level  routines,  in  tins  case  the  BLAS,  allow  the  development  of 
very  efficient  and  portable  software.  There  is  a  need  for  compa¬ 
rable  basic  routines  in  other  areas.  In  [4]  a  first  idea-for  a  set  of 
Basic  Operations  for  Fourier  Transforms  (BOFT)  is  given  which 
hopefully  will  play  a  similar  rule  for  applications  of  FFT.  Also  dis¬ 
cussions  on  sparse  level  2  BLAS  defining  matrix- vector-operations 
for  sparse  matrices  are  going  on.  As  with  the  BLAS  these  low  le¬ 
vel  routines  should  become  part  of  the  software  environment  of 
a  supercomputer.  This  is  the  basis  for  development  of  numerical 
libraries  and  application  programs. 

Today  there  are  some  open  problems  concerning  numerical  libra¬ 
ries  on  supercomputers: 

•  The  application  programmer  must  very  carefully  select  the 
appropriate  routine.  Sometimes  there  are  several  library 
routines  doing  similar  operations  but  using  different  data 
structures  which  may  influence  the  performance  signifi¬ 
cantly. 

•  When  passing  multidimensional  arrays  the  leading  dimen¬ 
sion  should  always  be  an  odd  number.  But  some  library 
routines  do  not  include  this  as  a  separate  item  in  the  para¬ 
meter  list. 

•  Within  one  library  the  performance  of  different  programs 
may  vary  significantly. 

•  Some  important  application  areas  (e.g.  solution  of  sparse  li¬ 
near  systems  or  sparse  eigenvalue  problems)  arc  not  covered 
by  library  routines. 
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Abstract:  The  supercomputer  in  combination  with  the  graphics  super¬ 
workstation  opens  a  new  simulation  technique.  The  scientific  visualization 
enables  computational  scientist  and  engineers  to  undertake  "human-in-the- 
loop"  problems  -  a  class  requiring  visualization  techniques  as  different 
from  photorealistic  computer  graphics  as  interactive  computing  is  from 
batch  processing.  The  developer  of  the  necessary  software  systems  that 
provide  true  "distributed  applications"  has  to  divide  the  application 
program  to  the  existing  resources  -  supercomputer,  network  and  graphics 
super-workstation. 

1.  Introduction 

The  new  series  of  powerful  supercomputers,  a  new  class  of  powerful 
workstations  and  the  high  speed  LAN's  in  combination  lead  to  a  new  Uass 
of  applications  called  "distributed  applications".  The  "graphics  super¬ 
workstations"  are  expected  to  play  an  increasingly  important  role  in 
providing  an  enhanced  environment  for  supercomputer  users. 

Their  potential  uses  include: 

:1.  Off-loading  the  supercomputer 

service  station  for  the  supercomputer  as  front-end  system  (input 

queue  -  output  queue  -  print  queue  management) 

pre-  and  postprocessing  of  the  input  and  output  of  supercomputer 

applications 

distributed  or  shared  processing. 

2.  Scientific. visualization 

understanding  of  results 
communication  of  results. 

3.  Real-time  interaction  with  the  supercomputer 

controlling  of  iterative  computations 

kill,  suspend  and  restart  of  supercomputer  jobs 

exploration  and  development  of  new  algorithms. 


2.  Status 

The  term  "graphics  super-workstation"  is  defined  here  to  refer  to  a 
category  of  workstations  introduced  in  1988  which  combine  high  quality 
graphics  with  very  powerful  computational  capability.  Typically,  such 
workstations  provide  from  1/10  to  1/100  the  floating  point  speed  of  the 
most  powerful  current  supercomputers,  they  have  large  main  memories 
(16  -  256  MBytes)  and  are  capable  of  generating  and  manipulating 
realistic,  three-dimensional:  graphic  displays.  In  combination  with  high 
speed  LAN’s  it  is  possible  to  exchange  data  very  fast  between- the 
different  computers  in  the  LAN  and  the  workstation  memory.  The  work¬ 
station  provides  a  very  rapid  movement  of  data  between  memory,  disk 
storage,  computational  units  and  graphics  hardware.  The  extensive  system 
and  application  software  provides  users  with  a  powerful  and  convenient 
working  environment.  In  the  following  table  typical  graphics  and  display 
manipulation  characteristics  will  be  specified.  In  the  second  column  of 
table  1  the  actual  capabilities  of  the  workstation  installed  in  the  computing 
center  of  the  University  of  Karlsruhe  will  be  presented. 


typical  graphics 
super  workstation 

workstation  of  the 
University  of  Karlsruhe 

screen  display 

19"  color  monitor 
resolution 

1280-1024 

19"  color  monitor 
resolution 

1280-1024 

image  bit- 
planes 

;  16-32  bit  Z-buffer 
-24  bit  color  planes 
^provision  for 
double  buffering 

2048-1024/plane 

8  planes,  4  overlay 
rplanes 

16  bit  Z-buffer 
:  16.7  Mio  colors 

display  speed 

500.000  3D  v  colors,  sco 
150.000  couraud- 
shaded,  Z -buffered 
triangles/sec 

130.000  Phong-shaded, 
Z-buffercd  triangles/sec 

240.000  3D  veUors.se>. 
50.000  triangles/sec 
without  light-source 
38.000  triangles/sec 
with  light  source 

surface  geom¬ 
etry 

approximation 

(primitives) 

polygons,  triangular 
strip  meshes,  NURBS 

polygons,  vectors, 
triangular  strip  meshes, 
NURBS  (order  of  6) 
dithering,  back  facing 
cull 

shading, 

lightings, 

rendering 

Flat-,  Phong-,  Gou- 
raudshading,  texturing, 
transparency,  specular 
highlighting,  ray  trac¬ 
ing 

Flat-,  Phong-,  Gou- 
raudshading,  radiosity, 
advanced  hardware, 
lighting,  transparency, 
ray  tracing  (optional) 

Table  1:  Typical  graphics  capabilities  and  values  of  the  univer¬ 

sity  workstations 


Table  2  shows  the  typical  values  of  a  graphics  super-workstation  hardware 
and  in  the  second  column  the  corresponding  values  of  the  university 
machines. 

The  supercomputer  performance,  mainly  the  very  fast  floating  point 
pipelines  with  a  peak  performance  of  5  GFIops  and  the  large  main 
memory  of  2  GByte  is  the  reason  that  we  need  powerful  peripheral 
workstations  with  super  graphic  capabilities  to  prepare  the  supercomputer 
results  or  to  steer  die  simulation.  Supercomputing  is  currently  in  the 
gigaworld  era.  Unfortunately,  we  may  also  be  confronted  with  GBytes  of 
output.  This  may  occur  not  only  from  scientific  problems  that  deal  with 
very  large  amounts  of  input  data,  but  also  as  output  data  from  solutions 
to  mathematical  equations  representing  physical,  chemical  or  technical 
processes. 

At  the  third  IFIP  International  Conference  on  Data  Communication 
Systems  and  their  Performance  an  empirical  ratio  of  approximately  100 
Bytes  of  output  per  MFlops  of  calculation  was  found.  Hence,  as  we 
approach  processing  power  of  5  GFIops  of  our  Siemens  S600/20  vector- 
computer,  and  a  simulation  time  of  2000  seconds,  this  empirical  ratio 
would  predict  the  following  output: 
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100  Bytes/Mflops  •  5  •  10'  MFIops/scc  •  2000  sec  = 
I  GByte 


typical  graphics 
super-workstation 

workstation  of  the 
University  of 
Karlsruhe 

number  of  processing 
units,  floating  point 
units 

1-4  vectof.floatmg 
point  pipes 

1  central  processing 
unit  without  vector 
capability 

vector  or  floating 
point  performance 

5-30  MFlops 

2  MFlops  (BLAS) 

integer  processing 

10-80  Mips 

14  Mips 

cache  memory 

1  MByte 
(1  GByte/sec) 

128  KByte 

main  memory 

16-128  MByte 
(300  MByte/sec) 

16-24  MByte 

I/O  channels 

80-100  MBit/sec 

60  MBit/sec 

disc  storage 

300-2000  MByte 

300-1200  MByte 

Table  2:  Workstation  hardware 


In  the  computing  center  we  can  have  up  to  10  jobs  per  day  of  this  1/2 
hour  type,  so  we  produce  data  output  in  an  order  of  10  GByte/day.  These 
types  of  jobs  are  large  scale  calculations  in  the  fields  of  finite  element 
structural  analysis,  fluid  dynamics  involving  repeated  iterations  over  a 
spatial  grid,  and  ab  initio  computational  chemistry  involving  determination 
of  eigenvalues  of  very  large  sparse  matrices  and  multi-dimensional 
integrations. 

The  driving  sources  for  increased  processing  speed,  main  memory  and 
disc  storage  are  the  physical  realism,  the  increased  dimensionality  and  the 
data  volume.  Realistic  representation  of  physical  or  technical  systems  may 
increase  geometric  complexity  or  eliminate  simplifying  approximations. 
On  the  other  side,  the  dimensionality  of  a  problem  is  not  limited  to  the 
physical  dimensions  and  the  time,  but  more  generally  represents  the  num¬ 
ber  of  degrees  of  freedom  that  must  be  considered  as  in  the  number  of 
grid  points  in  a  computational  fluid  dynamics  problem  or  the  number  of 
finite  elements  in  a  structural  analysis  problem. 

Scientific  problems  of  the  departments  of  the  University  of  Karlsruhe  that 
are  driving  forces  for  the  increase  in  computational  power  are. 

Computational  Fluid  Dynamics  (including  turbulence; 

Structural  Analysis  (finite  elements,  nonlinear  analysis,  different 
materials,  eigenvalues,  modification  of  the  geometry) 

Physics/Chemistry  (molecular  dynamics,  ab  initio  quantum 
chemistry,  surface  chemistry,  statistical  mechanics,  astrophysics) 

Material  Science  (superconductivity,  sinter  materials,  materials  by 
design) 

Seismology 

Climate-  and  local  weather  simulation  (environmental  influences) 


Structural  analysis  or  computational  fluid  dynamics  are  typical  engineering 
problems  requiring  a  vector  computer  for  the  solution  of  the  discretizised 
system  using  the  finite  element  method  employed  in  many  commercially 
available  codes  as  ADINA,  F1DAP  or  LS  Dyna  3D.  An  example  of 
graphical  output  is  shown  in  figure  1.  The  3D  turbulent  flow  around  a  car 
has  been  computed  on  the  Siemens/Fujitsu  S600/20  supercomputer  using 
FIDAP  and  the  results  are  visualized  on  the  workstation. 


Generating  the  spatial  discretization  into  different  elements  is  done  as 
preprocessing  using  a  workstation  freeing  the  supercomputer  for  the 
numerical  intensive  part  of  the  analysis. 


3.  Graphics  Super-Workstation  in  a 
Supercomputing  Environment 

The  supercomputer  of  the  University  of  Karlsruhe  is  needed  to  solve 
important  scientific  problems.  The  supercomputers  of  the  future  are 
needed  to  solve  problems  that  presently  cannot  be  done  at  all  and  should 
be  designed  and  used  for  this  purpose.  The  new  generation  of  powerful 
workstations  of  the  university  provide  a  logical,  cost-effective  and  user¬ 
time-effective  alternative  to  shared  supercomputers  and  indeed  this  is  one 
of  their  appropriate  and  important  -oles  in  a  supercomputing  environment 
shown  in  figure  2.  The  increase  in  computational  capability  should  not  be 
the  result  of  the  aggregate  demands  of  many  users  each  of  whom  may 
need  only  a  small  amount  of  supercomputer  time. 


Figure  2  Supcrcomputing  environment 


732 


Regarding  the  large  amount  of  results  and  output  data,  the  graphics  super 
workstation  can  also  play  the  role  of  a  'filter'.  Only  the  necessary 
information  to  detect  new  phenomena  arrives  at  the  workstation  screen. 
Along  with  processing  speed  and  larger  main  memories,  there  is  a  need 
for  increased  storage  and  communication  bandwidth.  The  present 
limitation  of  our  LAN's  of  about:140  Mbit/sec  is  restricted  but  adequate 
for  now,  however  the  existing  WAN's  (excluding  the  BELW'UE  link 
between  the  universities  of  Karlsruhe  and  Stuttgart;  are  totally  inadequate. 

The  telecommunication  bandwidth  required  by  a  supercomputer  is  mainly 
proportional  to  its  CPU  speed.  Table  3  shows  the  required  speeds  for 
transfer  of  different  items. 


application 

required  speed 

present  technique 

text 

XAVindows 

9.6  kBit/sec 

20  kBit/sec 

ISDN  (64  kBit/sec) 

color  graphics 
file  transfer  (FTP) 
NFS 

1-2  MBit/sec 

>  1  MBit/sec 

>  2  MBit/sec 

Ethernet 
(10  MBit/sec) 

simulation 
visualization 
(8  pictures/sec) 

64  MBit/sec 

FDDI  (100  MBit/sec) 
ISDN-B  (140  MBit/sec) 

animation 

1-10  GBit/sec 

Ultranet  (800  MBit/sec), 
frame  buffer 

Table  3:  Speeds  for  transfer  of  different  items 


The  problem  of  mass  storage  is  even  more  limiting  (University  super¬ 
computer  disc  storage  capacity  ~  40  GByte,  compare  with  expected 
output  for  advanced  simulations)  and  there  are  few  promising  technologi¬ 
cal  developments  on  the  horizon. 

The  only  hope  to  overcome  these  problems  is  to  find  out  a  new  way  in 
which  we  make  use  of  supercomputers  so  as  to  effect  a  drastic  reduction 
in  the  amount  of  data  that  needs  to  be  stored  or  transferred.  This  requires 
a  fundamental  new  kind  of  scientific  simulation  technique.  The  emergence 
of  graphics  super  workstation  offers  an  opportunity  to  enable  that  essential 
change  in  methodology. 

Today  the  typical  solution  sequence  of  a  simulation  includes  the  following 
steps: 

Physical  System  description 
Mathematical  model 
Vector  Algorithm 
Calculation 
Analyze  Results 
Presentation  of  Results. 


The  handling  of  these  steps  in  a  sequential  top-down  manner  must  be 
replaced  by  a  new  simulation-technique  using  the  capabilities  of  the 
graphic  super-workstations.  Graphics  super-workstations  can  be  utilized 
further  "upstream"  in  the  process  as  part  of  the  calculation  itself.  Their 
specialized  hardware  and  architectural  properties  can  be  used  effectively 
in  conjunction  with  the  supercomputer  in  a  distributed  processing  system 

However,  the  availability  of  X-windows  on  workstations  and  supercom¬ 
puters  not  only  enables  a  user  to  watch  the  progress  of  a  computation  - 
and  if  necessary  abort  a  bad  run  -  but  permits  the  user  to  interact  the 
computation  in  process.  The  scientist  can  modify  parameters,  such  as  step 
size,  grid  spacing,  damping  terms,  etc  and  also  change  the  solution 
algorithm.  Human  interaction  with  the  supercomputer  by  means  of 
powerful  graphics  super-workstation  will  also  enable  or  facilitate  the 
solution  of  computationally  difficult  problems  where  the  intervention  of 
a  human  is  a  key  or  possibly  essential  part  of  the  simulation.  Examples 


include  algorithms  with  different  data  storage  techniques,  systems 
containing  multiple  extrema  where  global  extremum  is  desired  and 
iterative  processes  that  converge  very  slowly. 

In  these  examples,  the  scientist  becomes  an  essential  part  of  the  simula¬ 
tion.  The  user  acts  at  a  very  high  level  by  serving  as  pan  of  a  complicated 
nonlinear  feedback  loop,  by  using  the  knowledge  of  physical  behavior  not 
included  in  the  program -code  or  by  detecting  trends. 

4.  Technical  aspects  of  "Distributed  Applications" 

The  technical  realization  of  distributed  applications  must  be  based  on  the 
existent  hardware  systems,  the  not  yet  fully  standardized  networks,  the 
different  operating  systems  and  the  different  graphical  standards. 
Standardization  is  a  difficult  task  involving  quite  a  number  of  organiza¬ 
tions  (ISO,  IEEE,  CCITT,  ANSI,  DIN),  competing  manufacturers  and 
specialists  and  will  take  time  and  an  still  evolving  market  The  require¬ 
ments  of  the  parts  of  the  distributed  system  are  shown  in  table  4. 


supercomputer 

communication 

services 

workstation 

operating  system: 

remote  login 

operating  system: 

UNIX  System  V 

remote  job  entry 

UNIX  System  V, 

.  Berkeley  Extens. 

remote  monitoring 

Berkeley  Extens., 

remote  printing 

OSF/1 

networks: 

file  sharing  (NFS) 

networks: 

Ultranet 

file  transfer  (ftp) 

Ultranet 

High  speed  I/O 

connecting 

FDDI 

(HIPPI) 

FDDI 

Ethernet 

Channels 
(Hyper,  IBM) 

(TCP,  UDP  /IP) 
auxiliary  services 

Ethernet 

languages: 

distributed 

languages: 

FORTRAN  + 

processing 

FORTRAN,  C, 

vector  extensions 

remote  procedure 
calls  (RPC) 

C+  +  (object 
orientated) 

graphical  standards. 

remote  windowing 

graphical  standards. 

XU,  Motif 

network  computing 

XI 1,  Motif,  GKS, 

GKS,  PHIGS 

(NCS) 

PHIGS,  PEX, 
Starbase,  HPGL 
different  picture 
interchange  formats: 
IGES,  GIF,  PCX, 
CGM 

Table  4:  Technical  requirements 


5.  Conclusion 

Today's  supercomputers  produce  torrents  of  data,  but  the  human  brain 
still  interprets  numerical  data  as  poorly  as  it  always  has.  Scientists  and 
engineers  need  an  alternative  to  numbers  and  that  alternative  is  images. 

The  overview  of  the  characteristics  and  capabilities  of  currently  available 
graphics  super-workstations  showed  that  one  of  the  most  important 
activities  in  a  supercomputing  environment  was  the  analysis  and  interpre¬ 
tation  of  large  masses  of  complex  information. 

The  role  of  the  graphics  super-workstation  in  a  supercomputing  environ¬ 
ment  is  absolutely  essential  to  insure  the  integrity  of  analysis,  to  provoke 
insights  and  to  empower  the  human  as  an  essential  component  of  the 
simulation. 
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Abstract  We  address  the  problem  of  benchmark¬ 
ing  supercomputers  with  the  aid  of  synthetic  programs. 
While  not  modelling  an  actual  workload  this  approach 
has  the  advantage  of  providing  more  general  information 
about  the  capabilities  of  the  systems  under  con~ideration. 
We  will  review  some  benchmarking  models  and  present 
the  EuroBen  benchmark  as  an  example  of  a  benchmark 
set  that  yields  a  performance  profile  which  cnaLles  the 
identification  of  the  strong  and  weak  points  of  a  machine 
in  terms  of  a  range  of  applications  and  their  constituent 
algorithms. 

I.  INTRODUCTION 

In  this  contribution  we  focus  on  the  performance  of  su¬ 
percomputers.  A  problem  encountered  with  these  systems 
is  the  large  variety  in  their  architecture.  These  can  range 
from  large  vector  computers  with  a  limited  amount  of  pro¬ 
cessors  that  share  a  common  memory  to  machines  with 
thousands  of  very  simple  processors  and  distributed  mem¬ 
ories.  Thiscan  lead  to  an  enormous  performance  range, 
sometimes  potentially  a  fa.  tor  cf  thousand  or  more,  de¬ 
pending  on  the  suitability  of  a  certain  piece  of  code  for 
the  underlying  arcnitecture. 

There  are  several  ways  to  deal  with  this  problem, 
leading  to  different  ways  of  benchmarking.  Three  main 
ways  can  be  identified:  Theoretical  benchmarking,  Syn¬ 
thetic  benchmarking,  and  Practical  benchmarking  [12], 
We  will  briefly  discuss  the  various  approaches  and  their 
particular  advantages  and  drawbacks  in  the  next  three 
sections.  In  addition,  in  section  V  we  will  d:scuss  one 
synthetic  benchmark,  the  EuroBen  benchmark,  in  more 
detail. 

II.  THEORECTICAL  BENCHMARKING 

Theoretical  benchmarking  is  aimed  at  the  muddling  of  the 
performance  behaviour  of  machines  with  regard  to  their 
constituent  components.  Tli.se  machine  may  or  may  not 
exist.  In  fact,  this  kind  of  modelling  is  often  used  to  esti¬ 
mate  trade-offs  between  performance  and  the  application 
of  more  or  different  hardware  components,  more  or  less 
expensive  technology,  etc.  Mostly,  probabilistic  models 
arc  used  to  estimate  the  influence  of  the  various  compo¬ 
nents.  As  supercomputers  tend  la  lc  mote  complex  than 
their  more  conventional  counterparts  the  composition  of 
theoretical  benchmarks  also  is  much  more  difficult  and 
one  often  has  to  rely  on  simulators  to  acquire  the  desired 
information.  This  branch  of  benchmarking  is  more  or  less 
becoming  a  discipline  in  itself  with  journals  like  Perfor¬ 
mance  Evaluation  as  an  example  of  the  interest  in  this 


field  and  a  growing  number  of  publications  in  other  jour¬ 
nals  (see  for  instance  [1],  [5],  [8],  [11]). 

An  obvious  advantage  of  the  theoretical  approach  is 
one  often  is  able  to  simulate  machine-  or  component  be¬ 
haviour  at  a  fraction  of  the  time  and  price  of  actually 
building  such  a  system.  For  existing  machines  a  cor¬ 
rect  theoretical  benchmark  may  adequately  predict  up- 
perbounds  and  even  performance  profiles  for  various  pat¬ 
terns  of  utilisation  of  the  components. 

A  drawback  is  the  difficulty  of  designing  good  theo¬ 
retical  benchmarks,  especially  for  very  complex  behaviour 
large  multi-user  supercomputers.  In  most  cases  one  has 
to  be  satisfied  with  the  limited  understanding  obtained 
for  isolated  subsystems  without  being  able  to  relate  this 
to  the  total  performance  of  the  system.  In  addition,  rela¬ 
tively  small  changes  in  the  architecture  of  a  machine  may 
be  difficult  to  incorporate  in  the  machine  model  to  be 
evaluated  In  all,  theoretical  benchmarking  is  a  very  diffi¬ 
cult  (but  sometimes  rewarding)  approa.li  to  performance 
evaluation. 

III.  SYNTHETIC  BENCHMARKING 
Synthetic  benchmarking  consists  of  the  running  of  one  or 
more  program  kernels  from  which  the  performance  of  a 
system  should  be  derived.  The  practice  of  running  such 
synthetic  programs  is  very  easy  in  comparison  to  theoreti¬ 
cal  benchmarking  or  the  practical  benchmarking  to  be  dis¬ 
cussed  later.  T  his,  and  the  fact  that  many  “ready-made” 
benchmarks  exist  ([3, 10]),  has  made  it  very  popular.  Yet, 
although  easy  to  run,  the  interpretation  and  the  signifi¬ 
cance  of  the  results  for  a  particular  test  site  are  often  far 
from  straightforward  [4,  6].  Especially  with  supercom¬ 
puters  one  has  to  be  very  careful  in  addressing  all  aspects 
of  the  machine(s)  at  hand  and  one  should  refrain  from 
judging  such  systems  from  just  one  parameter  which  sup¬ 
posedly  would  represent  the  performance  of  the  system. 
Regrettably ,  this  is  a  cm.uion  practice  with  many  vendors 
which  in  this  way  are  able  to  "prove”  the  relative  supe¬ 
riority  of  their  systems.  We  will  discuss  better  synthetic 
procedures  in  section  V. 

The  advantages  of  synthetic  benchmarking  arc  al¬ 
ready  made  clear,  the  testing  procedure  is  relatively  easy 
(although  the  design  of  a  good  synthetic  benchmark  is 
not).  Synthetic  benchmarking  also  is  flexible,  when  new- 
architectures  emerge  one  can  modify  or  extend  an  exist¬ 
ing  benchmark  set  easily  to  address  new  architectural  fea¬ 
tures.  In  addition,  when  performed  with  care,  the  bench- 
maik  m.iy  yield  more  general  information  than  just  per¬ 
formance  figures  for  particular  programs. 

Apart  from  the  danger  of  misinterpretation  that  al- 
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ready  has  been  mentioned,  sy  nthetic  benchmarks  caai.ov 
claim  to  give  definive  answers  in  selection  procedures  for 
a  particular  site.  In  this  case  one  has  to  Jo  additional 
benchmarking  that  more  precisely  reflects  the  workload 
of  that  site  and  possibly  the  variations  in  and  evolution  of 
this  workload.  So,  although  synthetic  benchmarking  may 
help  in  the  preselection  stage  arid  in  acquiring  a  general 
understanding,  one  has  to  complement  it  with  site-specific 
testing  procedures. 

IV.  PRACTICAL  BENCHMARKING 
Practical  benchmarking  is  employed  to  obtain  the  spe¬ 
cific  answers  concerning  a  systems  appropriateness  for  a 
particular  site.  In  this  case  a  typical  workload  for  that 
site  can  be  run  on  such  a  system  and  usually  one  al¬ 
ready  has  a  detailed  knowledge  about  configuration  re¬ 
quirements  and  the  total  software  environment  that  has 
to  present.  Because  of  the  very  specific  nature  of  these 
benchmarks  it  is  very  hard  to  make  general  statements 
about  the  methodology  beyond  the  most  trivial  ones:  one 
should  work  with  a  representative  workload,  memory-  and 
I/O-requirements  should  be  properly  heeded,  etc.  Conse¬ 
quently,  there  is  almost  no  literature  of  general  interest  on 
practical  benchmarking  (a  rare  example  is  [9]).  The  large 
architectural  differences  between  supercomputers  will  of¬ 
ten  frustrate  practical  benchmarking  because  it  is  impos¬ 
sible  to  port  a  complete  workload  to  these  systems  in  a 
way  that  allows  simple  comparison.  This  leads  to  the 
paradoxical  situation  that  where  a  clear  comparison  is 
most  needed  it  is  often  the  most  difficult  to  obtain.  In  this 
respect  synthetic  benchmarking  may  be  of  use  to  produce 
at  least  some  partial  answers. 

V.  THE  EuroBen  BENCHMARK 
In  June  1990  the  EuroBen  Group  was  founded  [7]  with 
the  objective  to  distribute  an  easily  portable  synthetic 
benchmark  set  in  Fortran  77  that  would  provide  the  user 
with  a  performance  profile  of  the  machine  to  be  tested. 
The  EuroBen  benchmark  is  a  European  effort  to  bring 
some  standardisation  in  the  rather  hectic  field  uf  synthetic 
benchmarking.  As  such  it  Is  certainly  not  the  only  effort. 
In  this  area  both  the  PERFECT  club  [2]  and  the  SPEC 
group  should  be  mentioned.  The  latter  communcales  its 
results  through  its  own  newsletter. 

The  EuroBen  benchmark  is  somewhat  different  from 
most  benchmark  sets  in  that  the  information  on  a  ma¬ 
chines’  capabilities  arc  obtained  In  a  hierarchical  way, 
i.e.,  the  benchmark  consists  of  modules  of  Increasing  com¬ 
plexity.  The  first  module  contains  tests  of  basic  opera 
tions,  combinations  of  operations,  and  intrinsic  functions 
while  also  issues  like  memory  bank  conflicts  and  mem¬ 
ory  contention  arc  addressed.  The  second  module  con 
tains  basic  numerical  algorithms  that  mainly  employ  op 
erations  as  tested  in  module  1.  This  enables  to  explain 
the  performance  of  these  algorithms  In  terms  of  the  results 
from  module  1.  Module  3  contains  more  extensive  algo¬ 
rithms  that  often  combine  several  algorithms  ft  j»*  mod 
ulc  2  (ODE-  and  PDE  solvers,  linear-  and  non-linear  least 


square  algorithms,  etc.).  Again  the  results  from  module  2 
and  module  1  can  be  used  here  for  explanation  of  the  re¬ 
sults  from module  3.  Module  4  contains  full  application 
programs  that  again  rely  on  the  previous  modules.  Since 
early  1931  there  is  an  effort  from  EuroBen  and  the  PER¬ 
FECT  club  to  integrate  their  benchmarks  in  the  sense 
that  the  PERFECT  benchmark  suite  will  act  as  module 
4  in  the  EuroBen  benchmark.  This  is  appropriate  as  the 
PERFECT  suite  only  contains  application  programs  and 
aims  at  the  same  diversity  in  application  areas  as  defined 
in  the  EuroBen  model. 
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Abstract  *  Recently,  the  biggest  increase  in  performance  -  measured  in 
"naked”  IPS  or  FLOPS  -  had  been  achieved  by  hardware  developments 
and  new  machine  architectures.  That  is  why  today  the  main  attraction  often 
is  the  architecture  of  new  systems.  In  ease  of  multiprocessing  systems  new 
results  will  be  expected  soon.  Anuiher  aspect  which  becomes  more  and 
more  important  is  the  quality  of  software.  For  economical  reasons  standard 
software,  c.g.  the  FORTRAN  programming  language,  is  prefered  radicr 
tlian  special  architecture  dependent  or  assembler  languages.  The  benefits 
are  caster  implementation,  better  portability  and  the  possibility  to  use 
universal  programs  and  libraries  on  different  machines.  Ponability  for 
example  is  very  important  since  the  life  cycle  of  application  software  lasts 
longer  Uian  die  innovation  time  of  hardware.  Consequently  die  FORTRAN 
programming  environments  for  some  supercomputers  from  CRAY,  IBM 
and  Fujitsu  are  presented.  The  optimizing  strategics  of  die  compilers  lor 
vectorizing  and  parallelizing  will  be  discussed  but  no  valuation  of  the 
efficiency  of  the  generated  code  will  be  made  because  this  strongly 
depends  on  the  underlying  hardware.  Besides,  some  language  extensions, 
compiler-directives  and  analysing  tools  are  presented.  Operating  systems 
will  be  focussed  briefly  since  they  build  the  missing  link  between 
runnable  programs  and  hardware. 

1,  INTRODUCTION 

After  a  general  survey  about  the  operating  systems  lor  supercomputers 
from  CRAY,  Fujitsu  and  IBM  the  compiler  systems  CRAY  CFT  77, 
Fujitsu  FORTRAN/VP  and  IBM  FORTRAN/VS  arc  presented  and 
compared  in  detail.  The  machines  from  CRAY  and  the  IBM  3090  x00 
series  arc  multiprocessor  computers  tightly  coupled  via  shared  memory. 
The  older  Fujitsu  VP  machines  are  monoproccssor  machines  but  the  new 
VP  machines  have  a  multiprocessor  option  and  enhanced  vector  units.  All 
machines  arc  vector  computers  widi  some  possibilities  for  parallelism 
provided  by  the  shared  memory.  Although  CFT  77  and  IBM  VS  have 
some  multitasking  capabilities,  their  main  goal  is  to  vectorize  rather  than 
parallelize  programs.  The  Fujitsu  VP  compiler  has  no  multitasking  features 
but  a  new  one  is  announced  which  will  support  the  new  multiprocessor 
architecture. 

In  addition  to  these  common  FORTRAN  systems  dial  arc  extensively  used 
in  production  environments  two  recent  developments  with  bettei  support 
for  parallelism  will  be  presented.  CRAYs  autoluskirig  system  CF77  and 
IBM's  PARALLEL  FORTRAN.  Both  systems  have  capabilities  to 
parallelize  work  automatically  and  powerful  extensions  for  explicit 
parallelism. 

Vectorizing  and  parallelizing  may  be  rcguarded  as  program 
transformations  which  change  the  order  of  statements  but  don't  change  the 
program's  semantics.  If  two  statements  share  some  inpul  or  output 
variables  -  cr'ed  a  data  dependency  -  they  must  not  be  interchanged. 
Therefore  the  autovcctorizing  or  autoparallclizing  compilers  analyse  these 
dependencies  before  they  change  the  order  of  statements.  There  arc  similar 
analysing  and  transformation  methods  for  parallelization  and  vcctorization. 

2.  OPERATING  SYSTEMS 

On  IBM  3090  mainframes  there  are  two  major  multiuser  operating 
systems:  MVS  and  VM.  MVS  is  a  multi-purpose  operating  system  which 
has  a  wide  functionality  and  is  used  in  scientific  and  commercial 
environments  as  well,  whereas  VM  is  commonly  used  in  scientific 
environments. 

MVS  (Multiple  Virtual  Storage)  is  designed  to  let  each  user  have  his  own 
addressing  room  which  is  extremely  protected  against  disturbance  from 
outside  of  the  user's  world.  Each  user  may  start  several  tasks  that  arc 


executed  concurrently  or  in  parallel  System  resources  arc  managed 
dynamically  by  MVS.  Thus,  MVS  supports  parallelism  in  an  efficient  way. 

VM  virtualizes  system  resources.  Each  use  1  his  own  personal  virtual 
machine  (VM)  which  is  separated  from  othc  .  s  but,  anyhow,  the  user 
may  initiate  communication  with  other  VM  .  These  VM's  send  their 
requests  to  a  control  program  (CP)  which  in  turn  carries  out  the  requested 
operations  Some  VM's  normally,  are  dedicated  as  batch  worker  machines 
to  realize  batch  processing  Parallelism  is  supported  by  assigning  several 
VM's  to  a  user  application  that  arc  working  independently. 

VSP/I  (Vector  System  Produci/Interauivej  for  Fujitsu's  vector  machines  is 
largely  compatible  with  MVS/XA  (user  arid  operator  interface,  job- 
control  but  not  binary  code)  VSP/I  has  some  extensions  concerning  vector 
processing  on  these  special  machines.  For  instance,  programs  under  MVS 
usually  operate  in  a  virtual  addressing  mode  but  in  VSP/I  all  vector 
programs  run  in  a  real  mode  the  whole  program  code  is  resident  m  main 
storage  Hence  the  vector  processor  never  waits  on  program  parts  to  be 
loaded  from  secondary  storage. 


The  newest  operating  system  for  CRAY  supercomputers  is  UNICOS 
which  is  based  on  AT&T  UNIX  SYSTEM  V.  UNICOS  has  some 
enhancements  to  UNIX  for  mainframe  supercomputers,  for  example  batch 
services,  accounting  tools  and  pcrfi  .manec  analysis  tools.  Above  all 
UNICOS  supports  the  multiprocessor  architecture  of  CRAY  machines. 

3.  STANDARD  FORTRAN  PROGRAMMING  ENVIRONMENTS 

3  1  THE  COMPILERS  CRAY  CFT  77,  FUJITSU  VP,  AND  IBM  VS 


Now  we  take  a  closer  look  at  the  compilers  CRAY  CIT  77,  Fujitsu  VP, 
and  IBM  VS  All  these  compilers  arc  autovcctorizing  compilers  based  on 
FORTRAN  77  standard  There  arc  language  extensions  with  CFT  77 
modelled  in  FORTRAN  8X  standard  Information  that  cannot  be  extracted 
by  syntactical  analysis,  for  example  vector  lengths  and  true  ratios  of 
logical  IF  statements  may  be  inserted  as  compiler  directives  into  the  source 
text.  These  directives  will  be  treated  like  comments  by  other  compilers. 
The  compiler  lining  can  be  helpful  when  optimizing  a  program.  All 
compilers  she  w  informations  about  the  optimizations  of  loops,  furthermore 
the  IBM  \  S  compiler  presents  all  loops  iri  a  source  to  source  modification. 
Hence  this  listing  could  be  a  vectorizing  tool  for  other  systems.  Tools  for 
run  time  analysis  arc  available  with  all  systems  except  IBM  VS  under 
VM/XA.  The  most  comfortable  is  VECTUNE  from  Fujitsu  which  allows 
interactive  analysing  on  lorn  and  statement  level.  Optionally  the  results  of 
this  analysis  may  be  taken  to  generate  compiler  directives  automatically. 


CFT  77 

Fuj.  VP 

IBM  VS 

auto¬ 

vcctorizing 

X 

X 

X 

auto¬ 

parallclizing 

cf  77 

planned 

- 

programmed 

multitasking 

X 

planned 

X 

vector  language 
extensions 

8X 

- 

- 

directives 

X 

X 

X 

analysing  tools 

X 

X 

only  MVS 

8X  =  FORTRAN  8X  standard 

cf77  =  possible  if  eft  77  is  embedded  in  cl77 

Table  3.1.:  compiler  equipment 
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3.2-' OPTIMIZING  METHODS  OF  AUTOVECTORIZING  COMPILERS 

The  quality  of  vectorizing  and  parallelizing  compilers  depends  decisively 
on  the  ability  of  analysing  arid  modifyingloops.  Nevertheless,  loops  with 
certain  data  dependencies  after  some  optimization  can  be  vectorized.  For 
instance  the  loops  with  the  data  dependencies  in  Table  3.2.1.  can  be 
vectorized  if  the  statements  are  exchanged. 

DO  10  I-1,N  DO  10  I-1,N 

...»  A  (I)  A(I)  -  .... 

A (1+1)  "...  ..."  A ( 1+1 ) 

10  CONTINUE  10  CONTINUE 

Table  3.2.1.:  data  dependence,  anti-dependence 

For  IF  statements  with  an  anti-dependence  that  cannot  be  reordered 
another  vectorizing  technique  may  be  chosen.  A  temporary  scalar  is 
introduced  which  is  expanded  to  a  vector  by  the  compiler  (see  Table  3.2.2) 

DO  10  I-1,N 
S  «■  A(I+1) 

A(I)  -  ... 

...  »  S 

10  CONTINUE 

Table  3.2.2.:  ariti-dcpcndcnce  after  insertion  of  a  temporary  scalar 

if  a  loop  contains  vcctorizablc  and  non-vcctorizablc  statements 
vectorizable  parts  have  to  be  separated  from  non-vcctorizablc  to  vectorize 
a  portion  of  the  loop.  This  is  called  partial  vectorizing.  Sometimes  it 
depends  on  the  value  of  a  variable  whether  a  lcop  is  vcctorizablc  or  not. 
With  the  conditional  vector  method  it  is  possible  to  generate  sequential  and 
vector-code  and  to  decide  at  nm-time  which  code  is  executed.  In  nested 
loops  statements  of  the  outer  loop  may  be  independent  from  those  of  inner 
loops.  Then  outer  and  inner  loops  may  be  spirited  into  two  loops  which  arc 
both  candidates  for  vcctorization  (loop  distribution).  The  vcctorization  of 
an  outer  loop  is  attractive  if  the  inner  loop  is  not  vcctorizablc  or  the 
vcctorization  of  the  outer  loop  is  simply  more  efficient,  for  example 
because  of  a  greater  vector  length.  This  implies  that  the  compiler  is  able  to 
analyse  whether  loops  can  be  interchanged  (loop  innermosting) 

For  a  logical  IF  statement-:  in  a  loop  there  arc  different  methods  for 
vcctorization.  Mask  technique,  a  vector-bit-mask  for  the  conditions  will  be 
built  and  only  those  right  sides  of  assignments  where  the  associated  mask 
bit  is  true  will  be  assigned  to  the  left  side.  The  disadvantage  of  this  method 
is  that  all  operands  arc  sent  through  the  pipeline,  this  would  be  waistful  if 
the  IF  condition  seldom  is  true  In  this  situation  the  gather/scatter 
technique  works  more  efficiently  For  all  true  conditions  an  index  vector 
will  be  built  and  a  special  gathcr/scattcr  hardware  accesses  the  operands 
indirectly  with  tnts  vector  arid  evaluates  the  right  sides  of  equations.  With 
the  comp,  css/c  pand  method  a  vector-bit-mask  is  built  as  well  but  all 
operands  arc  f  .chcd  from  memory  avoiding  indirect  addressing.  Then  the 
fetched  vectors  ate  compressed  and  processed  by  constant  stride  hardware 
After  processing  the  result  vector  will  be  expanded  and  stored.  This 
method  will  work  well  if  the  ratio  of  load  store  and  arithmetical  operations 
is  small. 

These  described  optimizing  techniques  for  the  compilers  arc  listed  in  Table 
3.2.3. 


CFT77 

Fuj.  VP 

IBM  VS 

statement 

reordering 

cf  77 

X 

X 

partial 

vectorizing 

X 

X 

X 

temporary 

scalars 

X 

X 

- 

conditional 

vectors 

X 

- 

- 

vectorizing 
outer  loops 

X 

X 

X 

loop 

distribution 

- 

X 

X 

logical  IF 

M 

M,G,C 

M 

Block  IF 

G 

M,G,C 

M 

ELSE  IF 

G 

M,G,C 

M 

M  =  mask  operation 

G  =  gather/scatter  operation 

C  =  compress/expand  operation 

cf77  =  possible  if  eft  77  is  embedded  in  cf77 

Table  3.2.3.:  optimizing  techniques 


4.  PARALLELIZING  COMPILERS 

4.1  GENERAL  PARALLELISM  CONCEPTS 

Parallel  execution  of  tasks  for  one  applicauon  may  improve  Us  cxccuUon 
time  but  n  increases  die  enure  amount  of  work  to  be  done  (in  CPU  cycles; 
because  there  is  a  remarkable  overhead  generating  parallel  tasks,  their 
synchromzauon  and  communication.  Therefore,  parallelism  must  be 
handled  carefully.  However,  if  one  application  covers  most  of  the  main 
storage  it  should  be  processed  in  parallel  since  it  would  be  waistful  to 
execute  it  on  only  one  CPU  because  of  other  CPUs  running  idle.  In 
general  to  maximize  throughput  the  share  of  main  storage  and  processing 
power  should  be  equal.  Another  motivation  for  parallel  processing  may  be 
that  an  application  may  be  done  only  in  realistic  time  by  parallel  speed  up 
or  the  applicauon  has  a  certain  deadline,  c.g.  meteorological  calculations. 

There  arc  two  classes  of  multitasking  concepts. 

Fine-grain  parallelism  means  parallel  execution  of  small  fractions 
of  code,  for  example  different  chunks  of  a  DO  loop 
Coarse-grain  parallelism  signifies  parallel  execution  of  program 
segments  with  larger  granularity,  for  example  subroutines 

Up  to  now  techniques  for  intcrproccdural  data  dependency  analysis  to 
allow  automatic  coarse  grain  parallelization  arc  in  the  experimental  phase. 
The  programmer  has  to  introduce  explicit  parallelism  by  using  a 
multitasking  interface,  for  example  library  calls,  or  new  language  elements 
or  by  specifying  compiler  directives.  All  intcrproccdural  data  dependencies 
have  to  be  synchronized  explicitly  by  the  programmer.  Within  one 
subroutine  compilers  may  find  small  independent  parts  of  code  (fine-grain 
parallelism)  Thus,  no  restructuring  of  the  algorithms  will  be  needed.  In 
coarse-grain  parallelism  it  is  a  big  problem  to  partition  work  into  portions 
of  approximately  equal  size  so  that  the  work  load  is  balanced  among,  the 
processors.  Enc-grain  parallelism  helps  load  balancing  by  filling  the  gaps 
of  processor  idle  time  owing  to  the  existence  of  many  small  computational 
units.  If  the  sum  of  idle  times  of  processors  is  greater  titan  that  for 
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initiation, communication  and  synchohization  of  parallel  work  the 
application  is  accelerated  as  well  as  system  throughput  is  increased. 

'*  cctorization  and  parallelization  may  exclude  each  other,  for  example  a 
long  vcctorizablc  DOToop  may  only  be  splitted  into  smaller  chunks  of 
parallel  loops. 

Here  arc  some  advices  for  parallel  programming: 

at  first  optimize  die  program  for  one  processor  (vcctorization) 
choose  equal  granularity  of  tasks  (load  balancing) 
coarsc-grain  parallelism  should  only  be  used  for  tasks  with  more 
than  10  000  operations  because  of  the  overhead  involved  with  it 
use  few  multitasking  routines  and  parall  lizc  the  hot  spots  of 
execution  time 

4.2.  CRAY  AUTOTASKING  SYSTEM  cf77 

CRAY  provides  three  concepts  for  multitasking:  macrotasking, 
microtasking  and  autotasking  As  macrotasking  is  the  coarsc-grain 
mechanism  microtasking  and  autotasking  are  fine-grain.  With  autotasking 
automatic  fine-grain  parallelization  in  subroutines  is  introduced. 
Autotasking,  microtasking  and  macrotasing  can  coexist  in  different 
subroutines  but  not  jn  a  single  one. 

MACROTASKING 

Macrotasking  is  available  by  means  of  FORTRAN  subprogram  calls  from 
a  special  multitasking  library  and  offers  high  level  synchronization  and 
communication  primitives.  These  subroutines  arc  the  interface  to  the 
library  scheduler  which  manages  the  single  tasks,  the  synchronization 
between  them  and  performs  requests  to  the  operating  system.  The  library 
scheduler  docs  not  use  hardware  for  most  synchronization  primitives.  Thus 
for  small  granularity  the  activities  of  the  library  scheduler  can  lead  u>  an 
extensive  overhead:  Macrotasking  should  be  used  widt  large  granularity. 

THE  MACROTASKING  LIBRARY  consists  of. 

routines  to  manipulate  tasks 

routines  to  control  events  for  synchronization 

routines  to  control  critical  regions  which  can  be  executed  by  one 

processor  exclusively  at  one  time 

MICROTASKING 

Microtasking  offers  much  faster  basic  functions  for  synchronization  and 
communication  by  accessing  special  hardware  and  is  realized  by  compiler 
directives  (CMI CS)  The  CMICS-dircctivcs  arc  translated  into  multitasking 
library  calls. 

THE  MICROTASKING  DIRECTIVES  consist  of: 

directives  requesting  microtasking  mode  and  logical  CPU’s 
directives  to  define  microtasking  control  structures  (MCS) 
directives  to  mark  critical  regions 

With  the  GETCPUS  directive  logical  CPU’s  arc  created  Logical  CPU’s  arc 
in  a  busy  loop  waiting  for  work  If  there  is  some  work  to  do  all  idle  CPU’s 
arc  able  to  execute  pans  of  it  The  operating-system  scheduler  lakes  this 
busy  loop  concept  into  account-  logical  CPU’s  which  terminate  working 
are  rescheduled  and  arc  immediately  ready  to  work  again.  Therefore 
microtasking  is  vety  efficient  Within  one  MCS  several  parallel  processes 
may  be  defined  each  of  them  executed  exclusively  by  one  logical  CPU. 
Processes  within  one  MCS  arc  scheduled  dynamically  in  unpredictable 
order  and  therefore  must  be  independent.  Data  dependencies  may  be 
considered  by  putting  the  corresponding  processes  into  different  MCS’s, 
since  a  MCS  must  be  terminated  before  the  program  continues.  Code 
outside  MCS’s  can  be  processed  in  parallel  by  all  logical  CPU’s  in 
unpredictable  order. 

AUTOTASKING 

Autotasking  is  realized  by  using  some  microtasking-  and  new  autotasking- 
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CMICS-dircctivcs. 

The  CRAY  autotasking  system  mostly  consists  of  well-known  components 
for  instance  the  cft77  compiler.  Other,  new  pans  arc  die  preprocessor  fpp 
and  the  multitasking  translator  fmp. 

fpp  analyses  the  data  dependencies  and  transforms  die  source  code  to 
modified  source  code  so  it  can  be  vectorized  or  parallelized  or  is  simply 
more  opdmal  in  scalar.  The  modified  source  code  contains  directives  for 
vectorizing  and  multitasking.  Automatic  parallelizing  may  be  switched  off 
so  fpp  may  create  pure  vector  source  code.  Depending  on  die  CRAY 
architecture- vcctonzation  is  prefered  rather  than  parallelization,  fpp  only 
analyses  DO  loops,  which  arc  the  most  frequent  type  for  parallel  or  vector 
constructs.  All  loops  arc  vectorized  if  possible.  In  nested  loops  the 
outermost  loop  will  be  parallelized  if  possible  and  die  innermost  loop  will 
be  vectorized.  By  an  option  vcctorizablc  loops  with  high  iteration  counts 
may  be  splitted  into  several  parallel  loops  and  each  parallel  loop  will  be 
vectorized.  Even  die  outer  loops  of  non-vcctonzablc  inner  loops  may  be 
parallelized,  fpp  provides  inline-expanding  of  subroutines  so  a  more  global 
analysis  of  data  dependencies  can  be  made.  But  it  should  not  be  overdone 
because  dicn  the  code  grows  immense.  If  no  additional  loops  became 
vcctorizablc  which  should  be  the  ease  in  good  vector  programs  die  gain  of 
run-dme  is  little. 

If  no  parallelism  is  requested  die  modified  source  code  program  may 
directly  be  compiled  widi  cft77.  However  to  exploit  parallelism  die  output 
of  fpp  must  bc  proccsscd  by  fmp  before  being  translated  widi  cft77..fmp 
changes  autotasking  dirccuvcs  to  machine  dependent  library  calls. 

4.3  IBM  PARALLEL  FORTRAN 

Parallel  FORTRAN  has  three  fundamental  extensions  for  fine-  and  eoaiae- 
grain  parallelism  on  IBM  3090  multiprocessors. 

extensions  to  die  compiler  for  automatically  generating  parallel 

code 

language  extensions  for  explicit  parallelism 

extensions  to  the  library. for  synchronizing  parallel  execution 

Fine-grain  parallelism  is  supported  by  language-extensions  and 
automatical  detection  of  implicit  parallelism,  coarsc-grain  by  language  and 
library  extensions. 

The  Parallel  FORTRAN  environment  consists  of  the  parallel  appheadon 
program,  some  FORTRAN  processors  and  the  parallel  library.  The 
FORTRAN  library  maps  the  parallel  pieces  of  work  onto  virtual 
processors  called  FORTRAN  processors.  The  operating  system  maps 
FORTRAN  processors  onto  real  machine  processors.  Tic  implementation 
of  FORTRAN;proccssors  depends  on  the  operating  system.  FORTRAN 
processors  under  MVS/XA  arc  tasks.  Under  VM/XA  several  virtual 
machines  build  a  virtual  multiprocessing  machine  and  each  FORTRAN 
processor  is  executed  by  one  virtual  CPU.  The  maximum  degree  of 
parallel  execution  can  be  varied  at  run-time  by  specifying  an  option  for  the 
number  of  virtual  FORTRAN-proccssors.  The  user  can  define  more 
parallel  pieces  of  work  dian  the  number  of  FORTRAN  processors  allows. 
Additional  pieces  of  work  build  a  queue  and  finishing  FORTRAN 
processors  take  their  work  from  this  queue.  As  long  as  the  queues  arc  filled 
the  FORTRAN  processors  can  continue  working  without  die  operadng 
system.  Only  if  a  queue  empties  or  refills  dicrc  is  overhead  of  the 
operating  system  by  suspending  or  restarting  a- FORTRAN  processor. 
Ticrc  is  no  operating  system  overhead  to  schedule  and  synchronize 
parallel  work. 

AUTOMATIC  PARALLELISM 

Tie  compiler  determines  whether  it  is  cost  cffccuvc  to  execute  the  loop  in 
parallel,  odicrwisc  vector  or  scaiar  code  is  generated.  A  loop  selected  for 
parallel  execution  may  contain  inner  loops  that  arc  parallelized,  vectorized 
or  serial.  A  loop  selected  for  vector  operation  may  contain  only  inner  loops 
which  arc  serial.  Ticrc  are  for  example  directives  to  indicate  a  preference 
for  parallel,  vector  or  serial  code  and  the  number  of  iterations  to  be 


grouped  together  as  a  unit  of  work. 

LANGUAGE  EXTENSIONS 

Parallel  FORTRAN  provides  two  types  of  language;  extensions  which 
both  can  be  nested  and  intermixed: 

in-line  extensions:  define  parallelism- within  a  routine 

out-line  extensions:  define  parallelism  across  routines 

In  general  m-line  extensions  support  fine-grain  parallelism  as  out-line 
extensions  provide  coarse  grain  parallelism. 

IN-LINE  EXTENSIONS 

There  arc  two  new  inrlinc  extension  language  elements  the  PARALLEL 
LOOP  and  the  PARALLEL  CASES.  Each  iteration  of  a  PARALLEL 
LOOP  can  be  executed  concurrcndy  and  the  order  of  execution  of  the 
iterations  is  not  guaranteed.  Parallel  executed  blocks  of  statements  arc 
declared  by  PARALLEL  CASES.  Such  blocks  may  contain  straight  code, 
parallel  or  vector  loops.  Although,  PARALLEL  CASES  is  an  in  line 
construct  thisprimitivc  should  better  be  used  for  coarse-grain  parallelism 
because  in  current  implcmcntauons  there  is  a  large  ovcriicad  involved  with 
it.  Thus .  It  is  possible  to  number  cases  to  define  an  execution  order  among 
blocks  of  statements.  Every  acyclic  graph  of  data  dependencies  may  be 
transformed  into  PARALLEL  CASES. 

OUT-LINE  EXTENSIONS 

Out-line  extensions  create  disjoint,  asynchronous  execution  environments 
called  tasks.  A  task  is  a  collection  of  subroutines  that  is  independent  of 
other  tasks.  This  task  concept  is  hierarchical,  in  the  beginning  there  is  one 
root  task  which  may  create  several  child  tasks  with  an  ORIGINATE 
statement.  A  task  is  terminated  with  a  TERMINATE  primitive  or 
automatically  at  its  end.  SCHEDULE  or  DISPATCH  assign  the  execution 
of  a  subroutine  to  a  task.  As  dispatched  tasks  run  completely  asynchronous 
scheduled  tasks  require  a  WAIT  FOR  instruction  to  terminate.  Other 
primitives  for  subtask  synchronization  arc  locks  and  events,  which  are 
recommended  because  explicit  WAIT  FOR  is  very  expensive.  Locks 
ensure  that  only  one  processor  at  a  time  gets  access  to  a  certain  resource. 
Events  may  be  used  to  make  a  task  wait  until  another  task  has  reached  a 
certain  point  of  execution.  With  locks  and  events  self  balancing  dynamical 
workloads  can  be  created.  PARALLEL  LOOP  and  PARALLEL  CASES 
constructs  are  automatically  load  balanced  by  the  library.  Only  if  the  user 
explicitly  shares  data  between  tasks  the  execution  of  tasks  can  affect  one 
another. 

IXfMCLIiSLQN 

Today  vectorizing  is  an  established  method.  The  three  described  compilers 
all  arc  able  to  vectorize  automatically  but  m  spite  of  that  they  arc  very 
different.  The  CRAY  CFT  compiler  is  the  successor  of  the  older  CFT  1.15 
compiler.  Since  the  aged  CFT  1:15  was  not  based  on  theoretical  program 
analysis,  CFT  has  been  designed  completely  new.  The  IBM 
FORTRAN/VS  compiler  is  based  on  an  older  sequential  version.  The 
biggest  handicap  for  VS  is  the- underlying  3090  cache-hardware.  If  the 
accesses  ran  out  of  cache-memory  (for  example  row  accesses  in  matrices) 
vcctorizablc  loops  arc  not  vectorized  by  the  compiler.  The  newest  version 
of  FORTRAN/VS  Rcl  2.5  is  an  autovcctorizing  and  autoparallclizing 
compiler.  Supplementary  to  enhanced  vectorizing  capabilities  it-includes 
features  from  PARALLEL  FORTRAN.  Fujitsu's  VP  compiler  adapts  the 
structure  of  vector  registers  to  the  program  structure  given.  It  has  three 
vcctorization  methods  for  IF  statements  (mask,  gathcr/scattcr, 
comprcss/cxpand).  The  announced  Fujitsu  FORTRAN/VP-EX  compiler 
will  adapt  programs  to  the  new  hardware  and  improve  the  performance  of 
programs.  For  instance,  the  vector-pipeline  is  used  inefficiently  if  die  DO 
loop  docs  not  contain  enough  operations.  Loop  unrolling  expands  the 
executable  statements  in  a  DO  loop  and  reduces  the  iteration  count  .thus, 
pipelines  can  work  more  efficiently.  Program  performance  is  increased 
further  by  integrating  subroutines  into  calling  routines  and  optimizing  the 
modified  program  in  a  more  global  manner.  To  exploit  the  new 


multiprocessor  architecture  the  compiler  FORTRAN/PP  will  be  developed 
with  automatic  intraprocedural  parallelism  and  language  extensions  for 
intcrproccdural  parallelism. 

There  is  no  ideal  compiler,  all  arc  in-continous  development  and  in 
addition  to  that  often  have  to  be  adapted  to  new  hardware. 

With  parallelization  however  new  problems  arise,  for.  instance  for  coarse- 
grain  parallelism  synchronization  has  to  be  programmed  explicitly.  To 
justify  the  overhead  derived  from  parallelization  work  has  to  be  partitioned 
in  large  parts  of  code.  This  in  fact  conflicts  with  dynamic  load-balancing. 
If  the  programmer  is  aware  of  his  problem  and  of  the  underlying  hardware 
too,  many  errors  may  be  avoided  .  Hardware  aspects  are  important  since, 
-for  instance,  the  shared  memory  systems  focussed  here  not  only  use 
memory  to  store  data  but  also  to  communicate  between  tasks.  Parallelizing 
compilers. today  are.n  die  age  of  matunty.  Possibly  the  next  generation 
will  be  able  to  analyse  data  dependencies  above  die  DO  loop  level 
Analysing  results  will  be  displayed  and.some  son  of  interactive  scmi- 
automatical  parallelizing  will  be  realized. 
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Introduction 

Dataflow  languages  are  attractive  for  parallel  computation  because 
of  their  expressive  power —  their  high-level,  machine-independent, 
implicitly  parallel  notation—  and  because  of  their  fine-grain  par¬ 
allelism,  which  seems  essential  for  effective,  scalable  utilization  of 
parallel  machines. 

Dataflow  languages  are  no  longer  tightly  coupled  with  dataflow  ar¬ 
chitectures.  Today,  we  understand  the  compiling  issues  for  dataflow 
languages  well  enough  that  we  can  recommend  these  languages  to 
programmers  without  having  to  rely  on  architectural  support. 

There  are  several  dataflow  languages  described  in  the  literature,  in¬ 
cluding  Id  [7],  Sisal  [6],  and  Val  [1];  due  to  space  limitations,  we  will 
base  our  discussions  here  on  Id. 

Expressive  Power  of  Dataflow  Languages 

“Expressive  power”  docs  not'have  a  precise  definition;  one  can  make 
reasoned  arguments  about  why  one  language  is  more  expressive  than 
another,  but  ultimately  the  judgment  is  subjective.  Theoretically, 
FORTRAN  and  assembly-language  have  the  same  computational 
power,  but  almost  everyone  would  agree  that  FORTRAN  is  more 
expressive,  because  it  is  architecture-independent  and  because  it  re¬ 
quires  less  detailed  specification  of  problem  solutions  and  is  “closer” 
to  the  way  human  programmers  think  about  problems. 

Dataflow  languages  are  based  on  functional  programming  languages. 
Unlike  most  programming  languages  that  have  evolved  upwards  from 
machine  languages,  functional  languages  arc  based  on  the  A-calculus, 
a  mathematical  theory  of  functions  that  predates  digital  computers 
[3]. 

Functional  notation: 

An  aspect  of  the  expressive-power  of  functional  languages  is  that 
one  can  manipulate  complex  objects  (entire  data  structures,  and 
even  functions  themselves)  as  ordinary  values.  Consider  this  func¬ 
tion: 

def  nap2  t  k  B  ■  ...  details  omitted  . . . 

taking  3  arguments:  a  function  t  and  two  arrays  A  and  B,  and  return¬ 
ing  as  its  result  a  new  array  (call  it  c)  where 
ctj]  -  x  A[jJ  BCj] 

i.e.,  it  applies  x  to  each  pair  of  components  of  a  and  B  and  returns  an 
array  containing  the  results.  (In  Id  and  other  functional  languages, 
it  is  common  to  use  a  “curried"  notation,  omitting  parentheses,  com¬ 
mas,  semicolons  etc.  around  the  arguments  of  a  function.) 

Now,  we  can  specialize  »ap2  to  define  a  vector  sum  function: 

deX  v«un  A  B  ”  nap2  (+)  A  B  j 

Here,  the  function  is  supplied  as  the  X  parameter  to  nap2,  so 
that  v»ua  adds  the  vectors  a  and  B  pointwisc,  and  returns  a  vector 
containing  the  sums.  Further,  since  v»ua  is  itself  an  addition  function, 
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we  can  perform  vector  addition  on  vectors  whose  components  arc 
themselves  vectors: 

deX  vvaun  AA  BB  >  nap2  vaum  AA  BB  ; 

Another  useful  higher  order  function  is: 
deX  Xoldl  X  z  A  *  ...  details  omitted  ... 

which  computes  the  “i-reduction”  of  array  a,  where  z  is  the  zero  of 
the  function  x,  i.e.,  it  computes: 

X  ...(X  (X  z  A[l])  A [2])  AW 

Using  Xoldl,  one  can  express  the  inner-product  of  two  vectors: 
def  ip  A  B  ■  Xoldl  (+)  0  (nap2  (*)  A  B)  ; 

Here,  tap 2  multiplies  A  and  B  pointwise,  and  Xoldl  computes  the  sum 
of  the  resulting  vector  of  products. 

The  ability  to  manipulate  entire  complex  objects  and  functions  them¬ 
selves  as  values  relieves  the  programmer  of  the  tedium  of  descending 
down  to  explicit  loops  and  assignments  at  every  stage —  such  details 
can  be  hidden  in  a  few  generally  useful  functions  such  as  nap2  and 
Xoldl  [2].  Such  higher  order  functions  are  the  “power  tools”  of  func¬ 
tional  programming,  in  the  sense  that  they  amplify  the  programmer’s 
effort. 


Implicit  parallelism: 

Another  aspect  of  expressive  power  is  implicit  parallelism.  In  most 
parallel  languages,  the  user  must  carefully  orchestrate  parallelism: 
explicitly  partition  the  program  into  parallel  processes,  specify  the 
placement  of  data,  specify  the  placement  and  scheduling  of  processes, 
etc.  Often,  these  details  are  architecture  specific,  and  sometimes  even 
configuration  specific,  resulting  in-fragile,  non-portable  code. 

In  functional  languages  (and  in  all1  our  examples  above)  we  do  not 
have  to  specify  what  can  be  done  in  parallel.  In  principle,  everything 
can  be  performed  in  parallel,  limited  only  by  data  dependencies.  For 
example,  the  implementation  of  rxp2  may  perform  all  the  applica¬ 
tions  of  x  in  parallel.  Thus,  functional  languages  do  not  increase  the 
complexity  of  the  programmer’s  task  when  moving  from  a  sequential 
to  a  parallel  environment. 

M-structurcs:  implicitly  synchronized  stale: 

In  pure  functional  languages,  there  is  no  concept  of  “state,”  i.e., 
structures  whose  contents  change  during  program  execution.  There 
are  no  assignment  statements —  programs  arc  functions  that  com¬ 
pute  new  values  from  old.  While-many  algorithms  can  be  expressed 
dearly  in  this  style,  there  arc  some-problems. 

One  difficult  area  is.  algorithms  making  effective  use  of  non-deter¬ 
minism.  Functional  languages  have  the  Church-Rosscr  property  [3] 
which  guarantees  that  the  answer  produced  by  a  functional  program 
does  not  depend  on  the  particular  parallel  execution  structure  chosen 
by  an  implementation.  This  is  usually  a  major  advantage;  unlike 
other  parallel  languages,  functional  programs  arc  not  subject  to  race 
conditions  leading  to  non  deterministic  and  irreproducible  behavior 
(which  complicates  debugging). 

However,  consider  the  problem  of  traversing  a  directed  graph  to 
count  the  number  of  nodes  reachable  from  a  given  root  node.  The 
following  strategy  seems  simple:  starling  at  the  root  node,  fan  out 
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in  parallel  on  all  outgoing  edges  from  each  visited  nodt.  To  avoid 
repeated  traversals  of  shared  subgraphs  (and  cycles),  the  first  traver¬ 
sal  to  reach  a  node  marks  it  “visited,”  so  that  subsequent  traversjs 
reaching  the  node  via  other  paths  will  observe  the  mark  and  retreat. 
Non-determinism  is  exploited  because,  of  all  the  incoming  traversals 
arriving  at  a  shared  node,  we  do  not  care  which  one  arrives  first  to 
mark  the  node  and  traverse  its  successors.  There  is  no  way  to  express 
tills  idea  in  a  functional  language  one -must  pick  a  deterministic 
order  to  traverse  the  nodes.  This  not  only  clutters  up  the  program 
significantly,  but  also  sequeutializcs  it. 

Introducing  non-determinism  into  a  functional  language  is  not  very 
different  from  introducing  state —  constructs  for  one  can  be  used  to 
simulate  the  other.  Not  surprisingly,  functional  languages  also  have 
difficulty  in  dealing  with  input  output,  which  seems  quintcssentially 
linked  to  the  notion  of  state. 

In  Id,  the  functional  core  is  extended  with  M-structures  which  arc 
updatable  data  structures.  Unlike  other  languages  where  updates  are 
protected  by  separate  synchronization  primitives  ( e.g .,  semaphores), 
accesses  to  M-structures  in  Id  are  combined  with  implicit  synchro¬ 
nization.  For  example,  a  component  of  an  M  structure  array  (an 
“K-array”)  can  be  incremented  using  the  statement: 

1!  Cjl  «  i![j)  +  1 

The  expression  ilCjl  on  the  right  hand  side  not  only  reads,  but 
simultaneously  locks  the  location.  The  assignment  “l![j]  -  ...”  not 
only  writes  the  value  back,  but  simultaneously  unlocks  the  location. 
This  guaratces  that  the  increment  is  atomic,  i.e.,  even  if  several 
computations  execute  this  statement  concurrently,  the  increments 
willbc  done  properly.  Coupling  accesses  with  synchronization  in 
this  manner  leads  to  clear  and  concise  programs  (4). 


Implementations  and  performance 

Dataflow  implementations  have  become  increasingly  sophisticated  in 
recent  years. 

Compilers  for  dataflow  languages  do  not  have  the  problem  of  de¬ 
tecting  parallelism;  rather,  they  often  have  the  opposite  problem  of 
trying  to  contain  excess  parallelism.  Without  optimization,  dataflow 
programs  can  be  quite  voracious  in  their  resource  demands.  For  ex¬ 
ample,  a  direct  interpretation  of  the  rasp 2  function  would  allocate  a 
new  vector  for  each  result  that  it  computes.  In  general,  tliis  storage 
must  be  allocated  dynamically,  and  it  is  necessary  to  have  a  garbage 
collector  to  recycle  memory  occupied  by  structures  no  longer  in  use. 
A  related  problem  is  computational  cost.  If  we  have  a  “point"  rep¬ 
resented  as  a  vector  of  3  values  {x,  y,  z),  and  we  wish  to  displace 
it  one  unit  along  the  x-axis,  functional  semantics  demands  that  we 
produce  a  new  vector  containing  (x  t  1,  </,  z).  Notice  that  we  have 
to  copy  y  and  z.  These  overheads  can  be  quite  high.  Thus,  reuse  of 
storage  is  essential  for  efficient  implementations. 

For  Sisal,  which  is  a  pure  functional  language,  researchers  have  de¬ 
veloped  program  analysis  techniques  that  allow  the  implementation 
to  reuse  storage  heavily  [9],  Sisal  researchers  report  that  on  the 
Livermore  loops,  they  arc  now  able  to  compile  code  for  Cray  super¬ 
computers  that  is  competitive  with  FORTRAN  codes. 

The  Id  compiler  [10]  is  unable  to  use  the  Sisal  analysis  techniques 
directly  because  of  higher  order  functions,  non  strictness  and  recur 
sivc  data  structures.  However,  it  is  a  highly  optimizing  compiler 
that  uses  lifetime  analysis,  loop  bounding  and  several  other  novel 
optimization  techniques.  The  Id  compiler  is  currently  targeted  to 
the  Monsoon  dataflow  machine  that  is  being  built  as  a  collaboration 
between  MIT  and  Motorola,  Inc.  At  time  of  this  writing  (March 
1991),  complete  uniprocessors  have  just  become  operational,  and  8- 
processor  Monsoon  machines  arc  expected  in  April  1991.  We  have 
run  only  a  few  small  benchmarks  (such  as  matrix  multiplication), 


but  it  appears  that  Id  on  Monsoon  can  be  competitive  with  C  on  a 
modern  workstation. 

Fine  grain  parallehsm  seems  essential  if  we  are  to  simultaneously 
achieve  the  goals  of  general-purpose  parallel  programming  and  scal¬ 
able  performance.  As  processors  become  faster  and  machines  become 
more  parallel,  memory  latencies  are  becoming  relatively  larger.  A 
general  way  to  address  this  is  rapid,  fine-grain  thread  switching,  i.e., 
each  processor  needs  a  large  pool  of  threads  amongst  which  it  can 
be  efficiently  multiplexed  so  that  it  can  always  do  useful  work while 
some  threads  axe  waiting  (for  long-latency  memory  requests,  for  syn¬ 
chronization,  for  results  of  procedures,  etc.). 

Dataflow  languages  and  their  compilers  offer  a  systematic,  complete 
approach  towards  this  computational  model.  New  compilers  are  un¬ 
der  construction  at  MIT  and  Berkeley  that  use  dataflow  principles 
to  compile  Id  even  for  non-dataflow  machines  [8,  5];  these  compilers 
should  enable  Id  to  become  widely  available. 

Conclusion 

There  is  an  interesting  parallel  between  parallel  programming  today 
and  sequential  programming  in  the  early  1950's.  At  that  time,  pro¬ 
grams  were  written  in  assembly  language,  and  programmers  had  to 
be  acutely  aware  of  the  architectural  details  of  their  machines.  There 
was  widespread  skepticism  that  high-level,  machine-independent  pro¬ 
gramming  was  possible  with  acceptable  efficiency.  John  Backus  and 
his  group  changed  all  that,  with  their  outstanding  FORTRAN  imple¬ 
mentation.  Today,  parallel  programmers  have  to  be  acutely  aware 
of  the  architectures  of  their  parallel  machines,  and  there  seems  to 
be  widespread  skepticism  that  high  level,  machine  independent.par- 
allel  programming  is  possible  with  acceptable  efficiency.  Our  hope 
is  that  dataflow  languages  like  Id  can  do  for  parallel  programming 
what  FORTRAN  did  for  sequential  programming.  The  prospects 
look  bright. 
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1  Introduction 

Dataflow  architectures  often  seem  mysterious  compared  to  more  famil¬ 
iar  von  Neumann  computers.  This  reflects  the  history  of  their  evolu¬ 
tion,  which  has  tended  to  emphasize  tokens  flowing  on  dataflow  graphs 
as  the- metaphor  for  their  operation.  Recent  advances  in  dynamic 
dataflow  architectures,  as  well  as  in  our  understanding  of  them  [4], 
make  it  possible  to  see  dataflow  machines  in  a  more  conventional  light. 
While  the  tokens-on-a-graph  metaphor  is  still  a  useful  way  to  reason 
about  the  machine,  and  especially  about  a  particular  compilation  style 
for  the  machine,  one  can  also  think  of  a  dataflow  program  as  multi¬ 
ple,  interacting  sequential  threads  [6].  This  makes  a  dataflow  machine 
look  more  like  a  typical  multiple-instruction,  multiple-data  (M1MD) 
multiprocessor,  and  highlights  its  strengths  relative  to  other  MIMD 
architectures. 

This  article  describes  the  Monsoon  architecture  from  this  point  of 
view.  Monsoon  [5,  2]  is  a  prototype  dataflow  computer  currently  un¬ 
der-construction  in  a  joint  effort  between  the  Massachusetts  Institute 
of  Technology  and  Motorola,  Inc.  Most  of  the  discussion  directly  ap- 
plies-to  any  dynamic  dataflow  computer  with  an  explicit  token  store, 
including  the  Sandia  Epsilon-2  [3],  and  the  ETL  EM-4  [7]. 

2  Parallel  Machine  Language 

Dataflow  architectures  are  perhaps  the  first  general  purpose  comput¬ 
ers  that  execute  a  parallel  machine  language.  It  is  a  parallel  machine 
language  because  it  has  primitive  operations  for  managing  parallel 
computation,  namely,  fork  and  join.  A  fork  instruction  initiates  a 
new,  independent  thread  of  computation  in  the  machine,  with  its  own 
program  counter  and  register  set.  This  is  depicted  in  Figure  la;  as  the 
figure-suggests,  fork  is  like  both  taking  a  branch  and  also  continuing 
on  to  the  next  instruction.  A  join  instruction  brings  two  independent 
threads- together  into  a  single  thread.  Each  thread  will  try  to  execute 
the  join  instruction  (by  falling  through  to  it  or  by  jumping  to  it),  but 
only  the  second  to  arrive  will  continue  with  the  next  instruction  fol¬ 
lowing  the  join.  This  is  depicted  in  Figure  lb  What  is  unique  about 
the  dataflow  architecture  is  that  these  primitives  arc  single  instruc¬ 
tions,  whereas  in  conventional  multiprocessors  they  must  be  simulated 
through  software  procedures  that  can  require  hundreds  or  thousands 
of  instructions  for  each  fork  or  join. 

What  happened  to  dataflow  graphs?  They  emerge  from  a  par¬ 
ticular  compilation  strategy  that  introduces  many  fork  and  join  in¬ 
structions,  as  illustrated  in  Figure  lc.  This  reveals  the  correspondence 
between  multi-thread  sequential  code  and  dataflow  graphs:  a  chain 
of  one-input,  one-output  dataflow  operators  is  like  a  sequence  of  con¬ 
ventional  von  Neumann  instructions.  The  token  flowing  along  such 
a  chain  simply  contains  the  processor  state  for  that  thread:  a  pro¬ 
gram  counter  (in  dataflow  parlance,  the  instruction  pointer  part  of  the 
“tag”),  and  the  thread's  register  set.  In  Monsoon,  that  set  is  really 
only  a  single  general  register,  called  the  “value,”  and  a  special  frame 
pointer  register  (another  part  of  the  "tag”  in  dataflow  jargon;  used  as 
the  base  of  an  addressing  mode  for  accessing  data  local  to  a  procedure 
activation.1  A  fork  is  a  one-input,  two-output  dataflow  operator,  and 
a  join  is  a  two-input,  one-output  operator. 

The  instruction  set  of  Monsoon  includes  single  instructions  that  do 
a.  join,  an  arithmetic  operation,  and  a  fork.  Such  an  instruction  would 
be  drawn  as  a  two-input,  two-output  arithmetic  node  in  a  dataflow 
graph.  Having  such  instructions  means  Monsoon  can  efficiently  ex¬ 
ecute  “pure  dataflow”  graphs,  but  again,  this  is  only  one  of  many 
compilation  strategies  possible. 

1  Monsoon  actually  provides  more  than  one  general  register  along  chains  of  in¬ 
structions,  with  the  restrictions  that  the  additional  registers  arc  uninitialized  in 
new  threads  created  via  fork,  and  that  the  additional  registers  are  destroyed  when 
the  thread  executes  a  join. 
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Figure  1:  Examples  of  fork  and  join 


3  Split  Phase  Memory  Transactions 

Essential  to  any  multiprocessor  is  the  ability  to  tolerate  long  memory 
latency  [1].  Dataflow  architectures  do  this  through  splil-phase  memory 
transactions  (1).  From  the  program’s  point  of  view,  a  split-phase  fetch 
instruction  to  fetch  from  location  L  behaves  like  a  fork:  the  thread 
issuing  the  fetch  continues  processing,  and  a  new  thread  is  initiated. 
The  new  thread  will  have  its  value  register  initialized  to  the  value 
fetched  from  L.  In  the  machine,  the  fetch  instruction  actually  oper¬ 
ates  by  sending  a  special  request  message  to  the  processor  containing  L 
(this  is  the  first  phase),  and  continuing  on  to  the  next  instruction  in 
the  thread.  The  remote  processor  sends  back  a  response  message  (this 
is  the  second  phase),  which  initiates  the  new  thread  in  the  processor 
that  originally  executed  the  fetch.  This  new  thread  may  begin  a  to¬ 
tally  independent  computation,  or  synchronize  with  the  original  thread 
through  a  join  instruction.  As  long  as  there  is  a  sufficient  supply  of 
parallel  activity  («.e.,  other  threads  previously  forked ),  the  processor 
will  not  be  idle  between  the  issuing  of  the  request  and  the  receipt  of 
the  response. 

A  split-phase  store  instruction  is  similar,  except  that  the  response 
from  a  stoic  carries  no  value,  only  an  acknowledgment  that  the  store 
is  complete. 

4  Synchronization 

Equally  essential  to  any  multiprocessor  is  the  ability  to  rapidly  syn 
thronize  parallel  computations  [1].  The  join  operation  already  dis- 
oussed  is  the  primary  means  of  synchronization  in  lataflovv  architec¬ 
tures.  In  "explicit  token  store"  dataflow  architectures  such  as  Mon¬ 
soon,  this  operation  is  performed  quite  efficiently  through  the  addition 
of  a  few  presume  fcifs  to  each  word  of  an  ordinary  data  memory.  Every 
join  instruction  names  a  word  in  that  memory,  called  the  rendezvous 
point.  Typically,  the  addressing  mode  used  to  name  that  rendezvous 
point  is  a  fixed  offset  relative  to  the  activation  frame  (see  Section  7). 
Initially,  the  presence  bits  on  the  rendezvous  point  arc  c mplij.  When 
the  first  of  the  two  joining  threads  executes  the  join,  the  contents  of 
that  thlead's  value  register  are  stored  in  the  data  part  of  the  ren 
dezvous  point,  and  the  presence  bits  are  changed  to  present.  The  first 
thread  then  “dies,”  meaning  that  the  processor  goes  on  to  execute 
some  other  thread,  created  by  an  earlier  fork  or  response  to  a  split 
phase  transaction.  Some  time  later,  another  thread  executes  a  join 
which  names  the  same  rendezvous  point,  finding  the  presence  bits  set 
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to -present,  that  thread  continues  with  the  next-instruction  following 
the  join,  and  the  synchronization  is  complete.  In  the  case  where  the 
join. is-part  of  a  two-input  arithmetic  instruction,  the  value  registers 
of  the  two  joining  threads  become  operands,  one  of  them  having  been 
recorded  in  the  rendezvous  point.2 

Notice  that  the  join. operation  requires  no  exotic  hardware  such  as 
associative  memories,  only  a  few  extra  bits.  Notice,  too,  that  every 
word  of  data  memory  comes  equipped  with  presence  bits,  so  there 
is  an  effectively  unlimited  namespace  for  synchronization  events,  or, 
putting  it  another  way,  an  unlimited-number  of  synchronizations  may 
be  in_progress  at  once. 

5  Synchronizing  Memory  Operations 

The  join  operation  provides  one  means  for  computations  to  synchro¬ 
nize;  another  is  provided  by  synchronizing  memory  operations.  These 
exploit  split-phase  transactions  and  presence  bits  to  provide  a  variety 
of  ways  to  synchronize  producers  of  data  structures  with  their  con¬ 
sumers.  An  example  are  the  split-phase  operations  I-fetch  and  I-store, 
which -synchronize  many  readers  of  a  location  with  a  single  writer. 
Before  an  I-store,  the  presence  bits.of  the  location  must  be  empty;  a 
subsequent  I-store  request  will  set  them  to  present  as  well  as  storing 
the  data.  An  I-fetch  request  to  a  present  location  behaves  like  an  or¬ 
dinary.  fetch.  An  I-fetch  request  to  an  empty  location,  however,  sets 
the  presence  bits  to  deferred  and  does  not  generate  a  response.  A  sub¬ 
sequent  I-store  request  will  store  the  value  and  set  the  presence  bits  to 
present,  as  before,  and  aiso  will  produce  the  response  to  the  deferred 
I-fetch.  (How  the  information  to  generate  the  responses  is  maintained 
is  beyond  the  scope  of  this  paper;  see  (2).)  Thus,  the  consumer  may 
issue  an  I-fetch  without  knowing  whether  the  data  has  been  stored: 
the  response  will  not  be  generated  until  after  the  corresponding  I-store 
has  happened.  This  sort  of  usage  generally  involves  two  types  of  syn¬ 
chronization:  the  memory  synchronization  as  described  above,  and  a 
join  back  at  the  issuing  processor  to  synchronize  the  response  to  the 
I-fetch  with  the  thread  that  issued  the  request. 

Monsoon  provides  several  forms  of  synchronizing  memory  opera¬ 
tions,  including  take  and  put  operations  for  building  locks;  different 
operations  are  selected  by  choosing  an  appropriate  fctdi  like  or  store 
like  opcode  as  the  first  phase.  Of  course,  ordinary  imperativc/c/ch  and 
store  operations  are  provided,  their  second  phases  of  these  operations 
simply  ignore  the.prcsence  bits  entirely. 

6  Compiler  Controlled  Thread  Granularity 

It  is  often  said  that  parallelism  in  dataflow  architectures  is  fine-grained. 
In  fact,  the  compiler  has  considerable  control  over  the  granularity  of 
parallelism  exposed  to  the  hardware.  Thread  granularity  can  be  mea¬ 
sured  by  the  number  of  instructions  a  thread  can  execute  before  it  stops 
or  synchronizes  with  another  thread  via  a  join.  Now  consider  compil¬ 
ing  an  expression  like  (c*a[i])  +  (c*b[i]>.  Assuming  a  and  b  are 
global  arrays,  the  fetches  of  a[i]  and  b[i]  will  be  split-phase  trans¬ 
actions.  There  arc  two  ways  the  compiler  could  express  the  remainder 
of  the  computation:  (1)  it  could  join  the  two  responses,  then  multiply 
each  by  c  and  add  the  products;  (2)  it  could  have  a  separate  thread  for 
each  response,  each  of  which  multiplies,  and  then  those  two  threads 
join  together  and  add.  The  arithmetic  in  strategy  (1)  is  in  one  largo 
thread,  whereas  in  t2)  it  is  in  three  smaller  threads. 

The  traditional  dataflow  style  of  compilation  uses  arithmetic  in¬ 
structions  that  always  join,  and  so  that  style  is  a  fine-grain  style  of 
compilation.  This  is  a  strategy  well  matched  to  non-stnet  functional 
languages  such  as  Id,  as  their  semantics  limit  the  size  of  grains  that 
any  compiler  could  discover  [8].  Larger  grains  might  be  employed  by 
a  compiler  for  an  imperative  language.  What  is  interesting  is  that 
because  fork  and  join  are  so  efficient,  the  choice  of  large  grains  versus 
small  grains  is  often  determined  by  addressing  modes  and  register  al¬ 
location,  as  opposed  to  the  overhead  of  synchronizing.  As  Monsoon  s 
addressing  modes  are  tuned  to  the  dataflow  style  of  compiling,  finer 
grains  can  in  many  cases  result  in  superior  code,  even  though  there  is 
more  joining. 

’There  is  a  way  to  designate  one  thread  as  the  “left”  operand  anil  the  other  as 
the  "right,”  regardless  oi  the  order  in  which  they  happen  to  attempt  the  join. 


7  Compiler  Controlled  Task  Distribution 

A  common  misconception  is  that  work  distribution  across  processors 
in  a  dataflow  machine  is  at  the  level  of  individual  instructions,  t.e., 
at  every  folk.  In  fact,  the  thread  created  by  fork  always  executes 
on- the  same  p.ocessor  that  executed  the  fork  instruction  itself.  So 
strictly  speaking ,  fork  dees. not  create  any  parallel  activity,  only  an¬ 
other  thread  that  is  queued  up  until  the  processor  finishes  with  the 
current  thread.  Creating  a  thread  on  another  processor  requires  a  spe¬ 
cial  kind  of  folk  instruction  called  send  or  start,  hence,  the  granularity 
work  distribution  is  under  compiler  control.  Typically,  a  compiler  in¬ 
serts  send  instructions  as  part  of  a  procedure  calling  convention:  a 
procedure  is  invoked  by  creating  a  new  activation  frame  (stack  frame) 
for  the  call — the  frame  may  be  on  a  remote  processor — and  then  using 
send  to  start  one  new  thread  on  that  processor  for  each  argument, 
where  the  value  register  of  each  now  thread  is  a  parameter  for  the  call. 
Similarly,  the  called  procedure  returns  a  result  to  the  caller  by  using 
send  to  start  a  thread  back  on  the  calling  processor,  which  may  then 
join  with  the  thread  that  initiated  the  call  in  the  first  place.  Task 
distribution  is  at  the  level  of  procedure  calls,  even  though  instruction 
scheduling  is  at  the  finer  granularity  of  threads. 

It  has  been  tacitly  assumed  up  to  now  that  local  variables  of  a 
procedure  invocation,  as  well  as  the  rendezvous  points  for  its  joins, 
are  collected  together  in  an  activation  frame  associated  with  the  in¬ 
vocation.  (Activation  frames  are-like  stack  frames  in  a  uniprocessor, 
except  that  because  of  the  possibility  of  parallel  procedure  calls  they 
form  a  tree  instead  of  a  stack.)  This  is  accomplished  through  the  use 
of  addressing  modes  that  operate  relative  to  a  frame  pointer  that  is 
part  of  the  register  set  of  every  thread.  One  of  the  operands  to  the 
send  instruction  is  a  frame  pointer  for  the  new  thread;  for  a  procedure 
call,  this  would  be  a  pointer  to  the  new  activation  frame  created  for 
the  call.  The  actual  routing  of  the  new  thread  to  the  target  processor 
is  accomplished  simply  by  considering  the  most  significant  bits  of  the 
frame  pointer  to  be  a  processor  ID. 

8  Summary 

Though  dataflow  architectures  have  grown  up  in  a  tradition  of  radical 
departure  iium  von  Neumann  computing,  they 'have  progressed  to  the 
point  where  they  may  be  seemas  an  evolutionary  step.  The  current 
direction  in  dataflow  processor  design  is  to  exploit  the  new-found  sim¬ 
ilarity  to  conventional  architectures,  leading  to  processors  thatr  match 
von  Neumann  efficiency  on  sequential  code  while  retaining  the  benefits 
of  a  truly  parallel  machine  language. 
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INTRODUCTION 

The  design  and  validation  of  parallel  algorithms  is  a  rewarding  and  satis¬ 
fying  experience  once  the  implementation  has  been  completed  and 
debugged.  It  is  this  latter  task  which  can  be  extremely  frustrating  when 
dealing  with  a  general  purpose  multiple  instruction  multiple  data  (MIMD) 
computer,  system.  Errors  in  expressing  parallel  constructs  give  rise  to 
unpredictable  execution  behavior,  affecting  both  the  resulting  answer  and 
the  sanity  of  the  programmer. 

The  notion  of  a  high-level  parallel  programming  language  that  insulates 
the  programmer  from  the  perils  of  asynchronous  bugs  and  booby  traps  has 
been  the  goal  of  many  researchers  in  the  functional  language  community. 
In  the  last  few.  years,  significant  progress  has  been  made  in  this  area. 
Language  and  compilation  research  has  resulted  in  several  very  powerful, 
inherently  parallel  programming  languages.  Notable  among  these  is  Id, 
the  work  of  Prof.  Arvind's  Computation  Structures  Group  at  MIT.  Id  has 
a  functional  and  deterministic  subset,  yet  is  a  completely  general  purpose 
language  supporting  synchronizing  data  structures,  and  side-effects. 
Compilation  research  is  also  being  carried  out  at  Yale  University,  Chal¬ 
mers  University  of  Technology,  and  the  functional  programming  group  at 
the  University  of  Glasgow. 

Up  until  now  few  dataflow  computer  systems  have  been  developed  for 
wide  use.  One  of  the  first  was  designed  and  built  at  the  University  of 
Manchester.  This  project  resulted  in  identifying  many  important  architec¬ 
tural  issues  in  the  design  of  support  hardware  for  the  dataflow  execution 
model.  The  Manchester  group  used  the  purely  functional,  strict,  single 
assignment  language  SISAL  for  writing  their  applications  and  produced  a 
compiler  generating  highly  efficient  dataflow  code  for  this  language.  A 
similar  dataflow  project  was  initiated  at  the  Electro-Technical  Laboratory 
(ETL)  in  Tsukuba,  Japan.  Here  a  large  dataflow  system  with  128  process¬ 
ing  elements  was  designed  and  built.  Unfortunately  the  lack  of  program¬ 
ming  software  has  prevented  the  system  from  being  fully  tested  on  sub¬ 
stantial  application  codes.  Still  from  these  and  other  experiences,  a  mul¬ 
tithreaded  execution  model  with  in  the  frame  work  of  dataflow  has 
emerged  and  has  many  researchers  very  hopeful  of  its  success.  Today 
several  research  groups  arc  seriously  involved  with  building  prototypes  of 
these  multithreaded  architectures  (e.g.,  Sandia  National  Laboratories’ 
(Albuquerque,  New  Mexico)  Epsilon -2,  Motorola  and  MIT’s  Monsoon, 
IBM’s  Empires,  and  ETL’s  EM-4). 

Wc  arc  now  at  a  very  exciting  moment  when  language,  compiler  technol¬ 
ogy,  and  hardware  are  quickly  maturing  and  becoming  readily  available 
for  use.  This  moment  also  offers  us  the  important  opportunity  to  criti¬ 
cally  assess  the  advantages  claimed  by  functional  language  and  dataflow 
advocates. 

Our  approach  is  to  study  the  performance  of  a  collection  of  numerical 
algorithms  written  in  Id  which  is  available  to  users  of  Motorola's 
dataflow  machine  Monsoon.  We  will  study  the  dataflow  performance  of 
these  implementations  first  under  the  parallel  profiling  simulator  Id 
World,  and  second  in  comparison  with  actual  dataflow  execution  on  the 
Motorola  Monsoon.  This  approach  will  allow  us  to  follow  the  computa¬ 
tional  and  structural  details  of  the  parallel  algorithms  as  implemented  on 

*11111  work  was  done  under  the  auspices  of  the  U.  S.  Department  of 
Energy  contract  No.  W-7405-ENG-36. 


dataflow  systems.  When  running  our  programs  on  the  Id  World  simulator 
we  will  examine  the  behaviour  of  algorithms  at  dataflow  graph  level, 
where  each  instruction  takes  one  Umestep  and  data  becomes  available  at 
the  next.  This  implies  that  important  machine  level  phenomena  such  as 
the  effect  that  global  communication  time  may  have  on  the  computation 
are  not  addressed.  These  phenomena  will  be  addressed  when  we  run  our 
programs  on  the  Monsoon  hardware.  Potential  ramifications  for  compila¬ 
tion  techniques,  functional  programming  style,  and  program  efficiency  are 
significant  to  this  study.  In  a  later  stage  of  our  research  we  will  compare 
the  efficiency  of  Id  programs  to  programs  written  in  other  languages. 
This  comparison  will  be  of  a  rather  qualitative  nature  as  there  are  too 
many  degrees  of  freedom  in  a  language  implementation  (on  language, 
compiler,  and  target  machine  level)  for  a  quantitative  companson  to  be  of 
interest 

We  begin  our  study  by  examining  four  routines  that  exhibit  different 
computational  characteristics.  These  routines  and  their  corresponding 
characteristics  are  listed  below: 

(1 )  Fast  Fourier  Transforms  (FFT) 

•  computational  parallelism 

•  data  dependences  between  the  butterfly  shuffles 

(2)  Adaptive  Quadratures 

•  dynamic  unrolling  of  recursively  adaptive  grid  refinements 

(3)  Efgenvalue/vector  Solvers 

•  application  of  cyclic  rotations  (incremental  array  updates) 

(4)  Stochastic  Simulations 

•  data  accumulation 

Details  of  our  implementation  and  performance  analysis  will  be  presented 
during  the  session's  presentation.  For  economy,  wc  chose  to  describe 
only  one  of  the  four  routines  that  have  been  analyzed  at  this  time. 

FFT 

A  fast  fourier  transform  (FFT)  routine  was  written  in  Id  by  J.  Michael 
A'hley,  a  former  summer  student  at  Los  Alamos  National  Laboratory. 
The  FFT  exhibits  both  divide  and  conquer  and  loop  parallelism.  The 
relevant  Id  program  segments  are: 

Dcf  Main_fft  Size  of_V  = 

{  C  =  (  array  (1 ,  sTzc_of_V)  |  [i]  =  Cmplx  ft  *  1  0)  0.0 
||  j  <- 1  loSize_of_V  ) ; 

InFFTC } ; 

Dcf  FFT  V  =  {  (_,Size_of_V)  =  bounds  V ; 

In  {if  (Sizc_of_V  =  1)  then  V 
else 

((Lcft_V,  Right.V)  =  Shuffle  V ;  FFT_L=  FFT  Lcft_V ; 

FFT_R  =  FFT  Right_V ;  Mid  =  fix  (Sizc_of_V  /  2) ; 

X  =  Two_Pi  /  Size_of_V ; 

Coeff=  (  array  (1,  Mid) 

|  [i]  =  Cmplx  (cos  (X  *  (i-1)))  (-sin  (X  *  (i-J))) 

||  i  <- 1  to  Mid  }; 

Prod  =  { array  (1,  Mid)  |  {ij  =  Cmplx_Mul  Cocffli]  FFT_R[iJ 
II  i  <- 1  to  Mid  );  j; 

In  { array  (1 ,  Sizc_of_V) 

I  [i]  =  Cmplx_Add  FFT_L[iJ  Prod[iJ  ||  i  <- 1  to  Mid 
j  [Mid+iJ  =  Cmplx_Sub  FFT_L(iJ  Prod[iJ  ||  i  <- 1  to  Mid  }  )  }; 
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Shuffle -V  =  {  (_,  Size  of  V) = bounds  V ;  Mid  =  fix  (Size  of  V 12); 

In  ({uny  (1,  Mid)  |  [i]  =  V[(i*2)-l]  ||  i  <- 1  to  Mid  }; 

{  array  (I,  Mid)  |  [i]  =  V(i‘2]  ||  i  <- 1  to  Mid  )) ) ; 

Note  that  in  FFT  a  recursive  invocation  of  FFT  is  applied  to  Left_V  and 
Right_V  (the  odd  and  evenelcments  of.V,  respectively)  until  the  butterfly 
shuffle  on  V  has  been  completed.  The  array  element  data  dependences 
occurring  in  the  recombination  of  smaller  results  into  larger  ones  are 
expressed  in  three  array  comprehensions  defining  the  values  of  the  arrays 
Coeff,  Prod,  and  the  result  of  FFT.  Running  the  above  program  under  the 
Id  world  simulator  for  a  Size_of_V  of  128  gives  us  the  following  parallel¬ 
ism  profile: 


(3400) 

I 

I 

I 

I 

I 

I 

I  I 
I  I 
I  I 
I  I 
I  1 
)  I 
I  I 

/  I 

/  I 

_  I  l_ 

/  X  \ - — - B - 

0.... 100.... 200.... 300 _ 400 _ 500 


Fig. -1.  Parallelism  profile  of  FFT  128. 

ANALYSIS 

The  simulator  assumes  that  each  instruction  takes  one  timestep  and  thit 
the  results  of  an  instruction  execution  are  available  the  next  timestep. 
Thit  approximation  leads  to  an  idealised  graph  interpretation  in  which 
maximally  parallel  execution  proceeds  along  a  critical  path  via  a  sequence 
of  indivisible  times leps.  The  graph  in  figure  1  plots  the  number  of 
instructions  executed  at  each  timestep,  and  consequently  pictures  the  ideal 
parallelism  profile  of  FFT  128. 

When  studying  Fig.  1,  we  observe  the  following,  first  there  is  explosive 
divide  and  conquer  parallelism  (A),  followed  by  (B)  a  stretch  of  low 
parallelism.  A  second  less  significant  burst  of  parallelism  (C)  follows 
which  dies  down  to  an  almost  sequential  tail  (D).  For  largerproblcms  the 
two  sequential  stretches  (B  and  D)  are  observed  to  dominate  more  and 
more.  The  parallelism  profile  drawn  in  fig.  1  is  very  disappointing  since 
the  computational  parallelism  is  known  to  be  very  large.  To  begin  to 
understand  this,  we  know  that  the  FFT  program  takes  0(Iog(n))  parallel 
steps  to  unfold  all  FFT  and  Shuffle  functions.  This  accounts  for  the  first 
bunt  (A)  of  the  divide  and  conquer  parallelism.  Once  the  functions  have 
been  unfolded,  the  loops  (array  comprehensions)  dictates  the  parallelism 
and  consequently  the  speed  of  the  compulation.  In  the  first  instance  the 
dominant  loop  is  the  array  comprehension  in  the  main  function  creating 
the  original  function  values  to  be  transformed. 

"Since  a  considerable  amount  of  work  may.  go  into  the  activation  of  a 
loop-body,  a  loop  analysis  is  performed  on  two  simple  loops: 

DefWWnm  =  {  s=0;  r=0; 

In(while(s<n)<k>nexts  =  s+  1; next r=r+Wm; finally r)  }; 
where 

DcfWn  =  { s=0; 

In  {while(s<n)donexts  =  s+  1;  finally  s)  }; 

Through  an  analysis  of  these  two  loops,  it  is  found  that  WW  (a  doubly 
nested  loop)  requires  five  (5)  steps  on  the  critical  path  to  instantiate  each 
inner  loop-body,  that  is,  every  five  parallel  steps  a  new  inner  loop  is 
spawned  off.  As  the  inner  loop  bodies  are  skewed  on  top  of  each  other, 
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the  number  of- them  that  run  in.  parallel  is  equal  to  the  critical  path 
required  to  execute  an  inner  loop  divided  by  the  rate  at  which  the  loop  can 
spawn  off  the  next  inner  loop.  Figure  2  sketches  a  parallelism  profile  for 
WW6420: 
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Fig.  2.  Parallelism  Profile  for  a  nested  loop. 

Clearly,  the  loop  rate  plays  an  important  role  in  the  parallelism  of  a  pro¬ 
gram.  Phase  B  in  Fig.  1  show  this  loop  behavior  where  the  dominant 
loop  is  the  array  comprehension  in  the  main  function  creating  the  original 
function  values  to  be  transformed.  Once  every  5  parallel  steps  an  array 
element  is  created  and  sent  through  the  log(n)  stage s  of  the  FFT. 

The  completion  of  the  FFT  is  dependent  on  the  loop  rate  and  the  creation 
of  the  last  two  elements  of  the  original  stray.  When  the  last  two  elements 
go  into  the  FFT  (phase  (C)  in  Fig.  1),  the  remaining  stages  of  the  compu¬ 
tations  can  be  done  with  divide  and  conquer  parallelism. 

The  last  sequential  tail  (  phase  (D)  figure  1)  is  caused  by  the  array 
comprehension  in  FFT  that  generates  the  resulting  array. 

SOLUTION 

The  solution  to  this  problem  is  to  unroll  loops  fast  enough  so  that  they 
don’t  cause  unnecessary  delay.  This  has  been  recognized  by  a  number  of 
dataflow  teams,  who  invented  special  instructions  (very  similar  to  vector 
instructions)  to  rapidly  create  parallel  workload  especially  in  loops  (itera¬ 
tive  instructions,  repeat  mechanism)., Id  docs  not  have  this  type  of  instruc¬ 
tions,  but  it  is  still  possible,  although  at  a  consirably  higher  cost,  to  create 
array  elements  at  a  higher  rate  in  a  nested  loop.  Take  the  following  array 
comprehensions: 

Def  A n  =  {  array  (1, n) |  [i]  =i  ||i<- 1  to n); 

Def  Abn  =  {  array  (l,n)J  [i]  =  i  ||  j<- 1  ton  by  16&i<-jto  j+15); 

Some  statistics: 


n 

SI 

Sinf 

Ab 

n 

SI 

Sinf 

16 

223 

101 

16 

277 

118 

32 

399 

181 

32 

504 

123 

64 

751 

341 

64 

958 

133 

256 

2863 

1301 

256 

3682 

198 

In  the  above  table,  SI  stands  for  the  number  of  instructions  executed 
and  Sinf  stands  for  the  total  critical  pathlenglh.  Where  array 
elements  are  created  at  the  loop  rale  (5)  in  A,  they  are  created  at  a 
rare  of  16  elements  in  5  parallel  steps  in  Ab  (i.c.,  an  element 
production  rate  of  16/5).  This  comes  at  Ae  cost  of  higher  SI  figures. 

This  trick  can  be  employed  to  make  all  loops  in  the  FFT  program  go  at 
a  higher  clement  production  rate.  Applying  this  idea  to  Main_fft,  wc 
have: 

Def  Main_fft  Size  of_V  = 

{ C  =  (  array  (1,  Sizc_of_V)  1  [i]  =  Cmplx  (i  *  1.0)  0.0 

||  j  <- 1  to  size  by  16  &  i  <- j  to  j+15  ) ; 

InFFTC); 

To  apply  this  technique  to  FFT,  requires  keeping  track  of  the  shrinking 
vector  lengths.  The  application  of  this  technique  to  the  array  Coeff  in 
FFT  results  in: 
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if  Mid  >  16  then 

{ Coeff=  {  array(l.Mid) 

|  [i]  =  Cmplx  (cos  (X  *  (i-1)))  (-sin  (X  *  (i-1))) 

]|  j  <- 1  to  Mid  by  16&i<-jtoj+15) ; 

In  (  array  (1,  Size_of_V) 

|[i]  =  Add_cFFT_Ui]Prod[i] 
j|j<- 1  to  Mid  by  16  &  i  <-j  to  j+15  } } 

else 

{  Coeff  =  {  anay(l, Mid) 

|  [i]  =  Cmplx  (cos  (X  *  (i-1)))  (-sin  (X  *  (i-1))) 

||  i  <- 1  to  Mid  } ; 

In  (  array  (1,  Size  of  V) 

|  (i)  =  Add_cFFt_L{i]  Prod[i]  ||  i<- 1  to  Mid  }  >  ) 
Its  parallelism  profile  is  shown  in  Hg.  3. 
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Fig.  3.  Parallelism  of  unrolled  loops  in  EFT  128. 

The  critical  pathlength  is  about  30  percent  of  that  of  the  original  program, 
and  the  two  ugly  sequential  stretches  B  and  D  have  disappeared.  Now  the 
parallelism  of  the  program  is  satisfactory. 

It  turns  out  that  the  array  comprehensions  are  rather  inefficiently  imple¬ 
mented  in  Id.  In  the  talk  we  will  address  the  efficiency  issue  in  some 
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Abstract 

A  number  of  techniques  have  emerged  recently,  which  at¬ 
tempt  to  improve  on  the  multi-layer  perccptron  training  algo¬ 
rithm  [1],  by  changing  the  network  architecture  as  training  pro¬ 
ceeds.  These  techniques  include  pruning  useless  or  unnecessary 
nodes  or  weights,  and  adding  extra  nodes  as  required.  The  ad¬ 
vantages  to  be  gained  are  smaller  networks,  faster  training  times 
on  serial  computers,  and  increased  gcncralization  ability,  with  a 
consequent  immunity  to  noise.  In  addition,  it  is  frequently  much 
easier  to  interpret  what  the  network  is  doing.  One  can  then  be¬ 
gin  to  draw  analogies  with  other  pattern  classifying  techniques 
such  as  decision  trees  and  expert  systems.  We  review  these  tech¬ 
niques,  suggesting  the  classes  of  problem  to  which  they  arc  most 
applicable,  and  indicaw.  possible  future  work-in  this  direction. 

1  Introduction. 

Multi  layer  perccptron  networks  are  well  established  as  a  standard 
neural  network  technique  for  pattern  recognition  tasks.  They  arc  ham¬ 
pered,  however,  by  a  number  of  problems  and  arbitrary  parameters 
which  make -them  much  less  dependable  and  predictable  than  they 
could  otherwise  be.  The  main  problem  is  that  there  is  no  way  of  de¬ 
termining  in  advance  how  many  units  there  should  be  in  the  hidden 
layer.  If  there  are  too  few,  the  network  may  not  learn  at  all,  while 
too  many  hidden  nodes  lead  to  over-learning  of  individual  samples  in 
the  training  data,  at  the  expense  of  forming  an  optimal  model  of  the 
data  distributions.  This  leads  to  an  inability  to  generalise,  so  that 
previously- unseen  data  are  labelled  according  to  the  nearest  training 
sample,  rather  than  in  accordance  with  a  good  model  of  the  prub 
lcm.  Despite  numerous  analytical  and  heuristic  attempts  to  determine 
this  number,  [2,3]  no  general  and  reliable  metliod.has  emerged  until 
recently. 

Recent  developments  fall  into  two  categories.  Pruning  algorithm* 
build  and  train  a  large  network,  and  then  remove  nodes  which  con¬ 
tribute  little  to  the  network's  operation,  while  constructive  algorithm s 
attempt  to  form  an  approximate  solution  using  a  small  network,  and 
then  add  further  nodes  to  increase  the  precision -as  required.  It  lots 
been  demonstrated  [1]  that  a  larger  network  is  generally  required  to 
learn  a  classification  task,  than  is  needed  simply  to  implement  a  known 
solution  using  predetermined  network  weignts.  To  this  end,  an  ideal 
algorithm  for  determining  network  architecture  might  add  nodes  dur¬ 
ing  early  training,  and  apply  pruning  selectively  as  a  solution  is  ap¬ 
proached.  The  need  for  additional  nodes  to  enable  the  learning  of  a 
solution  arises  because  a  network  of  the  minimal  size  to  solve  a  prob¬ 
lem  is  likely  to  get  stuck  in  one  of  many  locally  optimal  solutions  in 
the  training  phase.  In  constructive  algorithms  we  hope  that  the  local 
optima  in  which  we  find  ourselves  will  represent  a  reasonably  good 
approximation  to  the  true  solution,  and  we  escape  it  by  the  addition 
of  more  free  parameters  to  the  network.  To  work  well,  the  new  param 
ctcrs  must  be  added  with  predetermined  values  so  that  the  solution 
of  the  new  network  is  at  least  no  worse  than  that  of  its  parent.  By 
pruning  weights  (or  nodes)  which  do  not  contribute  significantly  to 
the  classification  or  mapping  task,  we  hope  to  reduce  to  a  minimum 
the  number  of  degrees  of  freedom  used  by  the  network  to  implement 
the  solution,  thereby  ensuring  we  have  a  simple  model  of  the  system. 
One  way  of  making  this  obvious  implementation  of  Occam’s  Razor, 
is  to  minimise  the  total  activation  in  the  hidden  layer,  which  encour 
ages  the  nodes  there  to  act  orthogonally.  This  is  the  same  behaviour 


for  which  we  aim  in  inductive  inference,  ie.  in  decision  trees  and  au¬ 
tomatically  generated  expert  systems.  It  may  be  possible  to  extract 
information  directly  from  the  weights  of  such  a  network,  allowing  us 
to  determine  the  problem-solving  rules  that  have  been  learned.  Nat¬ 
urally  the  reduction  of  the  number  of  nodes  to  a  minimum  detracts 
from  the  fault  tolerance  usually  associated  with  neural  networks,  and 
so  some  thoughtis  needed  before  such  minimalist  techniques  arc  used 
for  a  particular  application. 

2  The  MLP  training  algorithm. 

We  briefly  summarise  the  training  algorithm  described  in  [1].  In  the 
notation,  oPJ  denotes  the  output  of  unity,  upon  presentation  of  pattern 
p.  Unit  j  is  connected  to  unit  *  by  a  synapse  or  weight  of  strength  to;;, 
and  computes 

°pj  =  U) 

t 

where  f  is  a  differentiable,  non-linear  function.  The  desired  output  for 
output  unity  on  presentation  of  pattern  pis  denoted  tn,  and  the  global 
error  of  the  network  after  the  presentation  of  some  training  patterns 
is  defined  as 

£  =  (2) 

P  3 

where  the  inner  sum  is  over  neurons  considered  to  be  output  nodes, 
and  the  outer  sum  is  over  the  patterns  that  have  been  presented. 

Optimization  is  achieved  usually  by  gradient  descent,  Newton's 
method,  or  conjugate  gradients, [5,0]  all  of  which  use  the  derivatives  of 
the  network  error  with  respect  to  the  parameters  to  be  optimised.  We 
define  an  error  measure  in  terms  of  the  activations  of  output  units, 
which  can  be  differentiated;  the  term  back-propagation  refers  to  the 
repeated  calculation  of  the  corresponding  derivatives  for  the  previous 
layer.  The  chain  rule  for  partial  derivatives  leads  to  the  generalised 
delta  ruleql]  which  indicates  how  these  quantities  and  the  appropriate 
weight  updates  arc  to  be  calculated.  Minimization  of  the  sum  squared 
error  with  respect  to  the  free  parameters  in  the  network  leads  the 
network  to  approximate  the  Bayes  discriminant  vector,  the  probability 
of  a  class  given  the  input  to  the  network.  [31] 

3  Constructive  Algorithms. 

Early  constructive  algorithms  built  multi-layer  fccd-forward  networks 
of  perccptron  units, [7]  which  could  be  applied  to  problems  involving 
binary  input  patterns.  Convergence  of  such  a  network  is  guaranteed 
if  the  training  data  is  linearly  separablc.Js)  Iho  Pocket  Algorithm  [9j 
is  an  extension  of  the  Perccptron  Learning  Rule, (10)  which  allows  ap¬ 
proximate  solutions  to  be  found  for  non  linearly  separable  problems,  by- 
holding  in  one's  pocket’  the  best  set  of  weights  found  so  far.  For  binary- 
patterns,  it  is  always  possible  to  cut  off  a  corner  of  the  binary  hyper- 
cube  with  a  plane,  thereby  ensuring  that  we  can  learn  a  binary  func¬ 
tion  of  binary  patterns  by  repeatedly  adding  perceptions  to  a  network. 
These  techniques  have  been  implemented  in  liic  Tiling  nlgonthm,{t  ij 
although  this  been  superseded  by  the  Upstart  Algorithm, [i2,13j  which 
is  more  efficient- in  terms  of  the  number  of  nodes  created.  They  build 
trcc-likc  networks  with  finer  resolution  of  the  input  space  at  the  leaves 
of  the  tree,  and  do  not  usually  include  a  stopping  criterion  to  halt 
the  addition  of  new  nodes  or  layers.  Ibis  means  that  every  sample  in 
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the  training  set  is  learned,  but  has  strong  repercussions  if  the  training 
data  is  incomplete,  has  noise,  or  is  derived  from  a  classification  prob¬ 
lem  where  the  class  distributions  overlap.  These  networks  are  good  for 
learning  completely- a  logical  data  set,  but  cannot  form  a  useful  model 
of  many  statistical  distributions. 

Later  methods  [14-18,3-1]  apply  to  non-binary  functions  of  non- 
binary  inputs.  They  usually  build  a  single  hidden  layer,  which  has  an 
advantage  over  the  ‘deep  network’  methods  that  the  propagation  time 
for  data  from  the  input  to  the  output  is  shorter,  and  constant.  This 
is  particularly  important  for  real  time  signal  processing  applications, 
but  not  usually  in  simulated  networks  used  for  classification.  They  do 
not  guarantee  to  learn  every  sample  in  the  training  set,  but  are  more 
likely  than  the  earlier  algorithms  to  converge  to  solutions  with  good 
generalization  ability  for  statistical  problems. 

3.1  Tiling  Algorithm  and  Upstart  Algorithm. 

The  Tiling  Algorithm  builds  a  layered  network,  with  each  layer  ap¬ 
proximating  the  solution  of  a  binary  function  of  classification  problem 
more  closely  than  the  previous  one.  A  master  unit  in  each  layer  learns 
at  least  one  new  pattern,  and  the  ancillary  units  ensure  that  no  pre¬ 
viously  learned  patterns  arc  lost.  The  algorithm  creates  only  as  many 
nodes  as  it  needs  to  build  a  solution,  and  it  has  been  demonstrated  to 
have  good  generalization  capabilities.  On  the  down  side  it  requires  an 
excessively  large  number  of  nodes,  as  most  ancillary  units  just  dupli¬ 
cate  the  action  of  those  in  the  previous  layer.  This  problem  is  avoided 
in  later  methods  (Upstart,  Cascade  Correlation),  b>  allowing  connec¬ 
tions  to  span  many  layers.  A  recent  method  which  has  grown  out  of 
the.  Tiling  Algorithm  is  the  A'curaf  Tree, [30]  which  makes  repeated  use 
of  the  Pocket  Algorithm  to  divide  the  input  space  into  partitions  for 
classification,  and  builds  a  decision  trcc[36]  as  it  docs  so.  No  results 
have  been  published  to  date,  but  the  method  looks  very  promising. 

The  Upstart  Algorithm  builds  a  binary  tree  of  nodes.  For  each 
node,  one  subtree  corrects  all  errors  where  acne  is  expected,  and  the 
other  corrects  all  errors  where  a  zero  is  expected.  Each  subnodc  is 
guaranteed  to  classify  at  least  one  of  its  targets  correctly,  and  so  con¬ 
vergence  is  guaranteed  for  the  problem.  The  number  of  nodes  grows 
linearly  with  the  number  of  training  patterns  for  the  theoretically  hard¬ 
est  problem,  a  random  boulean  function,  and  this  is  better  than  the 
node  growth  rate  of  the  Tiling  Algorithm.  Training  can  be  speeded 
up  if  each  subtree  is  trained  using  only  the  patterns  that  have  not 
already  been  learned  elsewhere  in  the  tree.  Extensions  arc  possible 
whereby  the  trained  network  is  mapped  directly  onto  a  feed  forward 
network  with  only  one  hidden  layer.  The  Upstart  Algorithm  is  eas¬ 
ily  extended  to  classifiers  with  several  possible  output  classes,  while 
preserving  many  of  its  advantages. 

3.2  Dynamic  Node  Creation  in  Standard  MLPs 

Ash  [15)  describes  a  system  where  the  error  rate  is  analysed  as  train¬ 
ing  proceeds,  and  a  new  hidden  node  is  added  whenever  the  error  is 
no  longer  decreasing  significantly,  but  is  not  acceptably  low.  The  new 
nodes  arc  introduced  with  small  random  weights,  and  the  results  arc 
encouraging  when  compared  with  the  training  times  required  by  stan¬ 
dard  networks  of  fixed  size.  The  scheme  includes  an  analysis  of  when 
new  nodes  should  be  added,  based  on  the  assumption  that  the  error 
rate  decreases  exponentially  as  training  proceeds,  but  the  author  feels 
that  a  better  way  is  needed  for  determining  the  initial  weight  values 
of  the  new  nodes,  as  small  random  weights  do  not  guarantee  that  the 
larger  network  is  at  least  as  good  as  the  old  one. 

A  similar  scheme  [IG.31]  adds  new  nodes  to  the  hidden  layer,  but 
speeds  up  training  by  freezing  the  weights  of  the  previous  ones.  Back 
propagation's  properly  of  attempting  to  force  each  hidden  node  to 
account  individually  for  all  the  error  in  the  output  layer  means  that 
the  newly  introduced  nodes  learn  the  errors  of  the  previous  network 
with  frozen  weights.  Interestingly,  this  feature  Is  usually  Considered  a 
disadvantage,  as  the  use  of  'teamwork'  amongst  nodes  might  be  ex 
peeled  to  find  a  solution  more  quickly. 


3.3  Cascade  Correlation 

In  this  algorithm,  which  applies  to  real-valued  inputs  and  outputs,  hid¬ 
den  units  are  added  with  inputs  from  all  previous  input  and  hidden 
units.[Id]  The  weights  to  all  previous  units  arc  frozen,  and  the  new 
unit  learns  a  mapping  which  has  the  best  possible  correlation  with  the 
errors  of  the  previous  network.  The  weights  to  the  new  unit  are  then 
frozen,  and  the  process  continues  until  there  are  no  more  errors.  This 
method  is  not  limited  to  binary  classifications,  although  published  re¬ 
sults  only  cover  these  problems.  There  is  no  back-propagation,  with 
the  result  that  the  networks  train  quickly;  the  specii  compares  very 
favourably  with  both  backprop  and  ‘quickprop’  (19,20)  when  learning 
to  separate  two  interlocked  spirals.  The  problem  of  learning  individual 
samples  from  overlapping  distributions  might  be  addressed  by  contin¬ 
uing  the  development  of  a  network  until  the  error  figure  found  by 
correlation  decreases  to  the  value  expected  from  prior  knowledge  of 
the  problem.  This  could  be  a  noise  model,  or  a  measure  of  the  degree 
to  which  the  data  distributions  are  known  to  overlap.  Since  Cascade 
Correlation  builds  tall  networks,  with  many  layers  and  connectivity 
from  each  layer  to  all  earlier  layers,  it  has  the  advantage  of  enhanced 
feature  detection  over  the  networks  described  in  the  previous  section. 
On  the  other  hand,  the  many-layered  architecture  leads  to  a  variable 
delay  between  application  of  an  input  and  the  appearance  of  the  result. 


3.4  Meiosis  Networks. 


Meiosis  networks  [17]  arise  from  an  approach  to  multi  layer  perccp 
irons  which  combines  the  usual  gradient  descent  optimisation  with  a 
stochastic  search.  This  has  the  advantage  that  it  is  possible  for  the 
network  to  escape  from  a  local  minimum  by  a  random-perturbation 
in  the  weight  space,  with  a  probability  which  decreases  as  the  net 
work  approaches  a  good  solution.  This  is  implemented  using  stochas 
tic  weights,  sampled  from  gaussian  distributions  each  time  a  weight 
value  is  required.  The  learning  algorithm  updates  the  mean  and  the 
standard  deviation  of  this  distribution.  Thus  there  are  three  learning 
rules,  the  mean  is  updated  according  to  the  normal  learning  rule  de¬ 
scribed  in  §2.  The  standard  deviation  is  increased  at  each  update  to 
reflect  the  uncertainty  indicated  by  a  large  update,  and  decays  with 
time,  allowing  the  weights  eventually  to  become  deterministic. 

Meiosis  is  the  process  of  one  node  splitting  to  create  two  new  ones. 
The  composite  variance  of  input  and  output  weights  is  computed  for 
each  node  in  the  hidden  layer,  and  the  split  occurs  for  any  node  whose 
composite  variance,  that  is  the  standard  deviation  relative  to  the  mean, 
is  greater  than  100%. 


>  1  and  >  1. 
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(3) 


Each  new  weight  has  a  mean  which  is  a  jittered  copy  of  the  original, 
and  each  has  half  the  variance  of  the  old  weight  distribution.  This 
kind  of  splitting  policy  has  the  advantage  that  it  docs  not  converge 
to  a  complete  fit  of  the  training  data,  and  consequently  the  result¬ 
ing  networks  are  likely  to  exhibit  better  generalization  than  the  ones 
produced  by  the  Pocket,  Tiling  and  Upstart  algorithms.  It  has  the  ad¬ 
ditional  advantage  that  the  decision  on  whether  to  split  is  made  using 
only  locally  measured  parameters. 


3.5  Summary:  What  to  do  next  with  constructive  algo¬ 
rithms 

The  author  feels  that  constructive  algorithms  lack  a  good  mechanism 
for  determining  the  weights  of  a  newly  added  node,  although  Meiosis 
is  good  in  the  context  of  stochastic  weights.  Accepting  the  idea  of 
adding  new  nudes  by  splitting  an  old  one  in  two,  we  also  require  a 
good  measure  of  the  degree  to  which  a  given  node  requires  splitting. 
In  our  own  work, [In]  we  propose  a  new  split  mechanism,  and  build  on 
earlier  ideas  from  pruning,  to  obtain  an  ordered  list  of  nodes  with  the 
most  prunablc  at  one  end,  and  the  most  splitlable  at  the  other. 
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4  Pruning 

Pruning  has  been  carried  out  on  networks  in  three  distinct  ways.  The 
first  is  a  heuristic  approach,  based  on  identifying  which  nodes  and 
weights  contribute  little  to  the  mapping.  After  these  have  been  re¬ 
moved,  additional  training  leads  to  a  network  which  is  better  than  the 
original.[4]  An  alternative  technique  is  to  include  terms  in  the  error 
function,  so  that  the  weights  tend  to  zero  under  certain  circumstances. 
Zero  weights  can  be  removed  without  degrading  the  performance  of  the 
network.  Finally,  if  we  define  the  sensitivity  of  the  global  network  er¬ 
ror  to  the  removal  of  a  weight  or  node,  and  evaluate  it  for  each  such 
parameter  in  the  network,  we  can  then  remove  the  weights  or  nodes  to 
which  the  global  error  is  least  sensitive.  The  sensitivity  measurement 
docs  not  interfere  with  training,  and  involves  only  a  small  amount  of 
extra  computational  effort.  It  is  also  well  matched  for  implementation 
alongside  the  node-adding  scheme  described  in  §3.5. 

4.1  Heuristic  Pruning 

Sictsma  and  Dow  [••]  have  described  a  pruning  scheme  based  on  ana¬ 
lysing  automatically  the  activations  of  nodes,  in  response  Ui  different 
patterns  in  the  training  data.  Their  pruning  takes  piacc  in  three  dif¬ 
ferent  ways: 

•  Pruning  of  units  that  do  nothing,  or  duplicate  the  action  other 
units.  A  unit  is  ndundant  if  it  has  the  same  output  for  all 
patterns  in  the  training  data,  or  duplicates  the  action  of  another 
node. 

•  Pruning  of  units  that  provide  unnecessary  information.  Ifa  node 
makes  a  distinction  between  patterns  that  arc  later  recombined, 
then  ti.o  node  can  be  deleted. 

•  Pruning  out  an  entire  network  layer.  A  network  with  many  layers 
may  well  have  one  or  more  of  them  redundant,  especially  after 
the  earlier  stages  of  pruning  have  been  carried  out.  Indeed,  it 
has  been  shown  [21,33]  that  one  hidden  layer  is  theoretically 
sufficient  to  implement  any  problem,  although  this  may  require 
more  nodes  than  a  multi  layer  network. 

4.2  Pruning  which  is  inherent  in  the  learning  algorithm 

This  lower-level  aproach  is  more  appealing,  as  the  constraints  on  struc¬ 
ture  for  the  network  come  from  the  network  itself,  rather  than  from  a 
global  monitoring  system  as  describcd  in  §4.1.  On  the  other  hand,  sys¬ 
tems  have  been  proposed  where  processes  such  as  adding  nodes  and 
pruning  vvould  be  carried  out  by  exactly  this  type  of  global  control 
process,  which  could  itself  he  a  rule  based  system  or  a  neural  network. 

4.2.1  Minimising  a  Biased  Cost  Function 

In  standard  learning  techniques  we  optimise  a  network  in  terms  of  a 
cost  function  which  describes  ihc.goodncss  of  fit- of  the  modci  stored 
in  the  network,  to  the  data  representing  the  problem  to  be  learned. 
A  second  term  can  be  added  to  the  cost  function  tcq.4j  incorporating 
prior  knowledge  of  the  problem,  such  as  the  kind  of  architecture  which 
is  likely  to  be  most  useful  for  the  problem,  constraints  on  weight  val¬ 
ues,  or  constraints  on  the  function  implemented  by  the  network.  A 
constraint  on  the  function  implemented  might  be  that  the  network 
should  not  learn  to  classify  individual  samples  from  overlapping  or 
noisy  distributions;  elimination  of  sucii  unlikely  solutions  leads  to  the 
extra  term  being  referred  to  as  a  inu  ui  njoioiijiiij  unit  in  the  ficiik 
of  non-paramctric  statistics. 

0=E+/f  (4) 

In  relation  to  pruning  networks,  or  the  production  of  minimal  ar¬ 
chitectures,  the  constraints  we  wish  to  apply  by  means  of  the  bias 
term  will  he  such  that  they  minimise  the  number  of  active  nodes  or 
weights  in  the  network.  These  can  be  removed  from  the  network  hefnre 
training  Is  continued. 

Rumelhart's  pruning  mechanism*  unpublished  i  involves*  bias  ion 


*  3 

giving  a  modified  weight  update  rule 

trS(ii  +  1)  =  -c-^-{n)+pWij(n).  (6) 

This  causes  the  weights  to  dccay  cxponcntially  towards  zero,  and  this 
aproach  was  successfully  used  by  Hinton  in  some  experiments  on  ana¬ 
lysing  the  use  of  hidden  layers  and  a  representational  bottleneck  toen- 
courage  good  generalisation.^]  Weights  which  come  sufficiently  dose 
to  zero  in  the  weight  decay  scheme  can  be  pruned  out.  This  work  was 
taken  a  step  further  by  Hanson  and  Pratt  [22],  and  Rumclhart,  with 
the  aim  that  high  and  low  wdghts  should  decay  strongly,  while  mid- 
range  weights  are  left  unaffected.  High  weights  arc  discouraged  for 
reasons  of  smoothness,  while  low.  wdghts  can  be  pruned.  These  exper¬ 
iments  showed  that  dificrent  bias  terms  arc  indeed  useful  for  finding 
minimal  architectures,  but  the  bias  term  could  not  easily  be  used  in 
conjunction  with  the  momentum -term  used  traditionally  for  avoiding 
local  minima.  Perhaps  the  biased  cost  function  could  be  combined 
with Hanson’s  stochastic  search  MLP  so  that  the  traditional  momen¬ 
tum  term  would  no  longer  be  needed. 

Biased  cost  functions  have  been  used  in  other  applications  tco,  first 
for  pruning  nodes  by  including  a  total  node  relevance  term  in  the  cost 
function. [23j  The  relevance  term  is  defined  as  a  product  of  functions  of 
the  weights  into  and  out  of  a  node,  and  minimising  the  cost  function 
then  minimises  the  total  number  of  relevant- nodes.  This  kind  of  node 
decay  (cf.  weight  decay,  above)  has  not  been  analysed  in  detail,  but 
gives  promising  initial  results.  A  second  example  encourages  the  oati- 
maluse  of  hidden  units,  [29]  by  including  the  hidden  layer  activations 
in  the  cost  function  to  be  minimised,  and  hence  forcing  the  units  to  act 
orthogonally.  This  aticmp-s  to  a.uid  unnecessary  units  right  from  the 
start  of  training,  rather  than  allowing  them  to  develop  and  eliminating 
them  later.  This  technique  could  prove  useful  in  the  context  of  :ntc 
grating  neural  networks  with  expert  systems  ut  decision  trees,  since 
these  systems  attempt  to  invoke  independent  rules  whenever  possible. 

The  initial  aim  of  Rumelhart's  use  of  the  biased  cost  function  was 

to  avoid  large  weights,  am*  consequently  to  ensure  smoothness  of  the 

mapping  implemented  by  a  network.  A  sigmoid  transfer  function  is 
linear  for  small  input  values,  but  approximates  to  a  step  function  for 
larger  values  (and  hence  for  small  weights;)  step  functions  arc  neces¬ 
sary  to  classify  individual  samples  from  a  statistical  distribution  and 
we  have  already  been  emphasised  in  §3  that  this  should  be  avoided  if 
at  all  possible. 

An  alternative  approach  to  discouraging  the  fitting  of  individual 
samples,  again  emphasising  the  power  of  the  biased  cost  function,  is 
to  include  a  term  in  the  cost  function  representing  the  curvature  of 
the  mapping,  averaged  over  the  input  domaln.^Oj  The  elimination  of 
high  curvature  eliminates  sharp  transitions,  and  has  a  similar  clTcct 
to  the  bias  term  in  equation  5.  In  addition.  If  the  data  ...stributions 
aic  smooth,  and  the  curvature  of  the  mapping  is  minimised,  the  per 
formancc  is  likely  to  he  improv'd  for  the  classification  of  previously 
unseen  patterns.  Minimal  nctwoiks  implementing  low  curvature  map 
pings  wouid  also  be  more  likely  to  perfoim  usefully  in  extrapolation, 
that  is  foi  the  classification  of  patterns  outside  the  Input  domain  rep 
resented  bv  the  training  data. 

.j.2.2  Pruning  according  to  an  ordered  list  of  node  or  vseight 
relevances 

Mozer  and  Smolensky  [2-1]  opt  for  an  'all  or  none'  approach  So  prun¬ 
ing,  ralher  Shan  gradual  pruning  by  means  of  weight  decay.  They 
investigate  the  relevance  of  a  unit  in  the  network,  defined  as 

pt  —  Tv,:-  s-if  i  -  f  -o v  s«. «  1 1 1 

so  that  the  relevance  of  a  unit  depends  on  how  much  the  network  global 
error  will  increase  if  the  node  is  removed.  P tuning  «<roM  then  In'  ap 
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plLil  for  the  least  relevant, units.  The  relevance  me;u  ire  is  determined 
by  the  shape  of  the- error  surface  around  the  minimum-to  which  the 
network  has  been  trained.  This  is  best  characterised  for  a  parabolic 
minimum  by  the  first  and  second  derivatives  according  to  the  Taylor 
series,  namely 


.  dF,(a)  ,  s  ,  1  d2E(a) 
E(a)  =  E(j o)  +  —jr—  («  -  «o)  +  - 

a=ao  ■* 


da1 


(a  -  a0)2 
a=rao 


(8) 


is  solved  for  Upstart  by  transfunuing  the  tiaincd  netwuih.  The  best 
criterion  for  pruning  appears  to  be  the  iiicasuic  of  the  sensitivity  of  the 
network  error  to  the  piesence  of  a  parametei,  ambit  is  hoped  that  this 
will  vely  soon  be  used  as  the  basis  of  an  integiated  system  foi  building 
networks,  incorporating  construction  in  early  training.and  pruning  as 
a  solution  is  reached,  enabling  an  optimal  architecture  to  bo  found. 

6  References 


although  Mozer  and  Smolcnsky  propose  to  approximate  it  by  carry¬ 
ing  out  a  single  pass  of  back  propagation  with  a  linear  error  function, 
E  =|  opi  -  tpi  |,  so  that  the  gradient  is  non  zero  right  down  to  the  error 
minimum.  The  question  of  what  parameter  oi » hoii>>*  >,o  fi  as 
the  measure  against  which  the  shape  of  the  error  surfaced  is  measured, 
is  resolved  by  introducing  the  attentional  strength,  a  of  a  unit,  where 
the  output  of  the  unit  is  now  oj  -  i  w.-jaio;)  and  the  relevance  can 
be  expressed  as  p,  =  E(ai- 0)  -  -(a,=i)-  Relevance  is  determined  by 
the  shape  of  the  error  surface  around  the  value  a  —  1.  This  pruning 
technique  led  to  networks  from  which  rules  could  be  extracted  quite 
easily  for  low  dimensional  boolean  problems,  and  the  relevance  mea¬ 
sures  facilitated  an  evaluation  of  which  rules  were  the  most  frequently 
'i  voked  in  a  given  problem,  ie.  which  splits  in  the  feature  space  are  the 
rules,  and  which  are  the  exceptions.  Lc  Cun,  Denker  and  co-workers 
[25,20]  have  carried  out  similar  experiments  for  pruning  weights,  but 
used  the  second  dt  ,  ative  term  from  the  Taylor  series,  instead  of  the 
modulus  approximation.  The  second  derivatives  arc  found  by  back- 
propagation[25,26),  (or  by  measuremcnt(27])  and  the  results  are  very 
promising.  The  number  of  free  parameters  in  the  networks  used  to 
implement  handwritten  digit  recognition  [20]  was  reduced,  by  a  factor 
of  four.  There  are  no  results  available  of  comparisons  between  this 
pruning  methods  and'thosc  discussed  earlier,  but  this  gives  by  far  the 
most  convincing  way  of  identifying  which  nodes  are  to  be  pruned.  Ihe 
idea  of  an  ordered  list  of  sensitivities  of  the  network  global  error  to 
each  weight  was  used  also  by  Karnin.[28]  Ideally  the  sensitivity  would 
be  determined  by  integration  over  the  entire  weight  space,  but  since 
this  is  not  possible,  (cf.  training  by  exhaustive  search),  it  is  ii  teg!  vtod 
just  along  the  training  path.  It  seems  likely  that  the  sensitivity  found 
in  this  way  would  depend  most  strongly  on  the  starting  weights  (io. 
random)  and  not  bc-as  good  as  the  measures  described  above. 

5  Discussion 

We  have  discussed  a  number  of  techniques  which  aim  to  build  a  neural 
network  whoso  size,  and  hence  whose  number  of  internal  parameters, 
is  optimal  for  the  modelli..g  of  a  given  problem.  While  some  prob.cms 
are  most  efficiently  modelled  by  certain  types  ol.nevwork,  the  multi 
layer  perccptron  family  are  a  good  general  learning  toi  l  for  a  wide 
range  of  mouclling  applications.  Since  we  do  not  know  in  advance 
what  size -to  use,  and  because  we  usually  need  a  larger  network  to 
lec-rn  a  mapping  than  simply  to  implement  a  known  solution,  it  is 
sensible  to  allow  a  small  network  to  grow  during  early  training,  until  a 
reasonable  solution  is  found,  And  then  to  eptinrse  this  solution  during 
later  training,  to  give  a  small,  fast  and  efficient  network  which  is  an 
accurate  system  model. 

There  arc  a  variety  of  pruning  mechani  .ms,  and  constructive  algo¬ 
rithms  are  gradually  appearing  which  car  add  new  nodes  at  suitable 
times.  The  weights  foi  the  new  nodes  can  be  predetermined  to  ensure 
firstly  that  the  new  network  is  no  worse  than  the  old  one,  and  secondly 
that  it  can  be  expected  to  find  a  better  solution  with  fnrther  training. 

We  have  seen  that  a  measure  of  the  sensitivity  of  tho  network  to 
the  presence  of  weight  or  node  forms  a  good  criterion  for  determining 
whether  it  can  be  removed,  ar.d  that  at  the  other  end  of  the  scale, 
if  applied  to  nodes,  the  same  mesasurc  can  be  used  as  a  criterion  for 
splitting  a  nodi;  in  two. 

Of  the  current  constructive  algorithms,  Upst&H  appears  to  be  the 
best  for  binary  mappings,  while  the  best  for  real  valued  mappings  is 
Cascade  Correlation  Bcih-of  these  have  the  problem  of-iong  propa¬ 
gation  delays  from  the-networl.  inputs  to  tlte  output*,  although  t..is 
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Abstract 

Relative  few  papers  on  the  relationship  between  Neural  networks  (NN)  and 
Petri  nets  (PN)  are  known  (c.g.  (1],[5)).  Ot  her  groups  try  different  approaches : 
M.J.Murre  (Leiden  University,  Nctherland)  and  K.Lautcnbach  (University 
Koblcnz-Lindlau,  Germany).  Our  approach  is  to  use  Predicate  Transition 
systems  (PrT  systems).  The  result  is,  that  for  nonrecurrent  NN’s  a  be\pr- 
iorally  equivalent  PN  can  be  given.  The  proposed  technique  of  transforming 
NN’s  (with  and  without  backpropagation)  into  PN's  is  demonstrated  by  ex¬ 
amples.  H'e  show  some  differences  between  both  modeling  techniques  and 
also,  that  both  could  perhaps  gam  benefits  from  each  other,  if  they  were  put 
on  a  common  basis. 

NN  as  PrT  systems 

We  follow  about  the  NN  definitions  given  in  (4).  Predicate  Transition  systems 
(PrT  systems)  arc  a  widely  used  high  level  class  of  PN.  Details  about  PrT  sys¬ 
tems  can  be  found  in  [3], (7).  The  representation  of  a  NN  (without  backprop.) 
into  a  PrT  system  is  done  by  associating  to  each  unit  a  transition  and  to 
each  link  a  place.  Weights  occur  in  the  ‘equations’  associated  to  transitions, 
where  also  the  computation  of  activation  values  is  performed.  Example:  The 
NN  for  the  XOR-problein  is  shown  in  Fig  1,  the  corresponding  PrT  system 
in  Fig.  2. 


Figure  1:  A  NN  for  the  XOR  problem. 

The  input  marking  corresponding  to  the  input  pair  (x,y)  is  placed  in  the  input 
places  il,  i2  such  that  AfoO’l)  =  z,Afo(>2)  —  y,  where  Me  initial  marking. 
The  corresponding  PrT  system  is  ‘bchaviorally  equivalent’  to  the  NN,  in  the 
sense  that  for  each  input  given  to  the  input  units  of  the  NN,  the  marking  of 
the  output  place(s)  becomes  (after  firing  of  the  transitions)  identical  to  the 
output  values  of  the  output  units  (after  updating  the  corresponding  units). 
Lets  explain  the  PrT  system  of  Fig.  2  in.  detail.  The  transitions  correspond 
one-one  to  the  units  of  the  NN  (1  to  5).  For  input  units  we  add  input  places 
(il,  i2),  for  output  units  an  output  place  (o5).  For  each  link  between  two  units 
we  generate  a  place  and  connect  that  with  the  units.  The  arcs  are  labeled  i.g. 
with  formal  sums  of  tuples  <  (ji,  .  ,fm  >+...+  <  fmi,  •  ,Ui  >,  where 
the  tij  are  cither  variable  symbols  (starting  with  capital  letters)  or  terms 
over  some  set  of  operation  symbols  and  variable  symbols.  In  our-cxamplc 
m  =  n  =  1  and  each  i,y  is  a  variable  symbol.  The  markings  arc  taken  from 
that  set  of  formal  sums  too,  but  no  variable  symbol  must  occur  in  the  tij.  The 
labels  of  arcs  in  the  neighborhood  of  a  place  must  be  of  the  same  arity  (n)  as 
the  marking  of  that  place.  The  empty  tuple  allowed  too  in  markings  and 
arc  labels.  To  each  transition  a  conjunction  ofcquations  between  two  terms 
may  be  associated.  The  equations  must  all  be  satisfied  for  the  transition  being 
enabled. 

In  order  to  describe  the  dynamics  of  PrT  systems  assume  as  initial  marking 
e.g.  Mo(il)  =  0,A/o(il)  =  1.  Transitions  1,2  arc  enabled  now.  Transition 
1  is  enabled  for  the  substitution  {0//l,0//ll},  transition  2  is  enabled  for 
the  substitution  {0//i,G/Al}.  Under  these  substitutions  the  equations  as¬ 
sociated  to  the  transitions  become  0  =  G  and  1  —  1  resp.  and  lienee  are 
satisfied.  Doth  transitions  may  fire  concurrently,  remo  mg  the  tokens  from 
their  input  places  il,  i2  and  adding  tokens  e.  0  ?  to  their  output  places  a31, 
a41  (resp.  <  1  >  to  a32,  a42j.  Next,  transitions  3,4  arc  enabled  under  the 
substitutions  {0//U,l//12,  — i/Net3,0/vt3}  and  {0//U,  1/A2, 1/NeM,  1//14). 
After  concurrent  firing  of  these  transitions,  tokens  arc  removed  from  places 
a3i,  a41,  a32,  a42  and  tokens  c  0  y  (c  1  yj  added  to  a53  (a54j.  Last, 
transition  5  is  enabled  under  subs.itution  (G//13, 1/.14,  1/Acl5,  1//13]  and 


Figure  2'  The  PrT  net  for  the  XOR  NN. 


results  in  marking  <  1  >  on  place  o5,  which  is  the  result  expected  for  the 
given  input. 

For  NN  without  backpropagation  that  solution  is  straightforward.  The  update 
(firing)  is  maximally  concurrent,  we  dont  need  any  extension  of  classical  PrT 
systems  and  the  Prt  net  can  be  generated  automatically  from  the  NN  (and 
this  has  in  fact  been  done). 

NN  with  backpropagation 

The  translation  of  a  NN  with  backpropagation  requires  a  single  ‘global’  tran¬ 
sition  for  sotting  the  activation  values  (for  input  units),  the  target  values  (for 
output  units),  and  for  testing  whether  to  stop  updating  or  starting  the  next 
update  with  new  input/target  vector.  We  give  now  the  PrT  transition(s)  for 
each  (input,  hidden,  output)  unit  of  a  NN. 


r-l,-.Kj|*l,.,*s(r)  j.|„,*s(r) 

Figure  3:  The  global  transition  and  the  transition  for  an  input  unit 
with  Bp. 


Global  takes  input  from  three  global  places  'imt',  ‘control’  and  ‘trained  . 
mil  contains  the  vector  of  input  and  trainings  values  lor  one  computa¬ 
tion  cycle,  including  - 1  values  for  the  threshold  input  units.  Fui  exam 
pic,  in  case  of  the  XOR  example  above,  the  initial  marking  of  nut'  could 
be  1000  <  -1,0, 0,-1, -1,0  >  +1000  <  -1,0, 1,-1, -1,1  >  +1000  < 
-1, 1,0,  -  1, -1, 1  o-  +1000  c.  -1,1, 1,-1, -1,1  >,  where  the  second  and 
third  components  of  each  .uple  e.  ...  o  denote  the  input  values,  the  last 
component  the  target  value  and  the  others  the  threshold  Input  values.  The 
global  place  control'  is  initially  marked  by  K  c.o>,  where  K  is  the  number 
of  input  units  and  all  of  them  arc  consumed  when  'global*  fires.  The  global 
place  'trained?'  initially  contains  JvOy  token,  which  is  altered  to  <  1  > 
in  case  of  firing,  which  may  happen  only  if  the  equation  'Tr— O'  is  satisfied. 
I.c.  global’  fires  exactly  once  fur  each  computation  cycle.  The  transition  pro 
duces  output  tokens  fui  each  pair  of  places  c;p,  ajr  where  r  runs  over  the 
set  of  input  units  and  j  ovei  the  set  of  successors  S(r)  of  unit  r.  The  arcs 
are  labeled  with  a  control  token  e.y»,  resp.  with  <  /p  ,  where  Ir  denotes  a 
variable  symbol  (r  replaced  by  the  same  index  as  in  its  corresponding  place). 


r*  I  ,.,K 
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Figure  4:  The  PrT  transitions  for  a  hidden  unit -with  backpropagation. 

For  each  input  unit  r  in  1, I\  a  transition  ur  is  generated,  which  is  part  of 
the  backward  pass  (cf.  righthand  side  of  Fig.  3).  It  takes  its  own  activation 
value  Ar  (set  by  ‘global’  and  used  by  its  successor  units),  the  old  weights  W]r 
(connectors  to  its  successors)  and  the  error  output  D ,  backpropagatcd  from 
its  successors  (!).  It  produces  new- weights  \VW)r,  changed  by  the  transition 
equations,  and  a  token  on  the  control’  place.  The  transition  has  an  equa¬ 
tion  for  each  outgoing  connection.  All  of  them  must  be  computed  in  order 
to  produce  the  lVlVjr  varnes.  (Symbols  starting  with  capital  letters  denote 
variables),  ‘aeta’  is  a  constant  (0.5  for  our  example). 

For  each  hidden  unit  two  transitions  must  be  generated  (cf.  Fig.  4).  ulr  for  the 
forward  pass,  computing  the  new  activation  value,  and  u2r  for  the  backward 
pass,  computing  the  error  signal  Dr  to  its  predecessors  P(r)  and  then  the  new 
weights.  The  equation  in  ulr  uses  F,  which  is  a  sigmoidal  squashing  function. 
In  u2r  the  denotation  j  =  l,..,#S(r)  is  used  both  as  summation  index  m 
the  first  equation  (the  same  as  in  nip)  and  as  index  for  producing  the  rest  ot 
equations. 
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Figure  5:  The  PrT  transitions  for  an  output  unit  with  backpropagation. 


The  schema-for  generating  the  transitions  for  output  units  should  be  clear 
now  The  initial  value  of ‘trained'”  is  <  0  >  and  gets  changed  only  if  the  stop 
criterion  for  that  transition  is  satisfied  The  weight  places  W,,  arc  initially 
marked  with  the  inital  values.  The  result  of  generating  the  PrT  system  for 
the  XOR  example  is  left  as  an  exercise  to  the  interested  reader. 


PN  +  NN  =  Hybrid  systems? 

Some  differences  between  PN  and  NN  are.  (1)  Single  type  of  nodes  (NN) 
versus  bipartite  graph  (PN).  (2)  Continuous  activation  values  (NN)  versus 
discrete  (PN).  (3)  (Also  iicgnti vcj  real  values  of  wciglhs  (NN)  versus  posi¬ 
tive  integer  (PN).  (4)  Units  arc  often  updated  synchronously  (NN)  but  asyn¬ 
chronous  transition  firing  (PN)  (5)  NN  arc  deterministic,  i.e.  no  decisions 
between  alternatives  are  taken  even  in  recurrent  NN  (not  considered  here. 
Hence  the  PN  representation  opens  up  the  possibility  to  model  alternatives 
additionally.  (G)  The  embedding  of  propositional  and  first  order  predicate 
logic  in  PN  theory  has  no  equivalent  in  NN.  The  NN  form  of  the  logical 
‘or’  is  rather  complicated.  In  PN  we  know  that  a  propositional  implication 
aA6=>cVdis  represented  as  a  dead  transition  with  a,b  as  input  and  c,d 
as  output  places.  The  representation  of  (even)  propositional  logic  in  NN  is 
much  more  complicated.  (7)  PN  arc  suited  for  formal  analysis  (reachability- 
trees  and  invariant  calculus),  since  PN  are  used  to  describe  exact  solutions 
for  discrete  systems,  where  the  main  problem  is  to  guarantee  that  the  system 
is  live  and  save.  Since  NN  are  not  used  for  designing  systems  like  operat¬ 
ing  systems  or  protocols,  NN  units  keep  only  a  single  aetication  value  and 
distribute  only  that  single  value  to  all  successor  units.  A  restricted  form  of 
liveness  condition  occurs  as  inital  condition  in  recurrent  NN  only.  (8)  Modifi¬ 
cations  of  weights  and  lienee  ‘learning’  is  usually  not  at  all  considered  in  PN, 
Exceptions  arc  self-modifying  nets  [8], (2).  (9)  Usual  tools  designed  for  editing 
and  simulating  PrT  systems  could  in  principle  be  used  for  the  PrT  form  of 
NN,  but  the  mere  amount  of  connections  up  to  I01  makes  it  necessary  to 
use  dedicated  simulators  instead  of  the  general  simulators  for  PrT  systems  at 
hand,  E.g.  the  GRASPIN’  simulator  ((7j),  applied  to  the  XOR-network  with 


backpropagation,  updates  the  network  in  3  seconds,  wheras  a  dedicated  NN 
simulator  manages  at  least  5  to  20  thousand  updates  per  second. 

PrT  systems  (like  all  other  PN)  can  be  ‘folded’.  The  result  is  often  a  single 
transition  with  complex  inscriptions.  The  result  of  folding  the  PrT  system 
generated  for  the  XOR-NN  with  Bp  is  shown  in  Fig.  6.  The  simulation  of 
such  transition  is  of  course  faster  than  simulating  the  original  system,  since 
the  overhead  for  cheeking  iioiiactivalcd  transitions  is  greatly  reduced.  This 
holds  at  least  for  single  processor  machines. 
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Figure  C.  The  PrT  system  for  the  XOR-NN  (with  Bp),  completely 
folded. 

Since  the  considered  class  of  NN  can  always  be  folded  in  that  way,  the  re¬ 
sulting  transitions  can  be  used  as  building  blocks  in  hybrid  systems,  leaving 
the  task  of  representing. and  analysing  synchronization  of  complex  systems 
to  the  very  PN  methods  and  tools.  In  the  future  we  will  consider  recurrent 
NN  and  look  for  examples  within  which  an  answer  can  be  established  to  the 
question  how  hybrid  PN-NN  models  could  look-like  and  whether  they  can  be 
combined  in  a  fruitful  way. 
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ABSTRACT.  The  symmetric  logarithmoid  provides  a 
viable  alternative  to  the  sigmoid,  while  preserving  many 
characteristics  of  the  sigmoid.  The  sigmoid  is  very  flat  when 
the  absolute  value  of  its  argument,  |q,|  >  10.  In  other  words, 
its  derivative  is  extremely  small,  and  has  poor  sensitivity  to 
its  argument.  This  is  the  root  cause  of  the  very  slow  rates 
of  convergence  during  the  training  phases,  of  neural  networks, 
and  relative  insensitivity  of  the  network  to  a  fairly  wide  range 
of  weights.  The  symmetric  logarithmoid  overcomes  these 
limitations,  despite  perhaps  creating  some  others  of  its  own. 

Feed-forward  neural  networks  can  be  used  as  simulators 
trained  from  the  gross  observed  behaviour  of  a  system. 
This  paper  illustrates  the  applicability  of  the  symmetric 
logarithmoid  activation  function  in  a  feed-forward  neural 
network  for  such  training  exemplified -by  a  system  identification 
problem  of  pressure  drop  in  a  rough  pipe.  The  inputs  to  the 
network  include  viscosity,  density  of  the  liquid,  diameter  and 
roughness  of  the  pipe,  and -the  velocity.  The  outputs  are  the 
friction  factor  and  the  pressure  drop  per  unit  length.  The 
networks  were  trained  using  the  Levenberg-Marquardt  method. 

The  symmetric  logarithmoid  is  continuous,  first  order 
differentiable  and  a  simple,  monotonically  increasing  algebraic 
function.  While  minimising  the  error  square  sum  for  the 
outputs,  convergence  is  generally  fast  compared  to  the 
sigmoidal  activation  function.  Extremely  large  weights  nrr 
not  commonly  generated  by  the  training  process,  but  is  a 
usual  feature  with  the  sigmoids.  The  symmetric  logarithmoid, 
evidently,  does  not  mix  well  with  other  activation  functions, 
especially  the  sigmoids. 


The  sigmoid  and  the  symmetric  logarithmoid  can  Li 
considered  to  Le  in  a  continuum  of  activation  functions.  Om 
extreme  of  the  activation  functions  is  the  switch  (the  sign 
function),  a  network  based  on  which  cannot  be  trained  by  any 
of  the  optimisation  methods  meant  for  continuous  functions. 
The  sigmoid  alleviates  this  problem  by  smoothenirig  the 
switch  near  its  discontinuity.  The  symmetric  logarithmoid  is 
continuous  and  first  order  differentiable.  It  is  a  monotonically 
increasing  function  with  maximum  sensitivity  near  zeio  and 
monotonically  decreasing  sensitivity  away  from  zero,  as  with 
the  sigmoid.  However,  the  symmetric  logarithmoid  never 
becomes  insensitive  to  the  argument,  and  its  output  is  not 
limited-  to  between  -1  and  1.  Networks  using  this  function 
are  a  bit  easier  to  train,  and  the  convergence  is  better.  The 
other  extreme  of  activation  functions  is  the  linear  (identity) 
function,  which  finds  limited  use  in  our  work  for  statistical 
purposes.  This  function,  obviously  poses  no  problems  to  the 
usual  optimisation  methods,  and  the  Levenberg-Marquardt 
method,  which  we  use,  converges  in  a  couple  of  iterations. 

2.  The  flow  in  a  rough  pipe 

To  study  the  applicability  of  the  symmetric  logarith¬ 
moid,  we  considered  a  simple  system  of  a  flowing  liquid  in  a 
lough  pipe,  under  turbulent  flow.  The  pressure  drop  in  a  pipe 
is  of  vital  interest  while  sizing  pumps  or  compressors,  and  for 
calculating  flow  rates.  It  is  estimated  by  empirical  correlations 
such  as  the  one  shown  below  [  2  ]  . 

A p  _  (jpui1 

T  =  1T 


1.  Introduction 

A  lot  of  research  has  been  done  on  feed-forward  neural 
networks  taking  the  sigmoid  for  granted.  The  sigmoid,  however, 
has  its  limitations  and  its  applicability  is  not  universal. 
Sigmoids  arc  meant  for  outputs  contrained  between  0  and  1, 
or  -1  and  1.  A  linear  mapping  can  extend  this  range.  But 
many  variables  do  not  have  such  limits,  and  it  is  not  always 
desirable  to  map  them  to  a  range  of  0  to  1  since  sensitivity 
can  be  lost  in  the  process  of  mapping.  Feed  forward  neural 
networks  can  be  used  for  system  identification  of  processes 
[  1  ]  ,  and  one  often  comes  across  variables  like  temperature, 
pressure,  viscosity,  concentration,  etc.  which  have  no  upper 
limits,  although  for  a  system  under  consideration,  they  may 
stay  in  a  particular  range.  If  the  range  is  more  than  a  couple 
of  orders  of  magnitude,  it  is  customary  to  deal  with  their 
logarithms  in  the  mathematical  models. 

The  sigmoid  is  very  flat  when  the  absolute  value  of  its 
argument  |a<|  >  10.  In  other  words,  its  derivative  is  extremely 
small,  and  has  poor  sensitivity  to  its  argument.  This  is  the 
root  cause  of  the  very  slow  rates  of  convergence  during  the 
training  phases  of  neural  networks,  and  relative  insensitivity  of 
the  network  to  a  fairly  wide  range  of  weights. 

The  symmetric  logarithmoid,  given  by  the  following 
equation  overcomes  these  limitations,  despite  perhaps  creating 
some  others  of  its  own. 

*i  =  In  (1  +/?|oi|) 


lie  >  2300 


The  pressure  drop,  A p  per  unit  length  is  proportional 
to  the  friction  factor,  <;,  a  measure  of  retardation  of  the  flow 
by  liquid  viscosity  and  pipe  wall  roughness.  The  pressure  drop, 
obviously,  has  no  natural  limits  on  the  positive  side  and  so  does 
the  friction  factor. 


The  pressure  drop  depends  on  the  density,  p  and  the 
kinematic  viscosity,  v  of  the  liquid,  the  flow  velocity,  w,  and  the 
diameter,  d  and  roughness  factor  k  of  the  pipe. 

For  the  sake  of  training  a  feed  forward  neural  network, 
examples  were  generated  at  random  in  the  following  range  of 
inputs. 

p  0.5  -  1.5  x  103  kg/m3 

k  0.1  -  1.0  x  10-3  m 

v  0.5  -  5.0  x  10_<!  m5/sec 

w  1.0  - 10.0  m/sec 

d  0.1  -  0.5  m 


This  guarantees  that  lie  >  2300. 
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3.  The  Levenberg-Marquardt  method 

The  Levenberg-Marquardt  method  [  3-6  ]  was  used  to 
calculate  the  weights  in  the  neural  networks  which  minimised 
the  sum  of  squares  of  errors.  Most  algorithms  for  least- 
squares- optimisation  problems  use  either  steepest  descent  or 
Taylor-series  models.  The  Levenberg-Marquardt  method  is. 
a  restricted  step  method,  which  uses  an  interpolation  between 
the  approaches  based  on  the  maximum  neighbourhood  (a  “trust 
regioh”):in  which  the  truncated  Taylor  series  gives  an  adequate 
representation  of  the  non-linear  model.  The  method  has  been 
found’to  be  advantageous  compared  to  other-methods  which 
use  only  one  of  the  two  approaches. 

4.  Results 

The  results  give  a  clear  indication  of  the  applicability  of 
the  symmetric  logarithmoid  activation  function. 

4.1.  Training  the  neural  networks 

Artable  of  200  training  instances  was  created-by  random 
selection  of  inputs  in  the  ranges  stated  in  section  2.  The 
pressure-drop  per  unit  length  was  tabulated  in  units  of  103 
Pa/m.  Yet,  it  often  had  large  values  (greater  them  10)  which 
would.require  the  argument  of  the  symmetric  logarithmoid  to 
be  very  large.  Therefore,  the  logarithm  of  the  pressure  drop 
per  unit  length  (in  units  oflO3  Pa/m)  was  tabulated  instead. 
Similar  results  were  obtained  with  actual  pressure  drop  values. 

With  one  hidden  layer,  the  number  of  hidden  nodes  was 
varied  between  2  and  7.  The  configurations  with  5  or  more 
hidden  nodes  resulted  in  good  fits  of  the  training  data.  The 
error  square  sums  (SSQ)  for  (5,5,2),  (5,6,2)  and  (5,7,2)  were 
0.189,  0.132  and  0.080  respectively.  Networks  with  two  hidden 
layers  are  not  as  easy  to  train  as  the  ones  with  one  hidden  layer. 
This  has  been  observed  with  the  sigmoids,  and  was  observed 
with  this  activation  function  also.  The  configuration  (5,2,2, 1) 
had  a-SSQ.of  0.341,  but  (5, 3, 3,1)  with  34  weights  had  a  SSQ 
of  0.0583,  less  than  0.084,  the  SSQ  of  (5,5,1)  with  36  weights. 
The  SSQ  for  (5, 4, 4,1)  was  0.0316. 

4.2.  Testing  the  trained  neural  networks 

The  trained  neural  -networks  were  then  tested  with 
various  velocities,  while  keeping  other  variables  constant  (p  = 
103  kg/m3,  k  =  lCM  m,  v  =  10-6  m2/sec,  d  =  0.2  m).  A  plot  of 
the  logarithm  of  pressure  drop  per  unit  length  (103  Pa/m)  vs 
velocity  is  shown  in  Fig.  1. 

It  can  be  seen  that  for  various  configurations  shown  in 
the  legend  of  the  figure,  the  predicted  values  are  quite  close  to 
the  analytical  values.  This  accuracy  is  sufficient  for  engineering 
purposes.  Topical  error  is  about  0.05,  which  is  about  2.5%  of 
the  range  on  the  vertical  axis. 

5.  Conclusions 

The  feed-forward  networks  trained  with  the  symmetric 
logarithmoid  activation  function  performed  well  in  the  testing 
phase.  Convergence  during  training  was  faster  than  is  usually 
encountered  with  sigmoids.  The  weights  generated  after 
training  were  never  very  large,  although  that  happens  often 
with  sigmoids. 

The  symmetric  logarithmoid,  thus  provides  a  feasible 
activation  function  for  the  neurons,  instead  of  the  sigmoid, 
when  the  outputs  are  not  in  a  well-defined  limited-range. 


0.0  2.0  4.0  6.0  8.0  10.0 


Figure  1.  Logarithm  of .pressure  drop  per  unit  length 
vs  velocity. 
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Abstract 

Concepts  are  introduced  which  allow  robot  vision  systems 
to  be  designed  according  to  the  inlierent  structure  of  the  task 
of  vision.  Practical  results  obtained  with  such  systems  aic 
presented. 

Introduction 

Coarsely -grained  multiprocessor  systems  have  been 
demonstrated  in  numerous  practical  applications  to  be  partic¬ 
ularly  well  suited  for  building  powerful  robot  vision  systems 
<Dickmanns,  Graefe  88a,  b> .  The  real-time  vision  system, 
BWT,  is  an  early  example.  Conceived  in  the  late  seventies, 
it  uses  only  a  few  8-bit  microprocessors  (Intel  8085 A)  w'..  .h 
by  today’s  standards  are  rather  weak  and  slow  devices. 
Nevertheless,  the  BVV  1  as  a  system  was  demonstrated  in 
1982  to  be  sufficiently  powerful  for  solving  a  demanding  task 
in  robot  vision,  the  stabilization  of  an  inverted  pendulum 
CHaas  82,  Graefe  83  >. 

Its  successor,  the  BVV  2,  was  conceived  in  the  early 
eighties  <Graefe  84> .  Based  on  much  stronger  16-bit  pro¬ 
cessors,  Intel  8086,  it  enabled,  for  instance,  the  experimental 
vehicle  VaMoRs  in  1986  to  follow  a  road  at  a  speed  of 
96  km/h,  making  it  by  far  not  only  the  world’s  fastest  fully 
autonomous  road  vehicle,  but  also  exclusively  the  only  one 
whose  speed  was  limited  by  its  engine  and  not  by  its  vision 
system  <  Zapp  88  > .  The  BVV  2  is  an  open  system  based  on 
the  standard  Multibus  I  and  using  commercially  available 


Robot  Human  Operator 

Figure  1 

Conceptual  structure  of  object  oriented  vision  systems 


single  board  computers.  This  made  it  easy  to  replace  its 
parallel  processors  by  more  powerful  ones  later.  Such  an 
improved  version  of  the  BVV  2  has  been  used  for  detecting 
and  classifying  obstacles  on  the  road  while  approaching  them 
with  a  speed  of  about  50  km/h  on  an  unmarked  road 
<  Regensburger,  Graefe  90;  Solder,  Graefe  90  >. 

Recently,  the  BVV  3  has  become  operational  <  Graefe 
90>.  It  employs  Intel  microprocessors  80286  or  80386, 
augmented  by  a  custom  designed  coprocessor  for  feature 
extraction.  The  BVV  3  is  untended  to  be  used,  for  instance, 
in  future  experiments  with  an  autonomous  vehide  participat 
ing  in  ordinary  highway  traffic  < Graefe,  Kuhnert  88 > .  The 
BVV  3  should  generally  perforin  feature  extraction  about  5 
to  10  times  faster  than  the  BVV  2,  depending  on  the  task. 
Tests  have  indicated  that  in  some  vision  related  applications 
it  is  actually  more  than  100  times  footer  than  its  predecessor. 

It  should  be  noted  that  the  good  performance  of  the  BVV- 
systems  is  not  a  result  of  utilizing  any  particularly  fast  elec¬ 
tronic  components,  but  rather  of  a  system  architecture  that 
matches  the  inherent  structure  of  the  task  of  robot  vision. 

System  Architecture 

A  robot's  environment  contains  a  limited  number  of 
physical  objects  that  are  in  some  respect  relevant  for  the 
operation  of  the  robot.  Among  them  could  be  landmarks, 
obstacles,  the  pathway,  objects  to  be  grasped,  or  various 
other  objects.  At  any  given  moment  only  selected  ones  of 
these  objects  need  to  be  monitored  simultaneously,  provided 
the  robot  is  able  to  switch  its  attention  from  one  object  to 
another  one  within  a  fraction  of  a  second. 

A  robot  vision  system  should,  therefore,  have  the  ability 
to  observe  a  small  number  of  objects,  say  half  a  dozen, 
simultaneously.  At  the  same  time  it  should  be  able  to  main¬ 
tain  internal  models  of  a  slightly  larger  number  of  objects 
existing  in  the  robot’s  environment  but  not  demanding  imme¬ 
diate  attention  according  to  (he  perceived  situation. 

If  the  structure  of  the  task  to  be  handled  is  reflected  in  the 
structure  of  the  vision  system  a  particularly  high  degree  of 
efficiency  may  be  expected.  This  has  been  discussed  in 
greater  detail  in  <  Graefe  89  > .  In  short,  one  "object  proces¬ 
sor"  each  should  exist  within  the  vision  system  for  each 
relevant  object  in  the  robot’s  environment.  Figure  1  shows 
the  conceptual  structure.  It  comprises  a  video  section,  a 
number  of  object  processors,  and  a  situation  processor. 
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Video  Section 

The  cameras,  digitizers,  and  a  means  for  distributing  the 
video  data  to  the  object  processors  make  up  the  video  see 
tion.  In  addition,  it  ma)  contain  camera  control  devices  like 
platforms  or  lens  controllers.  Each  object  processor  has 
direct  access  to  the  digital  video  data.  Tor  the  efficiency  of 
the  vision  system  it  is  of  utmost  importance  that  all, object 
processors  have  independent  access  to  these  data.  Therefore, 
each  object  processor  should  have  its  own  image  memory.  A 
single  shared  image  memory  is,  of  course,  cheaper,  but  it 
tends  to  create  a  severe  bottleneck. 

Object  Processors 

Each  object  processor  receives  digital  image  data  from 
one  or  more  cameras  and  outputs  a  description  of  one  partic¬ 
ular  external  object.  The  description  may  relate  to  the  shape, 
location,  state  of  motion,  or  other  characteristics  of  the 
object.  An  object  processor  is  a  conceptual  entity,  not  a 
physical  one.  In  principle,  it  does  not  matteraf  such  an  object 
processor  is  implemented  on  exactly  one  piece  of  hardware, 
or  if  it  contains  several  computing  elements,  or  if  several 
object  processors  share  one  computing  element.  Given  the 
present  state  of  microprocessor  technology ,  an  object  proces¬ 
sor  for  a  typical  robot  vision  application  may  be  implemented 
on  one  to  three  microprocessors. 

Situation  Processor 

The  object  descriptions  are  fed  into  a  situation  processor. 
This  is,  again,  a  conceptual  entity.  It  will  typically  be  imple¬ 
mented  on  a  number  of  microprocessors.  The  mam  task  of 
the  situation  processor  is  to  deal  with  the  interactions  of  the 
external  objects  with  the  robot  and  among  each  other. 
Besides,  it  assigns  objects  to  the  object  processors.  The  situa¬ 
tion  processor  also  interfaces  with  the  human  operator, 
exchanges  sensor  and  control  data  with  the  robot,  and  con¬ 
trols  the  video  section,  if  necessary.  The  complexity  of  the 
situation  processor's  task  depends  highly  on  the  complexity 
of  the  robot's  task  and  on  the  environment  the  robot  is  sup¬ 
posed  to  operate  in.  Following  an  empty  road,  for  example, 
involves  hardly  a  situation  to  speak  of,  because  the  road  is 
the  only  external  object.  On  the  other  hand,  driving  autono 
mously  in  ordinary  road  traffic  will  certainly  require  a  very 
powerful  situation  processor. 

Implementation 

The  vision  system  BVV  2  has  been  designed  to  support 
structures  as  shown  in  Figure  I.  Its  video  sectiun  contains 
four  independent  video  channels  allowing  the  signals  from  up 
to  four  cameras  to  be  processed  simultaneously.  Each  object 
processor  typically  comprises  two  parallel  processors,  one 
for  a  2-D  object  model  and  the  associated  feature  extraction, 
and  one  for  a  spatio  temporal  object  model.  The  situation 
processor  may  be  implemented  partly  on  a  PC  AT  and  partly 
on  a  parallel  processor  within  the  BVV  2. 

An  implementation  on  the  BVV  3  could  be  quite  similar. 
But  the  full  potential  of  the  BVV  3  may  be  realized  if  all  its 
parallel  processors  are  used  for  feature  extraction  and  2  D 
object  models.  The  spatio  temporal  models  and  the  situation 


processor  may  then  be  implemented  on  separate  hardware, 
possibly  a  transputer  network. 

Two  new  implementations  of  the  object  oriented  architec 
ture  are  currently  being  developed.  Both  of  them  will  be 
based  on  a  standard  PC  equipped  with  a  commercially  avail 
able  v  ideo  digitizer  and  a  few  custom  built  microcomputers 
to  be  utilized  for  feature  extraction  and  2-D  object  models. 
In  one  implementation  the  Intel  376  microprocessor  will  be 
used  with  an  expected  performance  similar  to  the  BVV  2 
level  and  its  software  largely  compatible  with  the  BVV  2. 
The  other  new  implementation  will  be  based  on  the  Intel  960. 
Its  performance  is  hard  to  predict,  hopefully  it  will  approach 
the  level  of  the  BVV  3  at  a  lower  cost  and  smaller  size. 
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Abstract 

The  use  of  Markov  Random  Field  (MRF)  statistical  models  has 
recently  brought  new  powerful  solutions  to  classical  imago  analysis 
problems.  In  recent  papers,  we  have  presented  a  new  class  of  spatio- 
teinporalMRF  models  which  have  been  applied  with  surress  to .differ¬ 
ent  basic  tasks  in  visual  motion  analysis.  In  this  paper  parallelization 
methods  for  those  relaxation  algorithms  are  investigated  and  a  new 
hierarchical  approach,  based  on  the  interactions  between  dilfcrcnt  re¬ 
laxation-processes  running  in  parallel  at  different  scales  is  presented. 
The  hierarchical  method  has  been  simulated  in  the  case  of  optical  flow 
estimation.  It-shows  good  performances  (quality.of  the  estimates,  gain 
in  number  of  iterations)  when  compared  to  sequential  algorithms. 

1  Introduction 

Markov  Random  Fields  (MRF)  models  have  been  successfully  intro¬ 
duced  in  several  important  issues  of  still  image-analysis,  such  as  im¬ 
age  restoration,  segmentation  or  edge  detection,  [G]  Our  group  lias 
recently  extended  the  MRF  models  to  the  analysis  of  image  sequences 
for  motion  detection,  [3],  optical  flow  estimation,  (8]  and  motion-based 
segmentation,  (5).  In  visual -motion  analysis,  MRF  appear  as  an  effi¬ 
cient  and  powerful  tool  for  combining  spatial  and  temporal  informa¬ 
tion.  For  details  concerning  the  models  dcsignod  in  each  case,  we  refer 
to  [3,  8,  5]. 

The  subject  of  the  paper  is  the  study  of  parallel  approaches  for 
the  relaxation  algorithms,  [G]  associated  to  MRF  in  image  analysis 
Indeed,  one  very  attractive  property  of  MRF  is  that,  though  the  mod¬ 
els  are  global  and  non  linear,  the  involved  computations  remain  local 
and  arc  intrinsically  parallel.  We  present  here  an  approach  based  on 
relaxation  algorithms  running  in  parallel  at  different  scales  and  inter¬ 
acting  periodically.  This  parallel  algorithm  is  compared  to  sequential 
stochastic  or  deterministic  algorithms  in  the  case  of  optical  flow  com¬ 
putation.  It  exhibits  fast  convergence  properties  and  only  requires  a 
small  number  of  processors. 

2  Markov  Random  Fields  for  motion  analysis 

The  modeling  and  analysis  of  images  by  MRF  's  has  been  discussed 
extensively  in  the  litlcralure,  [b].  Fo  extract  labels  describing  mo¬ 
tion  from  image  sequences,  observations  rclatcd.to  the  spatio-temporal 
variations  in  the  image  sequence  arc  combined  with  a  priori  generic 
knowledge  on  the  expected  solution,  in  order  to  derive  estimates  of  the 
unknown-labels.  The  labels  are  binary  features  in  motion  detection, 
vectors  in  optical  flow  estimation  and  region  numbers  in  motion-based 
segmentation,  [3,  8,  5).  MRF  models  describe  tbe  local  statistical  in- 
tcractions  between  these  different- variables.  When  a  maximum  a  pus 
teriori  (MAP)  estimate  of  the*  unknown  label  variables  is  looked  for, 
MRF-based  image  analysis  reduces  to  the  minimization  of  a  global 
energy  function  V  which  depends  on  the  whole  observation  and  la¬ 
bel  field,  [G).  Minimizing  the  global  energy  function  (  is  an  intricate 
problem  :  the  number  of  possible  label  configurations  is  generally 
very  large  and  the  global  energy  function  l  may  exhibit  numerous 
local  minima.  Computationally  demanding  stochastic  relaxation  al¬ 
gorithms  are  therefore  generally  necessary  to  compute  exact  MAP 
solutions.  Deterministic  descent  algorithms  such  as  ICM,  [2]  can  of¬ 
ten  be  used  instead,  when  a  good  initial  guess  is  available. 

A  simple  model  for  optical  flow  measurement 

We  consider  here  a  very  simple  model  for  optical  flow  computa¬ 
tion,  which  will  he  used  for  comparison  purpose  between  the  parallel 
and  sequential  versions  of  stochastic  relaxation  (for  more  sophisticated 
models  including  discontinuities  and  occlusion  processing  see  (sj). 

I.Ct  f(s.l)  denote  the  observed  intensity  function,  where  *  =  (j-. ;/). 
$  g  S  designate  the*  2D  spatial  image  coordinates  and  l  the  time 
axis.  The  velocity  vector  at  point  a  is  denoted  u5,( «,,»,),  u,  = 


=  ^(s)  and  u  =  {wj,  s  6  5}  .  In  the  model  con¬ 
sidered  hero  velocities  arc  defined  on  the  same  grid  S  as  the  pixels 
and  the  velocities  arc  discretized  according  to  a  discrete  state  space 
W  =  (-a max  ■  «max, -a max  •  vmar)  with  a  step  size  of  6.  The  MRF 
model  is  associated  to  a  S-iicighbourhood  and  specified  by  following 
energy  function  : 

V(f,G)  =  Yi  (/(*.<)  -  fts  +  +  (It)  }2 

5  €  S 

+  a 2  Y1  ll^-^tll2  (1) 

(3.0  ntighbouTa 

The  first  term  in  the  energy  (known  as  the  ’’displaced  frame  differ¬ 
ence”)  expresses  the  constant  brightness  assumption  for  a  physical 
point  over  time.  The  second  term  balances  the  first  one  through 
weighting  parameter  a,  it  can  be  interpreted  as  a  regularization  term 
which  favours  smooth  solutions.  Tins  discrete  state  space  in  the  op¬ 
tical  flow  estimation  problem  leads  to  a  complex  energy  landscape 
showing  numerous  local  minima.  Hence  this  model  is  as  a  good  bench¬ 
mark  for  parallel  stochastic  relaxation  algorithms. 

The  stochastic  relaxation  algorithms  arc  based  on  the  generation 
of  realizations  of  Markov  Chains  whose  limit  distribution  correspond 
to  the  Gibbs  distribution  p(f  u3)  =  \  exp  -f/(/,i3),  (6].  Two-basic 
relaxation  algoritms  are  generally  used  :  the  Metropolis  algorithm, 
(1)  or  the  Gibbs  sampler,  (o).  In  the  case  of  optical  (low  computation, 
the  Gibbs  Sampler  can  be  described  as  follows,  [6) : 

Icl(ni,ii2,...n1),  n,  g  S  be  asequence  in  vvhiclr the  sites  of  the  vector 
field  J  are  visited  for  updating  iraster  scan  will  he  considered  here). 
The  corresponding  label  configurations  arc  denoted 
J0)  is  an  initial  configuration  chosen  at  randuin.  Let  7’( / )  be  a  de¬ 
creasing  sequence  of  teiiiperaliiies.  At  time  I  site  n,  of  is 

updated  by  drawing  a  sample  from  the  local  characteristics  of  the 
Gibbs  distribution  :  prlf,  J)  =  °M>  -'’y-^-  It  is  slraigiitfor- 

vvaul  to  -how  that  tins  cumputaliun  is-local,  thanks  to  the  muikoviau 
property  of  the  model  and  only  involves  site  ji(  and  its  neighbours. 
{  uj(0),aj(l),...v3( /),...  }  defines  a  Markov  Chain  whose  convergence 
properties  have  been  studied  extensively,  [1,  Gj.  A  logarithmic  de 
creasing  tcinpc-ratuie  schedule  is  requited  to  ensure  convergence  to  a 
global  minimum  of  the  energy  function.  To  save  computation  time,  we 
have  considered  less  conservative  exponential  schedules  of  the  form 
7'(()  =  f0.A'.  .1  <  1  (which  arc  often  used  in  practice). 

3  Parallel  algorithms  for  stochastic  relaxation 

Parallel  implementations  of  stochastic  relaxation  have  been  consul 
cred  for  global  optimization  m  applications  such  as  compulor-aidod 
circuit  design,  [i]  or  image  processing,  [G,  9,  4]  Until  now.  three  main 
approaches  have  been  investigated  .  parallelized  Markov  chains,  [1 ,  7 /. 
simultaneous  updating  of  tin  image  sites,  [G,  Oj ,  and  parallelization  of 
the  local  label  updating,  [fj 

Parallelized  Markov  chains  have  been  proposed  by  Aarts  ct  al  for 
global  optimization  problems  based  on  simulated  annealing  and  the 
Metropolis  algorithm,  [1].  The  basic  principle  of  the  approach  is  to 
run  in  parallel  several  relaxation  algorithms,  each  of  them  exploring 
differently  the  space  of  all  possible  label  configurations  ami  interact¬ 
ing  from  lime  to  time.  Tfiis  class  of  algorithm  may  he  run  on  a-MIMD 
or  SIMD  machine  by  assigning  each  available  processor  to  a  different 
relaxation  algoritni.  The  interaction  are  based  on  periodic  transfer  of 
global  label  configurations  between  tin*  different  processors  A  similar 
method  lias  recently  been  studied  by  Gralfigne,  [7] 

Our  own  approach  of  the  problem  is  also  based  on  parallelized 
Markov  Chains  but  derives  profit  from  a  hierarchical  representation 
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of  data  and  labels,  winch  leads  to  an  effluent  parallel  annealing  al¬ 
gorithm  with  a  speed-up  larger  than  the  nurubei  of  piucessuis.  Tin- 
method  can  be  outlined  as  follows, .  a  data  pyramid  is  fust  cuiistiucled 
by  low-pass  filtering  and  subsainphng  the  images  uf  the  sequence.  Ac¬ 
cordingly,  a  hierarchical  lepieseulatiun  is  also  considered  for  the  label 
fields  which  are  estimated  in  parallel  at  different  resolution  levels  oil 
reduced  grids  (Fig.  1).  Relaxations  are  peifoimed  in  parallel  by  as 
signing  one  processor  at  each  level  of  the  py  ramid. 

Following  (7],  the  different  relaxations  arc  performed  at  fixed  tern 
perature.  To  the  low  resolutions  levels  of  the  hiciaicby  arc  associated 
high  temperatures.  At  Tow  resolutions,  coaise  estimates  of  the  label 
field  are  visited.  Since  the  total  number  of  possible  label  configura¬ 
tion  is  reduced  at  those  scales,  the  coarse  configuration  space  can  be 
visited  very  efficiently.  A  high  temperatuie  enables  to  escape  fiom 
local  minima  of  the  energy  function.  To  the  Intel  mediate  resolution 
levels  are  associated  luwer-teinpeiatuies.  At  these  levels,  the  lelax- 
ation  process  becomes  mole  sensitive  to  local  minima  and  visits  the 
large  or  medium  scale  valleys  of  the  energy  landscape,  [7],  At  the 
finest  resolution  level  a  temperature  close  to  0  is  adopted.  Very  low 
temperature  in  the  stochastic  relaxation  conesponds  to  nearly  deter¬ 
ministic  descent  of  the  energy  function  :  the  estimation  is  ultimately 
refined  at  that  level. 

The  explorations  at  the  different  levels  are  cooperative  .  every  p 
iterations  -  one  iteration  corresponding  to  a  full  sweep  on  the  image  - 
a  processor  attempts  to  transfer  a  small  label  block  to  the  next  finer 
level  (Fig.  1).  The  interaction  process  is  controlled  as  follows  .  a  block 
Brk  at  resolution  level  r  is  interpolated  at  level  r  -  1  using  simple  rep¬ 
etition  of  the  label  estimates  at  the  missing  positions  of  level  r  -  1 
(Fig.  1).  The  energy  of  the  resulting  local  configuration  is  computed 
and  compared  to  the  energy  of  tiie  corresponding  block  J?^_I  at  the 
finer  resolution  r-  1.  The  local  label  configuration  on  the  block  B[~' 
is  replaced  by  the  interpolated  configuration  of  block  B[.  if  the  latter 
is  better  than  the  former,  that  is,  if  its  energy  is  lower.  Local  energy 
on  blocks  arc  obtained  at  reduced  additional  cost  from  the  local  clir.r- 
acteristics  of  the  Gibbs  distribution. 

Experimental  results 

Experiments  have  been  carried  out,  in  the  case  of  the  discrete  op¬ 
tical  flow  measurement  model,  on  several  synthetic  and  real  world  se¬ 
quences.  Three  algorithms  have  been  simulated  :  a  sequential  stochas¬ 
tic  relaxation  (SSR)  based  on  the  Gibbs  sampler  with  an  exponential 
schedule  (/I  =  0.97,  To  =  -TOO),  a  sequential  deterministic  relaxation 
(SDR)  algorithm  known  as  ICM,  [2],  and  the  proposed  parallel  hierar¬ 
chical  relaxation  ( P1IR ).  In  onr  experiments  the  same  parameter  value 


Q  (equ.  1)  was  used  for  the  potential  functions  at  each  level  uf  the 
label  pyramid  (a7  -  20).  In  evei.v  ease  the  conveigence  eiiterion  was 
the  same  .  the  relaxation  was  stopped  ax  soon  as  the  maximum  nuill- 
bei  uf  modified  labels  between  two  successive  image  sweeps  fat  the 
finest  lexululiuli  level)  went  below  some  specified  tluesliuhl  ^ typically 
10). 

Figure  2  shows  the  ciieigy  plots  obtained  ful  a  divulgent  motion 
on  C-lxO-1  images  by  the  different  algorithms.  Four  resolution  levels 
are  used  in  the  pyramid  and  umax  —  umar  —  fS  in  tins  case.  P11R 
produces  estimates  close  in  quality  to  the  one  obtained  by  SSR  (the 
energies  of  the  final  euiifigiiiatiun  are  respectively  9b700  and  S7300). 
The  slight  degradation  of  BUR  with  iespeet  to  bbli  originates  from 
the  block  efTeet  due  vo  the  mtc-rscale  interaction  mode.  BUR  exhibits 
fast  convergence  properties  (siniilai  to  SDR,  but  with  estimates  of 
significantly  bettei  quality).  On  an  average,  the  computational  gain 
(in  number  of  iterations)  uf  FIIR  over  SSR,  over  several  sequences, 
was  about  10.  An  implementation  of  the  proposed  algorithm  on  an 
iPSC/2  supercomputer  is  currently  investigated. 


REFERENCES 

[1]  E.ll.L.  AARTS  and  P.J.M.  van  LAARHOVEN,  Simulated  an- 
heatiiaj.  theory  and  applications,  D-  Rcidel  Publishing  Company, 19tt7. 

[2]  J.  BESAC,  On  the  statistical  analysis  of  dirty  pictures,  J. 
Royal  Statist.  Soc.,  Vul.  IS,  Sene  B,  No  3,  1980,  pp.  259-302. 

[3]  P.  BOl'THEMY  and  P.  LALANDB,  Detection  and  tracking  of 
moving  objects  baxed  on  a  statistical  icgulariialiun  method  in  space 
and  time,  in  PrvL.  Fust  European  Conjuenee  on  Computer  1  istort, 
Antibes,  France,  April  1990,  pp.  307-311. 

[4]  II.  DERIN  and  C.S.  WON',  A  parallel  image  segmentation 
algorithm  using  relaxation  with  varying  neighbourhoods  and  its  map¬ 
ping  to  array  processor,  Comput.  Vision,  Graphics,  Image  Processing , 
Vol.  TO,  19S7,  pp.  5T-78. 

[5]  E.  FRANCOIS  and  P.  BOUT1IEMY,  Multiframe-bascd  iden¬ 
tification  of  mobile  components  of  a  scene  with  a  moving  camera, 
in  Proc.  IEEE  Int.  Con}.  Computer  Vision  Pattern  Recognition, 
Hawaii,  June  3-6,  1991. 

[6]  S.  GEMAN  and  D  GEMAN,  Stochastic  relaxation,  Gibbs 
distributions  and  the  Bayesian  restoration  of  images,  IEEE  Trans,  on 
Pattern  Analysis  and  Machine  Intelligence .  Vol.G,  No.G,  Nov.  198T, 
pp.  721-741. 

[7]  C  GRAFFIGNE,  A  Parallel  Simulated  Annealing  Algorithm, 
Technical  Report,  CNRS,  Univcrsite  Paris-Sud,  1990. 

(81  F  IIEITZ  and  P.  BOUTHEMY,  Multimodal  Motion  estima¬ 
tion  and  Segmentation  using  Markov  Random  Fields,  10th  Int.  Conf. 
Pattern  Recognition,  Atlantic  City,  Vol.  1,  June  1990,  pp.  37S-383. 

[9]  DAV.  MURRAY,  A.  KASHKO  and  II.  BUXTON,  A  parallel 
approach  to  the  picture  restoration  algorithm  of  Genian  and  Goman 
on  an  S1MD  machine,  Image  and  Vision  Computing,  Vol.  T,  No.  3. 
1986,  pp.  133-M2. 


U(d>) 


Figure  1  ;  Parallel  Hierarchical  Relaxation  .  the  label  pyramid 


Figure  2  .  Energy  I'(iT)  versus  iteration  number 
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Abstract. 

In  this  paper,  we  present  concepts  related  to  the  design  of  parallel 
computer  architectures  for  use  in  real  time  vision  applications  and 
based  on  combinations  of  heterogeneous  processing  structures.  The 
corresponding  realizations  will  be.  described  and  the  use  of  such 
systems  illustrated  by  a  representative  application,  e.g  the  on-line 
inspection  of  manufactured  parts. 

1  Introduction 

Most  of  the  current  industrial  applications  of-machine  vision, 
relying  on  image  processing  systems  with  high  computation  power, 
are  concerned  with  inspection,  quality.control,  assembly,  control  of 
manufacturing  processes,  autonomous  vehicle  guidance  and  robotics. 
Optical  sensing  of  the  application  environment,  evaluation  of  the 
images  of  the  scene  and  physical  reaction  after  interpretation  of  the 
image  contents  are  among  the  most  effective  and  efficient  means  for 
the  analysts  of  the  environment  and  for  acting  in  an  appropriate  way. 
Machine  vision  is  thus  a  way  to  automate  the  applications  previously 
described  in  a  flexible  and  intelligent  manner.  The  goal  of  computer 
or  machine  vision  is  to  extract  high-level  information  about  the 
environment  from  the  low-level  information  contained  in  one  or  a 
sequence  of  images  of  that  environment.  This  should  contribute  to  the 
desigrv'development  of  so-called  intelligent  machines.  Because  of  the 
amount  of  information  contained  in  an  image,  machine  v  ision  calls  for 
high  computing  power.  Provided  the  required  hardware  is  available, 
this  leads  to  the  development  of  vision  systems  with  the  aim  to  solve 
these  problems  automatically,  with  a  computation  speed  compatible 
with  the  application  to  be  solved  [  1  ],  [2]. 

This  naturally  leads  to  the  use  of  parallel  computer  architectures, 
and  more  precisely  to  heterogeneous  pipelin.d  structures.  However 
the  different  systems,  proposed  for  the  industrial  applications  quoted 
above,  are  often  not  able  to  provide  the  performance  and  processing 
speed  needed  at  reasonable  costs.  This  is  also  the  case  for  more 
sophisticated  applications  such  as,  for  example,  the  automated  vision 
based  on-line  inspection  of  manufactured  parts  in  order  to  detect  and 
locate  different  defects  on  the  part  under  control  for  the  optimization 
of  production  rate.  Specific  requirements  for  the  vision  systems 
running  such  vision  tasks  have  thus  firstly  to  be  defined  and  secondly 
to  be  satisfied. 

With  the  technology  available  today,  in  order  to  run  the  application 
in  "real  time”,  it  is  necessary  to  use  heavily  parallelism  for  the  image 
processing  and  some  higher  level  treatments  required  by  the 
application.  More  specifically,  one  has  also  to  match  hardware  to  the 
envisioned  processing.  This  leads  to  the  design  and  implementation 
of  heterogeneous  pipelined  structures,  in  which  each  component  is 
optimized  with  respect  to  the  type  of  processing  it  has  to  perform. 
Furthermore,  the  elements  of  the  pipeline  often  imply  an  internal 
parallelism  (for  example,  systolic  processors,  arrays  of  processors 
such  as  Transputer  networks).  Last  but  not  least,  the  synchronized 
use  of  such  systems  calls  for  a  carefully  designed  programming 
environment,  relieving  partly  the  user  of  the  burden  of  programming 
such  systems. 

The  following  section  introduces  the  definitions  and  concepts 
involved  by  the  design  and  implementation  of  such  machine  vision 

*  Part  of  the  work  described  in  this  paper  has  been  earned  out  under  fcsPRI  I 
PCA  Application  A41JI  and  LSPRII  Project  2091  ViMP  t  Vision  Based  On¬ 
line  Inspection  of  Manufactured  Parts.  Comparison  of  CCD  and  CAD  Images 


systems.  Section  3  describes  the  image  processing  systems  already 
realized,  using  two  different  approaches.  The  first  system,  designed 
and  built  at  the  Fhg-IITB  Institute,  FRG,  uses  a  modular  functional 
approach,  whereas  the  second  one  aims  to  implement  a 
recorifigurable,  flexible  and  fully  programmable  structure.  Both 
systems  are  able  to  carry  out  most  of  the  low  level  image  processings 
in  video  real  time. 

Development  of  methods  and  design  of  new  architectures  call  thus 
for  careful!  studies  and  possibly  experimentation.  This  should  be 
facilitated  bv  the  set-UD  of  development  centers  Krouping  hardware 
and  software  resources.  A  possible  configuration  of  such  an 
integrated  development  system  for  computer  vision  applications  will 
be  indicated. 

The  paper  is  concluded  by  an  illustration  of  the  use  of  such 
systems,  an.automated  system  as  a  solution  to  the  100  %  control  of 
manufactured  parts  in  a  FMS  environment.  The  technique  used  is 
based  on  comparison  between  images  acquired  through  a  vision 
system  and  the  corresponding  data  gained  from  a  CAD  system. 
Comparison  takes  places  as  well  at  feature  level  than  at  image  level. 
All  kind  of  inspections,  ranging  from  conformity  checking  up  to 
metrology,  can  be  achiev  ed  through  use  of  an  user  friendly  planning 
system. 

2  Machine  Vision-Systems 

In  vision  applications,  two  diffcrcni  processing  steps  can  usually 
be  dcfincd.Thc  first  step  deals  with  the  so-called  low-level  image 
processing,  which  transforms  an  input  image  into  a  modified  output 
image  in  order  to  enhance  the  quality  of  the  input  image  (e.g.  noise 
reduction  and  distortion  correction)  and  prepares  a  subsequent  feature 
extraction.  Then  some  segmentation  of  the  enhanced  image  is  done  in 
order  to  delimit  different  regions  in  ihe  image.  The  extracted  features 
represent  (or  model)  some  characteristic  properties  of  the  information 
content  of  the  scene  (pcnmctci,  conncxity,  moments.. .).  Thus,  after 
having  computed  a  description  of  the  image  content,  the  second  step 
exploits  this  description  in  order  to  compute  statements  about  the 
meaning  of  the  image  content.  These  siatcmcnts  arc  then  further  used 
for  firstly  defining  and  secondly  carrying  oui  the  actions  to  be 
performed  on  the  environment  implied  by  the  application.  Thus,  this 
interpretation  of  the  image  is  used  to  achieve  a  well  defined  goal  ce.g. 
recognizing  objects,  taking  decisions,  vehicle  guidance,  inspection, 
acting  on  the  real-world,...). 

Imaging  dev  ices  (generally  a  CCD  camera)  produce  as  input  fui  the 
machine  vision  system  a  pixel  image.  The  purpose  of  the  vision 
system  is  to  transform  the  low  level  information  content  of  the  input 
image  into  a  number  (as  small  as  convenient)  of  high-level 
information  pieces,  in  ordci  lo  dclivci  a  description  of  the  real-world 
scene.  This  description  can  be  furthu  used  lo  lake  a  decision,  which, 
in  turn,  leads  to  one  or  more  actions  to  be  earned  out  on  the  real- 
world  through  a  feedback  loop.  Instead  of  a  feedback  free  processing 
model,  a  more  complex  processing  scheme,  including  a  feedback 
loop  called  interpretation  loop,  can  be  imagined. 

Figure  1  above  shows  the  model  first  proposed  by  Kanadc  [3],  [4] 
and  modified  by  Nagel  [5],  [6],  [7).It  is  important  to  sec  that  the 
model  of  figure  2  allows  iterative  image  interpretation  and  eventual 
control  of  the  data  acquisition  parameters.  Furthermore,  the  model 
implies  different  types  of  knowledge  for  the  interpretation  process  in 
both  the  image  (low  level)  and  scene  (high  level)  domains.  More  and 
more  industrial  v  ision  applications  rely  un  such  a  processing  scheme, 
as  the  examples  in  section  4  will  illustrate. 
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Figure  1  :  Computer  vision  as  an  iterative  interpretation  process  (after  (6),(7J). 


Each  processing  level  has  lo  be  implemented  on  hardware 
specifically  tailored  for  it,  in  order  to  perform  efficiently  its 
tasks.Taking  this  matching  into  account  leads  then  directly  to  the 
design  of  heterogeneous  pipelined  image  processing  structures  for 
complex  vision  applications.  The  amount  of  data  to  be  computed  is 
decreasing  from  the  low-level  to  the  high-level  stage,  and  less  and 
less  computing  power  is  needed,  but  more  ana  more  flexibility  is 
required. 

According  to  figure  2,  the  basic  structure  of  an  image  processing 
system  can  also  be  defined  around  three  parts,  having  each  different 
requirements  to  the  processing  architecture : 

-  The  acquisition,  pre-processing  and  restitution  of  images. 

-  The  processing  in  the  image  domain  or  the  so-called  iconic 
processing  step.  In  this  case,  the  needed  algorithms  and  data 
structures  are  nearly  directly  related  to  the  pixel  organisation  in  the 
image. 

-  The  model  based  exploitation  of  image  primitives  and  content  or 
the  so-called  symbolic  processing  step.  In  this  case,  the  data 
structures  implied  are  almost  exclusively  a  function  of  the  type  of 
computation  to  be  carried  out. 


Image  processing  thus  implies  very  different  processing  tasks  with 
respect  to  applications.  These  image  processing  tasks  arc  very 
different  in  nature  and  imply  very  different  data  structures  for  the 
computations.  From  the  system  designer  point  of  view,  these  levels 
arc  usually  refered  as  low,  medium  and  high-level  image  processing 
(see  fig.  2).  This  sub-dividing  of  a  complete  vision  task  into  three 
processing  levels,  reflects  the  nature  of  the  operations  to  be  earned 
out  and  the  nature  of  the  data  structures  used.  Figure  2  defines  the 
three  processing  levels  and  indicates  how  the  different  stages  are 
combined  in  a  sequential  processing  scheme,  implementing  the  direct 
processing  path  of  the  model  of  figure  1 : 

Low  level  image  processing  transforms  images  into  images. 
They  are  essentially  pixel  oriented  operations  .  threshold,  lowpass 
filtering,  mathematical  morphology. 

Medium  level  image  processing  needs  images  as  input  and  gives 
features  as  output.  Extraction  of  lists  of  contours  is  a  widely  known 
example. 

High  level  operations  transform  features  into  features.  Other 
sources  of  information  than  the  initial  images  can  be  used  (a  priori 
knowledge,  databases,  artificial  intelligence).  High-level  processing 
also  has  in  charge  the  control  of  the  interfaces  betw  een  the  machine 
vision  system  and  its  environment  (c  g  man  machine  interfaces, 
communication  network  interfaces,  actuator  interfaces). 
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Figure  2 :  Processing  levels  in  machine  vision. 


Three  basic  structures  (for  a  disv-ussion,  see  for  example,  [2],  [9]), 
for  so  vailed  general  purpose  sytems,  are  today  clearly  emerging . 

Ariays  of  mesh-connected  processors  with  more  or  less 
computation  power, 

pipe  lines  and  cascaded  structures,  chaining  different  hardware 
modules  with  more  or  less  flexibility, 

bus  oriented  processing  structures  with  powerfull,  more  or  less 
specialized  micro-  processors. 

For  special  purpose  processing,  systolic  arrays  or  dedicated  LSI  or 
VLSI  integrated  circuits  can  also  be  very  efficiently  used  [10]. 
However,  bottlenecks  are  usually  encountered  when  the  low-level 
pixel  data  has  to  be  matched  with  the  high-level  data  structures  [11], 
[12].  It  seems  therefore  not  possible  to  design  a  system  able  to 
perform  well  for  all  the  algorithms  needed  in  computer  vision. 
However,  heterogeneous  structures  for  the  three  levels  of  processing, 
with  an  integrated  control  strategy  and  incorporating  different  modes 
of  parallelism,  appear  to  be  today  the  best  compromise.  With  respect 
to  the  use  of  such  systems,  two  approaches,  exemplified  in  the  next 
sections,  are  possible: 

-  The  first  is  based  on  a  modular  functional  approach,  where  the 
user  has  just  to  choose  the  appropnatc  chaining  and  parameters  for 
image  processing  operations, 

-  The  second  is  based  on  a  fully  programmable  approach,  where 
the  user  can  develop  his  own  software  for  all  the  system  components 
and  organize  his  own  data  flows  and  image  processing  sequences. 

3  Parallel  Architectures  for  Computer  Vision 

Sophisticated  vision  tasks  like  those  mentioned  in  the  introduction 
imply  numerous  requirements  for  a  vision  system,  which  have  been 
implemented  into  the  systems  to  be  described  : 

-  Bottlenecks  should  be  avoided  cither  by  extending  or  by  specially 
organizing  the  system.  Addition  of  supplementary  modules  for 
parallelization  and  the  support  of  general  purpose  processors  with 
special  hardware  processors  help  to  remove  these  bottlenecks 

Image  acquisition  should  be  separated  from  the  image  processing 
and  interpretation  steps  (see  figures  1  and  2)  in  order  to  process  data 
at  maximum  speed. 

-  Organization  of  data  should  not  be  fixed  in  order  to  give  the 
system  the  greatest  flexibility. 

-  With  respect  to  signal  acquisition,  storage  and  display,  different 
sensors  must  be  available,  differing  in  format  but  also  in  physical 
nature,  in  order  to  be  able  to  process  multidimensional  images  and 
multiscnsorial  signals. 

-  Processing  of  images,  isolated,  endless  or  in  sequence,  should 
be  possible.  Furthermore,  the  system  hardware  must  be  able  to  adapt 
to  particular  classes  of  tasks,  varying  in  complexity,  in  order  to  allow 
a  cost  effective  match  of  the  system  to  the  application  to  be  solved. 
Bus-oncntcd  multiprocessor  architectures  whose  modules  arc  the 
processing  elements  can  efficiently  be  used.  The  modules  can  be 
classified  into  three  categories : 

.  Video  I/O  modules  for  acquisition,  storage  and  display, 

.  pixel  oriented  image  processing  modules  working 
synchronously  with  the  image  acquisition  rate  and  offering  the 
possibility  of  parallel  and  pipelined  processing,  for  data  compression 
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in  the  iconic  stage  (image  processing  and  feature  extraction), 

.  not  pixel  oriented  data  processing  modules  working 
asynchronously  with  the  image  acquisition  rate,  fut  statement 
generation  in  the  symbolic  stage. 

-  The  system  should  offer  the  possibility  of  being  used  as  a 
development  system  (e.g.  for  testing  the  image  processing  or 
evaluating  the  processing  steps  needed  for  solving  a  specific  vision 
task),  or  as  part  of  a  workstation  (e.g.  for  the  solution  of  real 
problems  in  industrial  environment,).  A  hierarchical  layered  approach 
can  be  retained  for  the  software  organization,  which  does  not  require 
the  user  to  be  a  low-level  programming. expert.  Furthermore,  an 
exhaustive  package  of  image  processing  and  evaluation  programs 
should  be  provided.  The  development  of  problem  oriented  software 
should  be  possible  using  high  level  languages  and  ergonomic  man- 
machine  interfaces  helping  the  user  in  his  application  software 
developments. 

The  architecture  of  the  parallel  vision  machines  developpcd  (see 
fig.  3  for  an  example)  implements  the  requirements  stated  in  the 
preceding  section  and  is  matched  with  the  three  processing  levels 
described  in  fig.2.  The  image  to  be  interpreted  is  sent  to  ihe  low-level 
processing  unit.  The  result  is  then  fed  to  the  medium-level  processing 
unit  which  produces  features  for  the  high-level  processing  unit. 

A  feedback-loop  has  to  be  foreseen  from  the  high-level  stage  to  ihe 
medium  and  low-level  stages  (use  of  high-level  knowledge  to  guide 
the  processing  of  the  lower  stages).  The  general  architecture  looks 
like  a  system  of  pipelined  processing  elements,  each  of  the  processing 
units  being  able  to  make  use  of  its  own  internal  parallelism,  adapted 
to  the  type  of  computation  to  be  performed  (leading  to  the  concept  of 
multi-parallelism). 

The  Low-Level  Processing  Units.  The  low-level  processing  is 
performed  cither  with  a  VISTA  system  (Visual  Interpretation  System 
for  Technical  Applications)  devclopped  at  the  Fraunhofer  Institut 
IITB  in  Karlsruhe,  FRG  [13],  [16]  illustrating  the  modular 
functional  design  approach  or  with  dedicated  hardware  build  around 
a  mesh  of  1  bit  processors  at  ENSPS  in  Strasbourg,  T  [14],  [15], 
[16]  -exemplifying  the  rcconfigurablc,  flexible  and  programmable 
design  approach. 


Figure  3  :  The  machine  vision  system  developpcd  at  IAKS 


The  Medium-Level  Processing  Unit  A  network  of  sixteen  T800 
Transputers  (Multiclustcr  2  from  Parsytcc  or  T  Node  from  TelmaO 
has  been  chosen  as  a  medium  level  processing  unit  The  Transputer 
technology  has  been  retained  because  of  its  flexibility  allowing  to 
efficiently  accomodate  the  computation  needs,  as  the  complexity  of 
processing  increases  from  the  low  level  to  the  medium-level  At  this 
level,  OCCAM  has  been  used  as  the  programming  language  for 
Transputers,  because  it  provides  the  advantages  of  a  high-level 
language  and  permits  to  easily  exploit  concurrency  The  OCCAM 
compiler  is  also  very  well  optimized  as  regards  executable  code  size 
and  execution  time.  As  the  inputs  of  the  medium-level  stage  arc 
images,  an  interface  between  the  low-level  stages  video-bus  and 
Transputer  links  of  the  network  has  been  devclopped  to  optimize  data 
transfer  rates  between  the  low  and  medium  processing  stages.  The 
integration  of  the  Transputer  based  systems  is  shown  on  fig.  3.  The 
integration  of  the  specialized  I/O  interfaces,  the  low  level  processor 
modules,  the  medium  level  Transputer  networks  and  the  cooperation 
between  the  two  levels  is  achieved  through  partitioning  of  the 


processing  algorithms  over  the  two  stages,  taking  into  account  the 
characteristics  of  each  processor  and  the  kind  of  algorithms  that  each 
processor  can  optimally  execute.  Consequently,  the  feasibility  of  an 
efficient  combination  of  the  SIMD  and  MIMD  approaches  for  low  and 
medium  level  image  processing  has  been  confirmed.The  processing 
capabilities  in  actual  applications  has  also  been  verified  (sec  section 
4.).  This  should  lead  to  a  tentativ  e  definition  of  the  domains  of  use  of 
each  type  of  parallelism,  leading  to  rough  rules  for  finding  an  optimal 
architecture  foi  a  given  application  and'or  a  given  time  performance 
requirement. 

The  High-Level  Processing  Unit.  The  high  lev  el  processing  unit  is  a 
SUN  4,330  workstation.  This  workstation  is  receiving  features  from 
the  medium-level  processing  unit  in  order  to  interpret  the  initial  real 
world- scene  content.  Programs  running  on  this  workstation  are 
written  in  C++,  an  object  oriented  programming  language,  which 
allows  a  flexible  and  easy  manipulation  of  the  feature  data  coming 
from  the  medium-level  stages  and  usually  packed  into  specific 
objects.  The  SUN  workstationdnitializcs,  configures  and  loads  the 
two  vision  systems  and  the  Transputer  networks  with  appropriate 
algorithms  and  is  used  as  an  interface  between  the  machine  vision 
system  and  its  environment  (Ethernet,  robot  control,  ) 
Communication  (and  feedback  loop)  with  the  low/medium  level 
stages  are  done  using  either  specially  developpcd  Transputer  based 
interfaces,  or  a  Transputer  board  (BBKV2  from  Parsytec)  with  dual 
ported  RAM  between  the  Transputer  memory  bus  and  the  VME  or 
Multibus-bus  of  the  low  level  stages,  or  a  bus  interface  between  the 
workstation  bus  and  the  low-level  system  buses.  Communications 
with  the  Transputer  network  are  performed  with  the  help  of  another 
Transputer  based  board  (VMTM  from  Parsystcc). 

When  planning  a  vision  system,  it  is  necessary  to  provide 
’  universal  "  tools  in  order  to  relieve  partly  the  user  of  the  burden  of 
programming  such  complex  systems.  Due  to  the  envisioned 
applications,  a  great  vanety  of  tasks  results,  leading  to  very  distinct 
operating  facilities  an'1  system  performance.  Furthermore,  in 
laboratory,  tools  are  needed  for  the  development  of  methods  and  for 
the  implementation  of  algorithms  in  order  to  test  their  time  and  logical 
behaviors.  The  tools  must  provide  facilities  enabling  the  user  to  take 
advantage  of  the  underlying  hardware  without  special  knowledge 
about  this  hardware.  On  the  other  hand,  the  requirements  for 
industrial  applications  arc  high  performance,  short  reaction  time  and 
minimum  user  interaction.  In  our  systems,  image  processing  steps 
can  be  run  autonomously  or  interactively.  The  compiled  code  for  the 
processing  steps  is  downloaded  into  the  user  program,  where  it  is 
parameterized  and  started.  Once  a  step  has  been  started,  it  continues 
autonomously,  independently  of  the  calling  user  program  and 
synchronized  with  it  via  an  autonomous  control  software.  The 
software  structure  is  also  in  charge  of  the  high-level  unit.  It  can  be 
seen  as  the  overall  system  management  software,  including  the  man 
machine  interface.  This  man-machine  interface  is  tunning  on  the  SUN 
workstation  and  is  developed  under  X-windows  and  OSF/MOTIF, 
which  allow  the  development  of  menu-driven  applications. 

A  Distributed  (Transputer  Network  Based)  Development  Tool. 
Within  the  Parallel  Computing  Action  Application  PCA  4137,  two 
Transputer  networks  will  be  interconnected  using  an  optical  fiber. 
The  two  systems,  located  the  first  in  Strasbourg  -France,  and  the 
second  in  Karlsruhe  -Germany  (see  fig.  3),  will  be  interconnected 
through  an  already  existing  optical  fiber  between  the  two  institutes 
involved  in  the  application.  The  protocol  chosen  for  data  exchange  is 
the  newly  available  I-DDI  standard.  The  performances  of  this 
standard  arc  such  that  the  overall  performance  of  the  distributed 
transputer  network  should  not  be  lowered.  The  connection  also 
punctually  allows  the  access  by  one  institute  to  the  whole  shared 
resources,  when  high  computing  power  is  required.  The  distributed 
system  can  then  be  seen  as  a  very  complete  development  system  for 
vision  applications,  joining  the  resources  of  the  two  institutes  and 
enabling  the  use  by  each  institute  of  tnc  two  different  low-level 
processing  units. 

4  Applications 

The  machine  vision  systems  described  arc  able  to  deal  with  quite  a 
lot  of  applications.  A  brief  description  of  one  of  these  follows.  An 
example  of  more  sophisticated  application,  currently  under 
development  and  to  be  run  on  the  described  hardwares,  is  the 
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inspection  using  computer  vision,  on  line  in  the  manufacturing 
environment,  of  parts  being  manufactured  [17],[18].  Inspection  takes 
place  through  comparison  of  CCD  images  and  corresponding 
conceptual  representations  gained  using  the  CAD  model  of  the  piece. 
Comparison  takes  places  as  well  at  feature  level  as  at  image  level.  All 
kind  of  inspections,  ranging  from  conformity  checking  up  to 
metrology,  can  be  achieved  through  use  of  an  user  friendly  planning 
system  Due  to  the  limited  resolution  of  the  imaging  sensors  used 
today  for  digital  image  processing,  the  sensor  is  moved  in  order  to 
scan  larger  workpieces  in  their  entire  extent.  CAD-bascd  knuwltdge 
is  also  required  and  used  for  efficient  performance  of  such  hybrid 
mechanical  and  electronical  inspection  tasks.  To  inspect  the 
geometrical  properties,  the  image  of  the  current  field  of  view  is 
compared  with  the  information  stored  in  the  data-base  of  the 
associated  CAD  system,  with  or  without  use  of  structured  light. 
Comparison  takes  place  after  segmentation  and  registration  of  the 
actual  image  with  a  synthetic  projection  of  the  CAD  module. 
Furthermore,  the  3D  data  coming  from  the  CAD  system  are  used  to 
generate  a  2D  representation  corresponding  to  the  angle  of  view  of  the 
sensor.  The  output  of  the  inspection  stage  is  used  for  retrofitting  by 
the  manipulator  in  case  of  a  possible  remanufacturing. 

The  advanced  inspection  system  described  consists  of  knowledge 
processing  and  engineering  at  high  level,  but  the  first  layers  will 
consist  of  simulation,  preprocessing,  feature  extraction  (c.g.  filtering, 
identification,  segmentation)  followed  by  recognition  (registration, 
inspection)  and  decision  taking.  Again,  the  inspection  task  is  the 
chaining  of  different  processing  tasks.  The  three  processing  levels 
defined  in  section  2  and  implemented  in  the  systems  described 
sections  3  can  easily  be  recognized.  It  is  noteworthy  to  see  that  the 
same  model  can  be  used  for  a  wide  range  of  applications  (pick  and 
place,  autonomous  vehicle  guidance,  robotics,  for  example)  just  by 
changing  the  a-priori  knowledge  (e.g.  the  CAD  database). 

The  comparison  itself  may  take  the  form  of  a  simple  distance 
measure  (for  example  as  is  suitable  for  difference  determination 
between  the  original  and  real  parts).  Alternatively,  a  more  complex 
processing  such  as  feature  descriptor  based  methods  (modified 
Fourier  descriptors,  for  example)  may  be  used  to  compare  the  images 
obtained  from  the  CCD  sensor  and  those  synthesized  from  the  CAD 
data-base. 

In  order  to  facilitate  the  implementation  of  such  a  vision 
application,  it  is  definitively  necessary  to  integrate,  as  transparently  as 
possible,  for  the  user,  ihc  vision  system  in  the  complete  inspection 
system,  as  well  with  respect  to  the  hardware  components  as  with 
respect  to  the  overall  manufacturing  environment. 

Up  to  now,  the  design  of  vision  systems  was  dominated  by  the 
image  processing  and  interpretation  methods  themselves.  In  the 
future,  however,  it  will  be  necessary  that  not  isolated  vision  systems 
but  complete  systems,  where  vision  is  only  a  component,  arc 
optimized,  as,  for  example,  in  the  field  of  Computer  Integrated 
Manufacturing  (CIM).  The  resulting  increased  requirements  for  the 
number  and  performance  of  the  used  sensors  will  further  lead  to  new 
evaluation  criteria,  which  must  be  taken  into  account  for  the  design  of 
vision  systems.  The  systems  should  also  be  integrated  in  local  array 
networks  (ETHERNET  or  the  newer  FDDI)  in  order  to  exchange  data 
with  other  sub-systems.  Integration  within  an  overall  manufacturing 
environment  should  also  be  foreseen,  for  example  by  using  MAP 
(Manufacturing  Automation  Protocol).  Development  of  methods  and 
design  of  new  architectures  call  thus  for  carefull  studies  and  possibly 
experimentation.  This  should  be  facilitated  by  the  set  up  of 
development  centers  grouping  hardware  and  software  resources.  A 
possible  configuration  of  such  an  integrated  development  system  for 
computer  vision  applications  has  been  indicated  in  simplified  block- 
diagram  form  in  fig  3. 

5  Conclusion 

A  model  of  machine  vision  architecture  has  been  implemented 
using  different  functional  levels,  leading  to  a  general  purpose  parallel 
computer  for  machine  vision.  The  machines  arc  based  on  pipelined 
low,  medium  and  high  level  processing  units,  each  having  its  own 
well-suited  parallelism. 

Asa  result  of  experimentation  carried  out  with  (he  vision  described 
systems,  the  assessment  of  SIMD  and  MFMD  parallel  architectures 
for  low  level  processing  tasks  and  the  development  of  knowledge 
based  methodologies  for  high  level  applications,  should  allow 
improved  performance  and  competitiveness  in  the  development  of  a 
wide  range  of  image  understanding  applications,  all  based  on  two 
common,  very  flexible  parts: 


•  A  kernel  of  image  protessing  routines  for  software.  A  general 
software  kernel  for  vision  systems  would  allow  the  designer  to  go 
from  one  application  to  the  other  only  by  changing  the  knowledge 
specific  to  the  application  (model  of  the  scene  under  examination  and 
of  its  content),  instead  of  changing  the  whole  software. 

-  An  heterogeneous  parallel  machine  for  hardware.  The 
demonstrated  feasibility  of  programmable  nardwarc  for  image 
processing  enables  faster  implementation  of  a  wide  range  of  industnal 
applications.  With  only  one  programmable  parallel  machine,  it  will  be 
possible  to  solve  a  number  of  disparate  computer  visions  applications 
related  to  various  domains. 

However,  'urther  work  is  necessary  in  this  field,  as  research  must 
be  continued  with  the  aim  in  particular  of  building  a  belter  SIMD 
machine  and  of  improving  the  coupling  with  the  MIMD  machines.  In 
addition,  it  is  necessary  to  develop  di  extensive  software  support,  as 
software  implementation  of  algorithms  will  definitively  be  the  major 
cost  factor  in  developing  hew  applications.  Furthermore,  the  future 
realization  of  vision  systems  will  be  influenced  in  particular  by  the 
integrability  of  vision  systems  as  sub-systems  in  complex 
applications,  possibly  in  the  feedback  path  of  the  control  loop  (.ace 
figure  2)  of  these  systems  in  order,  in  particular,  to  control  the 
sensors  and/or  the  lighting  conditions  (active  sensing)  for  an 
automated,  dynamically  optimized,  data  acquisition. 

Such  vision  systems  are  likely  to  run  a  loi  of  applications,  among 
which  comparison  of  CCD  and  CAD  data  for  automated  workpiece 
inspection  was  described.  The  type  of  computer  vision  architectures 
presented  seems  to  be  very  promising  for  the  future,  as  artificial 
vision  is  becoming  a  more  and  more  important.  The  approach 
described  could  also  lead  to  mure -"intelligent"  robots,  using  such 
vision  systems  to  understand  their  environment. 
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Abstract 

In  this  paper,  we  show  how  data  parallelism  can  be  used  for 
two  low  level  vision  algorithms  based  on  deterministic  relax¬ 
ation  techniques.  First,  we  review  the  architecture  and  pro¬ 
gramming  model  of  the  CM2.  Then,  we  give  some  details 
about  the  implementation.  Finally,  we  compare  both  algo¬ 
rithms  in  terms  of  running  time  per  iteration  for  different 
image  sizes.  We  also  present  a  comparison  between  parallel 
and  serial  implementations  of  the  same  algorithm  on  a  CM2 
and  on  a  SUN4  respectively. 

1  The  Connection  Machine 

In  this  section,  we  briefly  describe  the  architecture  of  the  Con¬ 
nection  Machine,  a  mine  detailed  description  can  be  found  in 
[3},[5].The  Connection  Machine  is  a  single  instruction  multi¬ 
ple  data  (SIMD)  parallel  computer  with  8I<  to  64 K  proces¬ 
sors.  Each  processor  is  a  1-bit  serial  processor,  with  32K 
bytes  of  local  memory  and  a  S.MIlz  cluck.  The  Connection 
Machine  is  accessed  via  a  front  end  computer  which  sends 
macro-instructions  to  a  microcontroller.  All  processors  are 
^adenced  by  the  microcontroller  in  receiving  the  same  nano¬ 
instruction  at  a  given  time  from  it.  Physically,  tile  architec 
ture  is  organized  as  followed: 

•  The  CM2  Chip  contains  10  1  bit  processors. 

•  A  Section  is  the  basic  unit  of  replication.  It  is  composed 
of  2  CM2  Chips,  the  local  memory  of  the  32  processors 
and  the  Floating  Poirrt  Unit. 

•  The  intcrprocessor  communication  architecture  is  com¬ 
posed  of  two  distinct  networks; 

-  A  nearest-neighbour  network,  the  NEWS  Network 
(North-East- West -South},  interconnects  Processors 
in  groups  of  four. 

-  A  more  complex  network  called  the  Router  Net¬ 
work  is  used  to  provide  general  communication  be¬ 
tween  any  pairof  processors.  Each  group  of  16  pro¬ 
cessors  is  connected  to  the  same  router  and  each 
router  is  connected  to  12  other  routers  forming  a 
12-dimensional  livjn-r<  nhc. 


®The  authors  wouM  like  to  thank  D.  Ray  and  If.  toorh-e?  from 
Thinking  Machine  Corporation  f  r  many  .p.m-sk-ns 


Memory  Procs  Communications 


Figure  I:  CM-2  architecture 

For  a  given  application,  the  usd  can  dy  namically  define 
a  particular  geometry  foi  tin  ml  vf- physical  processors  that 

has  been  attached. 

The  proccssot  resuuict  can  he  virtualized  when  the  num 
ber  of  data  elements  to  be  processed  is  grcatci  than  the  num 
her  of  physical  processors.  In  such  a  cave,  several  data  elc 
ments  arc  processed  on  a  single  physical  processor. 

Such  a  data  parallclisin model  aichilcclute  is  well  suited  to 
computer  vision  os  it  is  expressed  in  (4).  [Gj. 

2  Parallel  implementation  of  relax¬ 
ation  algorithms 

2.1  Mathematical  model 

\\c  use  a  probability  lU'-i'it*  m!  tti  ima&t  base*!  on  MarKox 
Random  Fields  ^MRF).  Tv\o  lieftl*  are  uM*d  lo  model  tlie  im¬ 
age:  one  for  the  intensity  to  In*  restored,  the  other  one  for  the 
discontinuities  (edges Hi**  problem  i>  the  approximation  of 
a  surface  given  noisy  depth  data  on  a  regular  2D  lattice' of 
sites.  The  value  of  the  intensity  field  at  tvtdi  site  (i.c,  each 
pixel)  is  given  by  the  surface  height  at  that  site. 

|  *  !  •  |  •  I  .  e 

_  _  _  .  intensity  firid 

|  •  |  •  j  •  |  7  Hne  processes 

_  _  _  I  f,  and  nr,  j 

Figure  2:  !i«.t"<-  ri*j«1<*1 
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We  suppos'  tile  nf  ‘  ~y  image  is  described  by: 

,  _  <k,  =  !/..j  +  ».j  (!) 

whire  is  a  white  Gaussian  noise  and  j/tJ  is  tile  original 
data. 

The  energy  can  be  expressed  by: 

E=D+S+P  (2) 

where: 

D  =  £(y,, -./.J2  (3) 

.  Q 

>v 

+  (n.j  -.'/i.,+i)^(!  -»»,-„)) 

which  models  the  smoothing  imiaUaini  (AJ  *  </i  adie.nt'2) 
and: 

P  =  +  »>.,;)  (4) 

i.J 

which  is  the  cost  to  pay  for  introducing  an  edge. 

The  problem  is  reduced  to  the  minimization  of  a  noil- 
convex  energy  function.  Usually  two  kinds  of  techniques  are 
used  to-solve  this  problem. 

•-  stochastic  techniques  such  as  Simulated  Annealing, 

-•  deterministic  techniques  such  as  Graduated  Non  Con¬ 
vexity,  Mean  Field  Annealing,  Iterated  Conditional  Mode. 

We  are  interested  lit  dcteiiimusUc  algorithms  and  their 
parallel  implementation. 

2.2  The  algorithms 

In  this  section  we  describe  two  deterministic  algorithms  for 
edge  di  don  and  image  restoration:  the  graduated  non  con 
vexity  technique  (GNC)  originally  proposed  by  Blake  k  Zis- 
serman  [1]  and  the  mean  field  annealing  (MFA)  used  by  Geiger 
k  Giros'  [2]  and  Zerubia  &  Chellappa  [7j. 

For  the  GNC  the  basic  idea  is  the  following: 

•  The  first  step  is  to  build  a  convex  approximation  E’  of 
the  energy  E. 

•  The  minimisation  of  E‘  gives  a  global-minimum. 

•  Then  a  sequence  £(p)  is  built  so  that  El  =  E"  and 
E  0  =  E  for  p=l,  1/2.  1/4,  1  /$. 

•  the  minimisation  of  Etpi  uses  as  initial  conditions  the 
result  of  the  minimisation  of  Eip~u 

The  MFA  algoiithm  is  ‘rased  on  Mean  Field  approximation 
used  in  statistical  mechanics.  This  approximation  consists  of 
replacing  the  stochastic  interact 'on  among  the  fields  at  differ 
enl  locations  by  tiic  interaction  of  the  field  at  eacli  site  with 


the  mean  field  values  at  different  locations.  Once  the  parti¬ 
tion  function  ?  lias  been  approximated,  it  is  easy  to  derive 
a-set  of  deterministic  equations  for  the  mean  field  values  §,  1 
and  r7i  of  the  intensity  and  the  line-processes. 

2.3  Parallel  implementation 

Both  methods  are  based  oil  t  he  weak  membrane  model  (cf.(2)) 
and  both  algorithms  are  inheiently  serial:  each  step  produces 
a  pixel  map  which  is  taken  as  input  for  the  next  step.  For  the 
GNC,  we  implement  a  checkerboard  version  of  the  successive 
over  relaxation  method  [l]  to  minimize  the  energy  and  for  the 
MFA,  we  use  an  optimal  step  conjugate  gradient  descent  [7]. 

Although  both  techniques  are  deterministic,  it  taxes  a  lot 
of  computational  time  on  a  sequential  computer  to  get  the 
edge  map  and  the  restored  image.  Our  attempt  in  reducing 
this  time  Is  based  on -the  fact  that,  in  early  vision  processing, 
much  of  the  time  is  spent,  in  performing  local  computation. 
Herein,  we  use  data  paiallelisin  (one  pixel  per  virtual  pro 
cessor)  and  fast  local  communications  (NEWS)  provided  by 
the  underlying  architecture^],  (5).  For  global  operations  like 
computing  the  energy  value  over  the  whole  image,  we  use  the 
reduce  primitives. 

3  Experimental  results 

These  two  algorithms  have  been  run  on  a  great  variety  of  im¬ 
ages.  The  discussion  that  follows  is  about  their  running  time 
on  the  CM2  using  8Iv  processor.  Qualitative  aspects  are  dis¬ 
cussed  in  (8). 

Table  1  shows  the  number  of  different  types  of  instructions 
for  each  algorithm.  All  these  instructions  are  32  bit  floating 
point  instructions.  The  interesting  point  is  that  the  inter¬ 
processor  communications  are  local  and  the  ratio  between  the 
number  of  communication  instructions  am'  ‘he  number  of  oth¬ 
ers  is  very  low. 


Arith.and  Compar. 

NEWS 

Global  Ops. 

GNC 

117 

10 

1 

M  -'A 

123 

24 

4 

Table  1  :  Number  of  CM  iiistmctions  per  iteration. 


The  GNC  and  MFA  paiallel  algorithms  implemented  on 
the  Connection  Machine  are  compared.  For  eacli  one,  we  give: 

-  The  Virtual  Processor  Ratio  (VPR)  i.e.  the  number  of 
virtual  processor  per  physical  processor. 

-  The  CM  time. 

-  The  total  time. 

-  The  number  of  iterations  foi  each  algorithm. 

-  The  CM  time  per  iteration. 

In  table  2  and  3  aie  displayed  the  lesults  for  two  images: 
a  noisy  aerial  image  (cf.fig.3j  and  an  infra-red  image. 
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Figure  I:  Edge  map  with  GNC 


VPR 

CM 

time 

Total 

lime 

Xb.Iter 

CM  time 
per  It 

GNC 

2 

wm 

61.5 

0.03 

MFA 

2 

10.2 

19.13 

174 

0.05 

Table  2  :  Noisy  Aeiial  Image  128x128 


VPR 

CM 

time 

Total 

time 

Xb.Iter 

CM  time 
per  It 

GNC 

S3 

15.81 

58.85 

172 

0.12 

MFA 

8 

mi 

Table.?;  Infra-tcd  Image 256x236. 


The  execution  time  pet  iteiatiou  lor  the  GNC  algorithm 
is  faster  tlian  for  the  Mh\.  Hut.  geneially.  the  .MFA  needs 
less  itcr.itionsUo  converge.  Figure  3  shows  that  the  execution 
time  per  iteration  is  piopoiiioii.il  lo  the  number  of  pixels  per 


processor.  However,  as  the  number  of  pixels  per  processor 
grows  the  ratio  between  the  c.wuutioti  lime  pel  iteration  and 
the  number  of  pixels  pel  pioeessoi  U  a  Lit  lower.  This  is  due 
to  the  fact  that,  the  higliei  is  the  \  PR,  the  higher  is  the  per 
centage  of  local  communications. 


Fortran-Sun4 

“Lisp-CM 

Total 

time 

Time 
per  it. 

Total 

time 

Time 
per  it. 

GNC 

15mn. 

1.69s 

61.5s 

0.11s 

MFA 

25mn. 

7.97s 

19.13s 

0.109s 

Tabled  ;  Noisy  Aerial  Image  128x128 


Figure  5:  Execution  time  oPthe  GNC  and  MFA  Algorithms 
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ABSTRACT  -  The  massive  computation  requirements  of  an  increas¬ 
ing  number  of  applications  m  electronic  measurements  need  dedicated 
hardware  architectures- to  match  the  high  throughputs  of  real-time 
environments.  This  paper  presents  some  results  about  design  and 
implementation  of  an  integrated  measurement  system  based  upon  a 
multiprocessor  architecture. 

I.  INTRODUCTION 

A  number  of  high-computing  applications  are  nowadays  practi¬ 
cally  feasible  and  appealing  due  to  the  availability  of  realisable,  reliable 
structures  for  massive  computation  at  reasonable  costs,  e.g.  in  digital 
signal  processing.  In  particular,  it  is  possible  to  implement  specialised 
architectures  for  management  of  large  data  in  real  time  for  extract¬ 
ing:^  reduced  amount  of  essential  information.  Complex  and  accurate 
data  observation  and  system  control  may  be  implemented  by  using 
this  characteristic  figures  of  the  input  data.  A  great  number  of  exam¬ 
ples  may  be  found  in  electrical  and  electronic  areas:  one  of  the  most 
important  applications  that  becomes  now  realisable  is  constituted  by 
the  systems  for  real-time  measurement  for-power  and  armomc  control 
in  power  distribution. 

In  this  paper  we  present  a  new  integrated  approach  to  real-time 
measurement  of  electrical  parameters  which  is  based  upon  a  multipro¬ 
cessor  system.  Such  architecture  allows  to  satisfy  the  massive  through¬ 
puts  and  requirements  of  complex,  high-level  measurements.  In  par¬ 
ticular, -we  present  the  overall  hardware  architecture  and  the  dedicated 
software  environment  for  developing  application-specific  measurement 
algorithms. 

Our  parallel  architecture  is  composed  by  a  SIMD  multiproces¬ 
sor  suL  system  for  parallel  computation  and  by  a  front-end  for  an  easy 
user. interaction  and  control.  Both  such  components  arc  connected  to  a 
standard  VME  bus  and  to  a  dedicated  control  bus.  The  front-end  com¬ 
puter  is  a  standard  Motorola’s  68020  board,  with  mass-storage  devices 
and  input/output  subsystems.  Such  computer  provides  the  high-level 
human  interface  for  designing,  testing  and  executing  the  application- 
specific  measurement  algorithms.  The  front-end  computer  allows  to 
load  the  measurement  algorithm  in  the  program  memory  of  the  multi¬ 
processor  subsystem,  to  overview  and  control  the  computation  in  such 
subsystem. 


II.  APPLICATION  AND  MATHEMATICAL  REMARKS 

Electronic  measurements  require  execution  of  high-computing  al¬ 
gorithms  to  extract  basic  characteristics  and  features  from  a  large 
amount  of  data.  Usually,  when  the  measurements  are  used  a3  informa¬ 
tion  sources  for  chosing  the  suited  actions  in  plant  or  process  controls, 
all  operations  must  be  performed  in  real-time.  This  constraint  makes 
impressive  the  amount  of  data  that  must  be  treated  on-line  during 
system  management. 

One  of  the  most  recent  and  important  applications  in  the  fields  of 
electrical  engineering  is  the  l-al-time  accurate  control  of  high-voltage 
transmission  and  distribution  systems.  In  this  application,  real-time 
electronic  measurements  are  used  to  compensate  the  armomc  contents 
of  current  and  voltages  due  to  the  characteristics  of  the  distribution 
system  and  to  the  electric  loads.  The  basic  aim  of  such  operation  is  in 
fact  the  optimisation  of  power  distribution  with  minimisation  of  power 
losses.  Real-time  control  is  important  to  measure  dinamically  the  ar- 
monics  and  to  provide  continuously  updated  feedback  information  to 
the  armonic  compensator.  This  power  electronic  system  suppresses 
unexpected  and  undcsircd  frequencies  and  corrects  reactive  power. 


High  computational  capabilities  and  possible  parallelisation  of  the 
basic  computation  are  two  basic  features  to  implement  efficient  archi¬ 
tectures  fur  real-time  applications  when  massive  computation  is  con¬ 
cerned  [3]  [4],  In  the  application  case  presented  above,  these  charac 
teristics  allow  to  guarantee  a  very  low  response  lime  in  driving  the 
electric  power  system  for  armonic  compensation  and,  thus,  to  achieve 
an  effective  and  optimal  power  distribution. 

In  this  application,  there  is  also  a  very  large  set  of  input  data, 
which  are  composed  by  the  samples  of  three-phase  voltages  and  cur¬ 
rents  Since  control  activities  operate  only  on  integral  forms  of  such 
inputs,  the  high-level  management  of  the  system  does  not  need  a  de¬ 
tailed  and  complete  knowledge  of  the  samples’  values  In  fact  analysis 
of  the  electrical  behavior  of  the  distribution  system  can  be  performed 
by  extracting  the  characteristic  figures  both  in  time  or  frequency  do¬ 
mains.  A  pre-processing  and  compacting  function  must  therefore  be 
executed  to  reduce  the  quantity  of  information  This  is  useful  to  allow 
acquisition,  manipulation  and  storing  only  of  the  necessary  data  in 
the  control  computer  Data  compression  and  reduction  arc  an  impor¬ 
tant  step  towards  the  implementation  of  real-time  control  of  complex 
system  at  reasonable  costs. 

To  satisfy  strict  computational  requirements,  the  computer  archi¬ 
tecture  must  be  able  to  guarantee  a  high  computational  power  and, 
above  all,  an  impressive  input  throughput  Output  is  generally  very 
smaller  than  input  flow,  due  to  the  characteristics  of  the  computa¬ 
tion  input/output  management  is  thus  strongly  unbalanced  towards 
input  activities.  Neither  traditional  computers  nor  known  architec¬ 
tures  of  parallel  processors  [3]  [4]  are  able  to  provide  a  flexible  and 
high-throughput  connection  between  the  processing  units  and  the  ex¬ 
ternal  environment,  at  least  at  reasonable  costs.  Therefore,  a  new 
dedicated  solution,  as  the  one  we  propose,  is  needed  to  achieve  an 
efficient  system  without  using  expensive  structures. 

By  looking  at  the  algorithms  used  in  electronic  measurement  and 
in  system  controls,  we  can  identify  a  low  number  of  typical  mathe¬ 
matical  operations  that  arc  common  to  the  most  of  the  algorithms. 
Traditional  arithmetic  operations  are  obviously  widely  used  in  all  nu¬ 
merical  algorithms.  Therefore,  the  architecture,  specialised  for  mea¬ 
surements,  must  greatly  optimise  execution  of  data  transfer,  addition, 
subtraction,  multiplication  and  division. 

A  second  group  of  more  complex  operations  constitutes  the  basic 
kernel  of  a  large  number  of  algorithms  to  compute  electrical  quantities: 
the  data  transformations.  Different  kinds  of  data  transformations  may 
be  identified  in  the  most  of  the  popular  algorithms.  Some  examples 
are  Fourier,  Walsh-Hadamard,  sine  and  cosine  transformations,  con¬ 
volution  and  correlation  [5]  [7j.  These  operations  allow  to  extract  the 
different  spectral  contents  of  the  input  data  and  to  generate  composed 
control  signals.  The  previous  mathematical  operations  require  execu¬ 
tion  of  many  simple  arithmetic  operations  (e.g.  additions,  subtrac¬ 
tions  and  multiplications)  [o],  efficient  generation  of  the  corresponding 
coefficients  and  proper  data  addressing  and  use.  An  effective  imple¬ 
mentation  should  therefore  be  tailored  to  perform  the  most  of  such 
activities  directly  in  hardware  to  increase  the  overall  computational 
power  of  the  architecture  Configurable  devices  should  be  preferred 
to  hard  wired  solutions  to  guarantee  the  flexibility  of  the  system  and 
adaptability  to  different  specific  applications  and  measurements. 

in.  HARDWARE  ARCHITECTURE 

The  parallel  architecture,  presented  m  this  paper,  has  been  de¬ 
signed  especially  for  advanced  measurement  applications,  its  features 
are  thus  strictly  connected  with  the  specific  algorithms  implemented 
in  measurement  procedures.  The  processor  design  has  been  studied  to 
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obtain  the  best  performances  not  only  for  some  traditional  arithmetic 
operations,  but  also  for- high-speed  digital  signal  processing  operations 
(e.g.  Walsh  and  Fourier  transforms). 

Our  parallel  architecture  is  composed  by  a  multiprocessor  subsys¬ 
tem  and  by  a  front-end  computer,  as  it  is  shown  in  fig.  1.  The  first 
one  allows  to  execute  high-speed  parallel  computation,  while  the  sec¬ 
ond  one  provides  an  easy  user  interaction  and  control.  Highly-parallci 
computation  is  supported  by  using  the  32-bit  VME  system  bus  and  a 
70-bit  dedicated  bus  for  instruction  transfer  and  broadcasting.  High 
throughputs  are  achieved  by  using  dedicated  16-bit  data  busses  (one 
for  each  processing  unit)  which  connect  the  multiprocessor  subsystem 
to. the  external  data  sources. 


DEDICATED  BUS 

Fig.  1  -  The  multiprocessor  architecture 


Our  structure  differs  from  many  ether  parallel  structures  since  it 
behaves  basically  as  a  co-processing  unit  of  the  front-end  computer. 
In  fact  it  may  be  used  to  extract  some  characteristic  figures  from  a 
large  amount  of  input  data  by  means  of  traditional  signal  processing 
algorithms.  This  pre-processing  activity  greatly  reduces  the  quantity 
of  data  that  must  treated  by  the  front-end  computer,  in  particular  for 
applications  in  electronic  mesurements  and  automatic  control. 

The  front-end  computer  is  a  standard  Motorola’s.68020  board, 
with  hard  and  floppy  disks,  printer,  plotter,  serial  and  parallel  com¬ 
munication  channels,  graphic  display.  The  main  goal  of  this  com¬ 
puter  is  the  definition  of  a  standard  Unix  environment  for  the  user 
activities.  Moreover,  it  provides  the  high-level  human  interface  for 
designing,  testing  and  executing  the  application-specific  measurement 
algorithms.  In  particular,  the  front-end  computer  has  been  designed  to 
support  loading  of  the  measurement  algorithms  in  the  multiprocessor 
memory  and  controlling  of  the  parallel  computation.  The  multiproces¬ 
sor  subsystem  and  the  front-end  computer  are  connected  to  a  standard 
VME  bus  and  to  a  dedicated  control  bus  for  data  and  control  exchange. 

The  multiprocessor  subsystem  is  a  SIMD  architecture,  in  which 
a  single  instruction  is  performed -at  the  same  time  by  all  processing 
units  [3]  (4).  The  main  goals  of  our  design  approach  to  a  multipro¬ 
cessor  architecture  were  performance,  modularity,  expandability,  flex¬ 
ibility  and  adaptability.  Performance  is  an  obvious  requirement  to 
implement  structures  for  massive  computation.  Modularity  allows  to 
achieve  a  compact  standard  architecture  in  which  the  component  can 
be  modified  and  improved  according  to  the  requirements  of  the  spe¬ 
cific  applications.  Simple  and  fixed  interfaces,  interconnections  and 
protocols  guarantee  the  expandability  of  the  structure  (at  least  in  a 
reasonable  range)  by  addition  of  identical  modules  to  match  the  algo¬ 


rithm  characteristics.  Flexibility  and  adaptability  of  the  architecture 
to  a  large  class  of  measurement  algorithms  is  needed  to  implement  a 
unique  computing  structure  that  may  be  used  for  a  number  of  differ¬ 
ent  applications  Adaptability  should  hold  alsu  at  run-time  by  means 
of  a  software  reconfiguration  of  interconnections  to  guarantee  a  high 
availability  and  flexibility  of  the  system  Many  uf  these  features  where 
achieved  by  adopting  a  simple,  clear,  high-speed,  modular  architecture 
based  upon  standard  components. 

T*  -  multiprocessor  subsystem  is  composed  by  identical  processing 
units  ami  by  a  controller  unit  (see  fig.  I).  The  processing  units  pro- 
v  ide  the  parallel  computational  power  by  working  on  different  data  sets 
contemporaneously.  The  control  unit  has  been  introduced  to  overview 
the  multiprocessor  activity  by  imposing  the  sequence  of  instructions 
that  must  be  performed.by  all  processing  units  in  parallel.  The  num¬ 
ber  of  processing  units  depends  on  the  specific  measurement  algorithm 
required  by  the  user.  We  have  found  from  extensive  experiments  that 
a  good  balance  between  the  multiprocessor  performance  and  host  com¬ 
puter  operativity  in  the  minimal  configuration  can  be  achieved  when 
the  units  are  no  more  than  8. 

Each  processing  unit  is  composed  by  two  boards:  the  ALU  (Arith¬ 
metic  Lugic  Unit)  board  and  the  local  memory.  The  ALU  board  is 
the  heart  of  the  computational  structure  to  implement  high-speed  al¬ 
gorithms  for  electronic  measurement.  The  memory  board  is  basically 
used  to  store  measurement  data  coming  from  the  external  environ¬ 
ment,  during  execution  of  the  application-specific  algorithm.  Perfor- 
mant  data  transfer  inside  each  board  is  guaranteed  by  an  internal 
high-speed  bus  for  data  and  addresses.  Our  implementation  of  the 
experimental  multiprocessor,  discussed  in  this  paper,  considers  arith¬ 
metic  units  for  16-bit  data  and  operates  at  10  MHz  to  avoid  hardware 
complex  structures  and  to  provide  high  flexibility,  powerful  computa¬ 
tional  capabilities  and  high-throughput  data  management  at  reason¬ 
able  costs.  The  structure  of  the  processing  unit  is  given  in  fig.  2. 


Fig.  2  -  The  processing  unit 

The  ALU  board  is  a  custom  structure  fur  cxccutiuii  uf  basic  arith¬ 
metic  uperatiun  and  sumc  turnplcx  algurithmic  kernels  uf  digital  signal 
prutessing.  The  ALU  board  is  based  upun  AMD's  29501  ALU’s  and 
AMD’s  29517  multiplier. 

Two  three-purt  VLSI  ALU's  perfurm  the  curnputaliun  un  16  bit 
data  using  a  rum.  bus  and  rnuitiregistcr  architecture.  A  high  perfur- 
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mance  16x16  bit  multiplier  completes  the  arithmetic  hardware  and 
provide  the  suited  computational  support  for  a  high-speed  implemen 
tation  of  FFT  algorithm.  The  two  ALUs  can  perform  multiple  data 
operations  during  the  same  clock  cycle  using  their  multiport  struc¬ 
ture  (two  input-output  ports  and  one  input  port)  and  the  six  register 
operating  independently  by  the  internal  ALU  and  MUX  registers 

The  memory  board  has  been  designed  to  obtain  the  best  per 
formancc  and  to  reduce  data  transfer  time  without  limiting  system 
capabilities.  This  board  is  strictly  connected  to  ALU  board  Never¬ 
theless,  it  has  high  autonomous  capabilities  for  data  management  A 
double  memory  bank  has  in  fact  been  developed  to  allow  contempo¬ 
rary  memory  management  from  both  internal  processor  resources  and 
system  ALU.  Every  bank  is  formed  by  four  8x32  kbit  memories  con¬ 
nected  to  the  internal  32-bit  bus.  These  two  bus  can  be  alternatively 
switched  to  one  of  the  three  possible  connection  paths  (ALU's,  direct 
-I/O,  system  bus). 

Two  independent  data  paths  are  provided  by  the  memory  board 
in  order  to  exchange  information  with  the  external  environment. 

-  the  main  data  path,  which  is  connected  to  the  system  bus, 

-  the  secondary  data  path,  that  provides  a  direct  input  bus  for  data 

acquisition  by  using  the  DMA  technique. 

While  the  processors  are  working  on  odd  banks,  the  host  computer 
performs  data  transfer  operations  from/to  the  main  memory  for  the 
even  banks,  and  vice  versa.  The  switching  system  provides  the  control 
of  active  paths  in  order  to  avoid  bus  conflicts. 

When  DMA  tecniques  arc  adopted,  at  first  the  control  logic  exe¬ 
cutes  memory  reading  operations  (performed  by  the  main  CPU)  and, 
then,  DMA  acquisition  from  secondary  data  port  since  data  arc  writ¬ 
ten  in -the  same  storage.  Both  these  activities  can  be  implemented 
while  the  processor  is  working  on  the  other  bank  because  their  exe¬ 
cution  time  is  smaller  than  time  required  to  complete  a  Walsh  or  a 
Fourier  transform. 

The  sine  and  cosine  generators  (for  FFT  algorithm)  or  Walsh 
function  generator  (for  FWT  algorithm)  and  latches  providing  the  bus 
switching  during  computational  activities  have  been  arranged  on  the 
memory  board  to  limit  the  ALU  complexity. 

As  we  have  seen,  the  multi-access  structure  and  management  of 
input  data  and  memory  banks  are  the  most  important  novelty  of  our 
approach  to  multiprocessor  design  for  applications  in  electronic  mea¬ 
surements.  The  vafiuos  possibilities  of  overlapping  data  input  and 
internal  computations  greatly  increase  the  throughput  and  the  com¬ 
putational  power  of  the  system  to  match  the  massive  requirements  of 
real-time  applications  in  measurement  and  control.  While  one  half  of 
a  processing  unit  is  computing  the  nominal  algorithm,  the  other  is 
supporting  the  input/output  mechanism. 

Parallel  computation  and  management  of  the  boards  of  the  pro¬ 
cessing  units  must  be  performed  by  activating  the  proper  control  sig¬ 
nals  on  the  dedicated  control  bus.  Due  to  the  complexity  of  the  dif¬ 
ferent  activities  that  can  be  cxcutcd  in  parallel  and  to  the  number 
of  control  signals,  direct  control  from  the  front-end  computer  is  not 
feasible. 

To  provide  an  efficient  mechanism  for  operation  fetching  and  de¬ 
coding  in  the  multiprocessor  system,  we  defined  a  set  of  instructions 
that  can  be  executed  by  our  architecture.  Each  instruction  corre¬ 
sponds  is  the  compact  coded  representation  of  the  control  signals  that 
must  be  activated  to  impose  execution  of  the  desired  operation.  A 
program  for  the  multiprocessor  system  consists  of  a  sequence  of  such 
instructions. 

Since  our  multiprocessor  is  a  SIMD  machine,  only  one  control  unit 
is  needed  to  supervise  and  manage  all  processing  units.  This  board  is 
composed  by  the  program  memory  and  the  processing  controller.  The 
program  memory  contains  the  sequence  of  instructions  (in  the  coded 
format)  that  the  multiprocessor  must  execute.  The  processing  con¬ 
troller  perform?  the  fetch  and  decode  operations  of  the  multiprocessor 
program. 

The  processing  controller  is  an  AMD's  2910  microcontroller  with 
its  own  control  circuits,  private  memory  and  latches.  The  microcon¬ 
troller  fetches  and  decodes  the  operations  for  the  multiprocessor.  For 
each  new  instruction,  it  acquires  the  coded  representation  from  the 
program  memory  and  identifies  the  current  instruction.  Then,  it  gen¬ 


erates  the  proper  control  signals,  which  correspond  to  the  current  in¬ 
struction,  by  looking  at  them  into  the  its  own  private  memory.  Finally, 
the  microcontroller  moves  to  the  next  instruction.  Due  to  the  modu¬ 
larity  of  the  multiprocessor  architecture,  in  the  second  release  of  the 
control  board,  the  microcontroller  will  be  substituted  by  a  micropro¬ 
cessor.  when  properly  programmed  such  microprocessor  will  be  able  to 
generate  autonomously  sequences  of  multiprocessor  instructions  that 
will  execute  cumplex  operations  on  data.  In  this  case  the  controller 
unit  will  behave  as  a  traditional  microprogrammed  unit. 

The  program  memory  is  composed  by  twelve  8x4k  bit  high-speed 
static  CMOS  RAM.  In  this  memory,  we  store  the  sequence  instruc¬ 
tions  for  the  multiprocessor,  which  are  29-bit  long.  The  memory  is 
loaded  by  front-end  computer  through  the  system  bus  before  com- 
pution  is  started.  The  96-bit  control  signals,  generated  by  the  pro¬ 
gram  controller  in  correspondence  to  each  multiprocessor  instruction, 
are  imposed  to  every  processing  unit  by  using  the  dedicated  control 
bus. 

Program  execution  is  started  by  the  front-end  computer,  after 
loading  the  program  in  the  program  memory  of  the  multiprocessor 
subsystem,  the  fronbend  computer  enables  the  autonomous  computa¬ 
tion  of  the  multiprocessor  by  stating  the  proper  signals  to  the  control 
unit  Results  computed  by  the  multiprocessor  are  stored  in  the  local 
memory  of  the  multiprocessor  itself  The  front-end  computer  may  read 
them  through  the  VME  data  bus  and  provide  delivering  to  the  user  or 
storing  in  mass-storage  devices. 

TV.  SOFTWARE  ENVIRONMENT 
The  use  uf  an  advanced  hardware  architecture  generally  presents 
a  number  of  practical  difficulties,  which  reduce  the  usability  of  the  sys¬ 
tem  and  a  complete  exploitation  of  the  new  features.  In  our  architec¬ 
ture,  this  drawback  is  essentially  related  to  the  complexity  of  the  struc¬ 
ture  and  to  the  non-traditional  parallel  programming  style.  To  avoid 
this  drawback  and  to  give  access  to  new  computational  paradigms  also 
to  non-expert  users,  an  integrated  environment  become  necessary. 

In  our  research  we  developed  different  tools  which  guarantee  a 
high  level  view  to  the  hardware  architecture  and  easy  programming  of 
a  large  class  of  numerical- intensive  applications.  A  general  schema  of 
‘.he  software  environment  is  shown  in  fig-  3.  The  main  entities  and 
tools  we  developed  and  integrated  in  the  standard  Unix  environment 
of  the  fron-end  computer  are: 

the  low  level  multiprocessor  assembler  and  the  related  translator, 
U’C  assembler  run  time  library  for  direct  access  to  all  features  of 
the  system, 

-  the  high-level  language  C  and  the  related  compiler, 

-  a  high-level  run-time  library  for  traditional  programming  in  C 
language, 

-  a  program  loader, 

-  a  symbolic  debugger  for  C  language, 

-  an  interactive  control  environment. 
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To  allow  the  user  programming  of  application-specific  algorithms 
for- the  multiprocessor  architecture,  it  is  necessary  to  define -the  se¬ 
quences  of  instructions  in  the  assembler  of  the  multiprocessor  itself. 
Such  instructions  are  the  coded  represcntationiof  the  control  signals 
which  impose  execution  of  the  desired  sequences  of  operations.  When¬ 
ever  the  multiprocessor  controller  fetches  a  new  instruction,  it  decodes 
the  compact  representation  and  generates  the  proper  signals  to  acti¬ 
vate  the  devices  required  by  the  operation. 

The  symbolic  representation  of  the  assembler  instructions  of  our 
multiprocessor  is  similar  to  all  traditional  assembler  languages  of  mi¬ 
croprocessors  [1].  An  instruction  is  given  by  the  n-tuplc 
(opcode,  op-1,  op-2,  ...  op-n) 

where  opcode  is  the  operator  (i.e.  the  symbolic  identifier  of  the  desired 
operation),  while  op-i  arc  the  needed  operands  (i.e.  immediate  data, 
registers,  memory  addresses).  The  complete  definition  of  the  assembler 
language  is  given  in  (2).  On  the  front-end  computer  we  developed  a 
translator  which  generates  the  machine  code  from  the  assembler  source 
code  of  the  user  program.  Parallelism  and  data  transfer  are  demanded 
to  the  proper  design  of  the  assembler  program. 

To  write  new  application  programs  in  thc  multiproccssor  assem¬ 
bler  in  a  simple  way,  we  provide  a  modular,  expandable  run-time  li¬ 
brary.  It  contains  the  most  used  basic  mathematical  functions  (e  g. 
trigonometric,  exponential  and  hiperbolic  functions)  and  the  advanced 
DSP  operations  (e.g.  DFT,  FFT,  HFT,  convolution,  correlation). 
Such  functions  arc  coded  as  efficient  as  possible  by  exploiting  all  hard¬ 
ware  parallelisms. 

For  loading,  debugging  and  executing  the  machine  code,  the  front- 
cnd;provides  a  user-friendly  environment.  The  user  can  select  the  pro¬ 
gram  file  that  must  be  loaded,  can  transfer  such  program  in  the  mem¬ 
ory  of  the  multiprocessor  subsystem,  can  run  the  program  Possibly, 
he  can  also  execute  the  multiprocessor  program  in  a  step-by-step  mode 
or  by  introducing  break-points  to  observe  the  behavior  of  the  system 
and  to  correct  errors  in  algorithms  under  development. 

A  higher  programming  interface  may  be  achieved  by  adopting  a 
standard  programming  language  and  custom  libraries  for  multiproces¬ 
sor  operations.  In  our  system  we  consider  at  the  moment  a  subset  of 
the  C  standard  programming  language  Control  and  programming  of 
the  multiprocessor  architecture  is  allowed  by  a  run-time  library  that 
we  designed  and  implemented  for  the  most  common  operations  The 
user  writes  his  programs  as  on  a  traditional  monoproccssor  computer 
during  execution  the  run-time  library  guarantee  the  proper  data  trans¬ 
fer  and  program  execution  on  the  multiprocessor  architecture.  Pro¬ 
gram  editing  and  compiling  for  the  multiprocessor  is  performed  onto 
the  front-end  computer  by  using  a  traditional  text  editor  and  our  C 
cross-compiler,  respectively.  At  the  moment  we  are  designing  also  a 
high-level  debugging  tool  to  provide  a  view  of  the  program  in  the  C 
language  (except  for  the  run-time  multiprocessing  procedures). 

V.  CONCLUDING  REMARKS 

A  flexible  multiprocessor  architecture  has  been  presented  in  this 
paper,  particularly  suited  for  on-line  processing  of  a  large  amount  of 
data  signals  The  most  original  charatcristics.uf  such  architecture  is 
the  high  capability  of  acquiring  data  from  the  external  environment 


due  to  specialised  high-speed- data  paths  for  concurrent  I/O  opera¬ 
tions.  A  powerful  support  to  direct  signal  processing  is  the  availability 
of  dedicated  hardware  inside  each  processing  unit  for  high-level  math¬ 
ematical  computations  (e.g.  DFT).  The  traditional  FFT  alghorithm 
uan  be  implemented  in  our  architecture  by  using  ten  ist^uctions  they 
are  iterately  executed  for  a  number  of  times  equal  to  the  number  of 
butterflies  required  by  the  computation.  If-the  number  of  sampled 
points  is  N  =  2*,  the  total  execution  time  T  for  the  FFT  in  a  single 
processor  board  is  T  =  lOTckN j 2  =  5TC  f:2fc .  where  Te  is  the  clock  pe¬ 
riod  of  the  system  In  our  experimental  implementation,  a  1024-points 
FFT  is  executed  about  in  5  ms. 

As  software  aspects  are  concerned,  our  system  provides  an  inte¬ 
grated  environment  for  development  of  application  programs.  A  li¬ 
brary  of  basic  mathematical  operation  has  been  implemented.  It  is 
continuously  updated  and  expanded  to  cope  with  the  requiremets  of 
new  applications  we  are  experimenting  in  the  area  of  electronic  mea¬ 
surements. 

Further  researches  are  presently  in  progress  to  improve  the  ab¬ 
straction  level  for  the  programmer  of  applications.  In  particular,  we 
arc  studying  a  user-friendly  interface  and  programming  style  based 
upon  icons:  non-expert  users  will  create  the  computational  graph, 
which  describes  operations  performed  upon  input  data,  through  graph¬ 
ic  interaction  with  the  development  environment.  The  user  will  select 
functional  building  blocks  from  a  menu  and  connect  them  into  the 
computational  graph. 

A  second  research  topic  is  the  automatic  identification  of  paral¬ 
lelism  in  the  user  program.  Compiler  and  assembler  translator  should 
be  able  to  describe  a  sequence  of  simple  operations  affecting  disjoint 
sets  of  devices  in  the  same  processing  unit  by  means  of  a  unique  in¬ 
struction.  Whenever  group  of  operations  can  be  executed  at  the  same 
time,  the  compiler  and  the  assembler  must  detect  this  event  and  col¬ 
lapse  the  operations  into  the  unique  instruction. 
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Abstract  -  A  paper  presents  some  theorems 
giving  sufficient  conditions  for  a  reliabili¬ 
ty  function  to  be  an  asymptotic  of  large 
series-parallel  and  parallel-series  systems. 

I.  INTRODUCTION 


series-parallel  system  of  order  m,  m»l.  If 


for  all 


.,^1^  1*  *  *im-l'^m-l^ 


We  are  interested  in  a  wide  class  of  systems 
•which  every  two  elements  are  connected  to 
each  other  either  parallel  or  series.  In  the 
investigation  of  these  systems  it  can  be  no¬ 
ticed  that  their  elements  can  be  arranged  and 
numerated  this  way  that  the  system  lifetime  X 
is  given  by 


X  =  m 
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is  the  arranged  family  of  the  random  varia¬ 
bles  corresponding  with  the  lifetimes  of  the 
particular  elements.  In  a  first  case  the 
system  is  called  a  parallel-series  system  of 
order  m  and  in  a  second  case  it  is  called  a 


then  parallel-series  and  series-parallel 
systems  are  called  regular.  Moreover,  if 
random  variables  of  the  family  DC  have  the 
same  distribution  function  F(x>,  i.e.  ele¬ 
ments  have  the  same  reliability  function 
R(x)  =  i  -  F(x) ,  then  these  systems  are 
called  homogeneous. 

Now,  assuming  k  a  kn  and  1  =  ln,  where  n 
tends  to  infinity  and  kn  and  lp  are  natural 
numbers,  we  obtain  sequences  of  parallel- 
series  and  series-parallel  regular  homogene¬ 
ous  systems  of  order  m  corresponding  with  the 
sequence  (kn,ln).  For  these  sequences  of 
systems  there  exist  sequences  of  reliability 
functions  IR^m,00  for  parallel -series  and 
iR^ra\x)  for  series-parallel  system. 

II.  ASYMPTOTICS  OF  PmRALLEL-SERIES  and 
SERIES-PARALLEL  SYSTEMS 


Definition  1. 

A  reliability  function  IR(x)  is  called  an 
asymptotic  reliability  function  of  a  sequence 
IR^m\x)  or  an  asymptotic  of  the  regular  homo¬ 
geneous  parallel-series  system  of  order  m  if 
there  exist  constants  a^m>>  0,  b^"1^  (-00,00), 
such  that 

1  i^m  lR^m)(a£m)  x  +  b^m))  =  IR(x> 
at  all  x  where  IR  CO  is  continuous. 
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Similarly  wo  define  an  asymptotic  of  the 
regular  homogeneous  series-parallel  system  of 
order  m. 

Theorem  1. 

Let 


d  =  sup^x  s  IRCx\  ?  0  }  . 


If  IR(x>  is  continuous  at  point  d  in  case  when 
d  <  a>  and  sequences  (  a^"15  ,b^)  ,  (kn,ln)  have 

the  following  properties 
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theorems  1  and  2  provide  sufficient  condi¬ 
tions  for  a  reliability  function  to  be  an 
asymptotic  of  the  regular  homogeneous  para¬ 
llel-series  and  series-parallel  systems  res¬ 
pectively.  These  conditions  allow  to  search 
for  the  possible  asymptotics  of  the  conside¬ 
red  systems  in  case  when  their  reliability 
models  are  fixed.  First,  one  should  assume 
any  reliability  function  and  next  try  to  find 
a  norming  constants  sequence  C3pm\b^m^)  sa- 
tysfying  the  sufficient  conditions  for  the 
assumed  reliability  function  to  be  an  asym¬ 
ptotic  of  the  system.  Some  examples  and  more 
general  theorems  about  asymptotics  of  the 
parallel-series  and  series-parallel  systems 
of  order  1  can  be  found  in  [l, 2, 3, 5].  Some 
examples  of  asymptotic  for  nonhomogeneous 
systems  of  any  order  m  can  be  found  in  U4], 


*  -  In  IR(x)  for  m  >,  1 
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Abstract  This;paper presents  an  extension  to  the  use  of  generic 
algorithms  for  Recursive  Spatial-Decompositions  (RSD)  to  design  a 
hierarchical  substrud  sring.(IIS)  scheme  that  can  be  easily  coupled  to 
the  automatic  mesh  generator  and  can  be  embedded  in  a  self-adaptive 
meshing-analysis  procedure.  The  geometric  algorithms  for  RSD  gen¬ 
erate  nested-dissections  (analytical  substructures )  of  the  domain  that 
are-used  for  the  analysis  scheme  (IIS)  described- in  this  paper.  An 
evaluation  of  the  IIS  scheme  for  parallel  processing  is  discussed  with 
reference  to  the  results  of  implementation  of  the  scheme  on  a  vector- 
concurrent  machine. 

1  INTRODUCTION 

This  paper  describes  a  3-D  FEM  analysis  scheme  based  on  Re¬ 
cursive  Spatial  Decompositions  (RSD).  The  scheme  forms  an  integral 
part  of  an  automated  FEM  meshing-analysis  system  that  is  ideally 
suited  for  parallel- computing  [1).  Specifically,  spatial  decomposi¬ 
tions  are  used  to  (1)  transform  automatically  a  solid  model  into  a 
finite  element  mesh,  (2)  perform  incremental  analysis  via  hierarchical 
substructuring,  (3)  produce -hierarchical  data  structure  that  allows 
coupling  between  meshing  and  analysis,  and  (4)  perform  incremen¬ 
tal  self-adaptive  analysis.  The  parallelism  in  the  meshing  scheme 
has-been  earlier  described  in  [1],  In  this  paper  the  applicability  of 
the  hierarchical  substructuring  scheme  is  discussed  in  the  context 
ofparallcl  processing  environments.  A  brief  overview  of  RSD  based 
meshing  algorithm  that  forms  the  basis  of  the  substructuring  scheme 
is  given  in  the  following-section. 

2  AUTOMATIC  MESHING  SCHEME 

A  two-stage  automatic  meshing  procedure  is  used  for  automatic 
generation  of  the  finite-element  meshes.  -Fora  detailed  description 
see  Reference  ^].  In  Stage  1,  the  solid  to  be  meshed,  fi,  is  approxi¬ 
mated  by  a  collection  of  variably  sized  octants  through  the  recursive 
spatial  decomposition  of  the  original  geometric  domain.  Such  an  ap¬ 
proximation  is  conveniently  represented  by  a  logical  tree  structure 
ivlioscnodc  have  eight-sons,  popularly  known  as  “octree”.  Stage  2  of 
the  meshing  algorithm  transforms  the  RSD  into  a  valid  FEM  mesh, 
through-further  processing  of  the  individual  octants. 


This  process  continues  until  the  root  node  of  the  tree  is  reached. 
The  mathematical  formulation  of  this  stage  can  be  described  as  fol¬ 
lows:  Let  6  and  i  denote  respectively  the  nodes  on  the  boundary  and 
the  interior  of  the  substructure.  The  equilibrium  equations  for  the 
substructure  can  be  partitioned  as 


Each  nodo  of  thc-octrcc  represents- an  informationally  complete 
subdomain  a >;  and,  in  terms  of  the  finite  clement  model,  a  substruc¬ 
ture.  Thus,  for  the  purpose  of  analysis,  the  octree  can  be  regarded  as 
a  cataloging. structure  with- geometrical  and  analytical  information 
directly  mapped  on  to  it  -  see  Figure  1  for  a  2-D  example.  Such  a 
substructuring  scheme,  whereby  ali  the  substructures  arc  hierarchi¬ 
cally,  organized  and  a.o  derived  through  the  recursive  spatial  decom¬ 
position  (RSD)  of  the  original  domain,  is  referred  to  as  hierarchical 
substructuring.  Note  that  the  analytical  substructures  produced  by 
the  RSD  are  equivalent  to  the  nested  dissections  described  in  (3). 

3  HIERARCHICAL  SUBSTRUCTURING 
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where  X  is  the  displacement  vector,  R  is  the  load  vector,  Kjj  arc 
the  stiffness  coefficients  related  to  the  interior  nodes  alone,  Kbb 
the  coefficients  for  the  nodes  on  the  boundary  and  Kjb  the  cross¬ 
coupling  terms  linking  boundary  nodes  to  the  nodes  in  the  interior. 
By  eliminating  the  interior  degrees  of  freedom  a  new  system  of  linear 
equations  is  obtained: 

KrbbXb  =  Rb  (2) 


There  are  three  distinct  stages  in  Hierarchical  Substructuring. 

In  the  first  stage,  stiffness  matrices  arc  formulated  for  the  low¬ 
est  level  nodes  of  the  octree  which  consist  of  assemblies  of  linear 
isoparametric  elements.  The  stiffness  matrix  formulation  is  based  on 
the  degeneration  of  the  eight-noded  isoparametric  brick  clement. 

Second  stage  is  the  assembly  stage  of  analysis.  Starting  from 
the-bottom  of  the  tree,  the  stiffness  matrices  of  the  offspring  of  the 
same  parent  cell  are  assembled  into  a  substructure  and  the  interior 
degrees  of  freedom  arc  eliminated  by  static  condensation.  Once  all 
the  substructures  at  a  given  level  are  assembled  and  condensed,  the 
procedure  begins  to  operate  on  the  tree  level  immediately  above. 


where  Kf|b(=  Kbb  —  K^K^IC;,,)  and  It*  (=  Rb  -  K^K^R;) 
arc  the  reduced  stiff-ess  matrix  and  the  reduced  load  vectors,  respec¬ 
tively. 

The  third  stage  involves  root  level  solution  and  recovery  of  dis¬ 
placements  and  stresses.  The  reduced  system  of  equations,  obtained 
at  the  end  of  assembly  stage,  is  solved  for  the  unkown  boundary  dis¬ 
placements,  Kbb.  Once  the  root  level  displacements  Xb  are  known 
the  interior  nodes  arc  computed  by  solving  'he  system 

K;;X;  =  Ri  -  KibXb.  (3) 

Itecali  that  Kjj  has  already  been  reduced  to  a  upper  triangular  matiia 
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during  assembly  stage.  Thus  X;  can  be  derived  directly  through 
backward  substitution  inequation  3.  Finally,  the-displacemcnts  at 
the  element  level  arc  used  to  compute  the  stresses  in  the  solid. 

a  =  DB54  ,  (4) 

whereD  is  the  material  property  matrix,  B  is  the  strain-displacement 
matrix  and  d4  is  the  elemental  displacement  vector. 

4  PARALLEL  IMPLEMENTATION 

Tour  domains  were  meshed  using  the  octree-based  mesh  generator 
described  in  Section  2,  and  analyzed  via  hierarchical  substructuring. 
Figure  2  shows  the  meshes  used,  the  applied  constraints  and  loads, 
as  well  as  the  deformed  shape. 


Figure  2:  Analysis  via  hierarchical  substrucluring  -  original 
meshes  and  deformed  shapes  for  -  (a)  block,  (b)  housing,  (c) 
cyLcylJnt,  and  (d)  bracket. 


To  study  parallelism,  it  is  convenient  to  identify  three  stages  of 
varying  computational  complexity  as  follows:  I)  substructures  as¬ 
sembly  and  condensation  except  the  root  level  (this  includes  compu¬ 
tation  of  element  stiffness  and  condensation  of  all  the  substructures 
up  to  level  1  in  the  octree);  2)  solution  of  the  final  root  level  sub¬ 
structure;  and  3)  recovery  of  interior  d.o.f.’s.  Stages  1)  and  2)  arc 
the  dominant  factors  in  terms  of  solution  time  and,  therefore,  only 
these  two  stages  are  considered  for  parallel  processing.  Stage  2  of 
processing  consists  of  assembling  the  eight  level- 1  substructures  and 
then  solving  the  final  root-level  substructure.  As  such,  stage  2  must 
be  performed  on  a  single  processor.  Ifowcvcr,  since  it  requires  the 
reduction  of  alarge,  nearly  fully  populated  matrix,  stage  2  can  take 
full  advantage  of  vcctorization. 

In  order  to  minimize  the  computational  overheads  associated 
with  parallel  processing  (processor  idle  time)  the  following  strategy 
was  used  for  mapping  the  computational  load  to  various  processors 

1.  Start  at  the  lowest  level  of  the  octree  and  visit  all  ihe  sub 
structures  at  this  level. 

2.  Identify  the  first  non-empty  substructure  S-  that  can  be  as¬ 
sembled,  i.c.,  all  its  sons  arc  already  assembled.  (Hereafter,  an 
asterisk  denotes  a  substructure  whose  eight  sons  arc  already  3 
assembled.)  Assign  5j  to  the  first  available  processor  Pi.  The 


next  non-empty  substructure  S’  is  assigned  to  the  second  avail¬ 
able  processor  P2  and  so  on.  Once  all  the  eight  sibling  of  an 
octree  node  arc  computed,  the  substructure  corresponding  to 
the  parent  node  is  marked  as  available  for  assembly. 

3.  The  process  continues  until  all  the  first  level  substructures  are 
computed. 

Table  1  shows  the  speed-ups  and  efficiencies  for  the  example  prob¬ 
lems.  p,  i),  Ts  and  Tp  are  the  speed-up  factor,  efficiency,  serial,  and 
parallel  time,  respectively.  All  the  times  are  reported  for  implemen¬ 
tation  on  Alliant  FX/8  machine  configured  for  8  processors.  A p  is  the 
percent  increase  in  the  efficiency  achieved  by  using  the  balanced  pro¬ 
cessor  load  scheme,  described  above,  in  contrast  to  a  scheme  whereby 
eight  level-1  substructures  are  assigned  to  separate  processors.  No¬ 
tice  that  the  increase  in  efficiency  is  marginal  for  the  bracket  problem. 
This  can  be  ascribed  to  the  fact  that  for  this  particular  problem,  con¬ 
densation  of  one  substructure  dominates  the  whole  execution  cycle. 
Therefore,  the  processing  time  is  only  marginally  influenced  by  the 
way  the  other  substructures  arc  assigned  to  different  processors. 


ESS SHI 

Ts  (sec) 

Tp  (sec) 

P 

v  (%) 

A p  (%) 

mmm 

9.19 

1.222 

7.52 

ismi 

41.0 

Housing 

23.30 

6.154 

ESDI 

47.4 

45.0 

Cyl-cyl  Jnt 

12.74 

1.727 

BH 

92.3 

85.0 

Bracket 

85.G7 

30.853 

34.8 

30.0 

Table  1:  Speed-up  and  efficiency  for  balanced  load  scheme 


Problem 

T,cahr  (SCC) 

T vector  (SCC) 

P 

Block 

12.123 

5.613 

E2H 

Housing 

13.475 

Esa 

CyLcylJnt 

3.560 

1.650 

SE3 

Bracket 

270.064 

46.565 

ESI 

Table  2:  Speed-ups  due  to  vcctorization  of  root  level  solution 
on  the  ALLIANT  FX/8 

Table  2-reports  the  speed-ups  produced  by-exploiting  vectoriza- 
tion  for  solving  the  root  level  substructure.  Notice  that  the  efficiency 
of  vcctorization  increases  with  the  length  of  the  associated  vectors 
(i.c.  the  size  of  the  stiffness  matrix),  as  illustrated  by  the  speed  ups 
for  housing  and  bracket  problem. 

5  SUMMARY 

This  paper  has  presented  a  view  that  emphasizes  on  the  use  of 
RSD  for  3-D  Hierarchical  Substructuring  (HS)  scheme  that  can  be  in¬ 
corporated  in  a  parallel  FEM  analysis  system  consisting  of  automatic 
meshing,  analysis  via  IIS,  and  sclf-adpative  incremental  re-meshing 
and  re-analysis.  The  octree  structure  provides  a  light  coupling  be¬ 
tween  geometrical  and  analytical-data,  thus  allowing  for  an  efficient 
integrated  meshing-analysis  procedure  (lj.  In  conclusion,  the  recur¬ 
sive  formulation  of  the  algorithms  makes  the  scheme  ideally  suited 
for  parallel  processing. 
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ABSTRACT 

In  this  paper,  we  try  to  solve  clique  finding  problem,  one  of  the  most 
famous  NP-Complele  Problems,  m  parallel.  We  propose  a  new  sequen¬ 
tial  clique  finding  algorithm,  the  empirical  and  theoretical  performances 
of  the  algorithm  arc  further  analyzed.  The  empirical  results  show  that 
the  average  time  complexity  is  about  Jt  •  e0,M8n,  which  grows  in  an  ex¬ 
ponential  order.  However,  this  algorithm  can  be  easily  parallelized  if  an 
MIMD  shared-memory  machine  is  used,  and  then  a  parallel  clique  find¬ 
ing  algorithm  is  obtained.  Therefore,  the  time  complexity  of  our  parallel 
algorithm  is  about  k  ■  c°  113rI/n. 

1  Clique  Finding  Problem  and  Algorithm 

The  clique  finding  problem  is  defined  as  follows. 

Definition.  Given  a  graph  G  =  (V,E),  the  clique  finding  prob¬ 
lem  is  to  find  every  subset  V'  C  V  ,  such  that  every  two  vertices 
in  vertices  K'  arc  joined  by  an  edge  in  B  [3]. 

Clique  finding  problem  is  one  of  the  most  famous  HP- Complete  prob¬ 
lems  Generally  speaking,  exponential  time  is  needed  for  it,  however,  there 
arc  some  special  cases  which  can  be  solved  in  polynomial  [2]  [4]  [5]  (6]  [7]. 

Next,  we  define  some  notations  and  terminologies  used  in  this  paper. 
Degree  of  a  vertex  v  is  d(u);./l(u)  is  the  adjacent  vertices  of  vertex  ti 
whereas  AE(v)  is  the  adjacent  edges  of  vertex  o.  Clique  k(G)  is  a  set 
of  vertices  which  arc  mutually  connected  in  the  graph  G,  K(G)  is  a  set 
of  cliques  in  the  graph  G  and  all  of  the  cliques  in  G  constitute  of  a  set 
called  Kau(G)  kv(G).is  a  clique  which  v  6  k0(G)  ;  likewise,  /f„(G)  is  the 
set  of  cliques  that  all  cliques  in  this  set  include  vertex  v.  The  output  of 
our  algorithm  is  composed  of  two  parts,  essential  part  and  optional  part. 
Every  vertex  in  the  essential  part  is  a  clique  and  each  combination  of  the 
optional  part  forms  a  clique  with  essential  part. 

If  we  give  every  vertex  t  in  graph  G  a  label,  then  A(t>)  is  the  integer 
value  label  of  the  vertex  t.  CJ(I",£*)  is  said  to  be  a  resin  Jed  induced 
subgraph  with  respect  to  vertex  a  In  graph  G  iff  G*(l",  G*)  is  an  induced 
subgraph  of  G  and  (1)  V*  =  vUA(v)  -  {i/|u'  €  A[v)  and  A(v')  <  A(u)}. 
(2)  E*  -  {(u,u;)|u,ui€  V'  and  (u,u>)  6  E). 

Now  the  notion  of  our  algorithm  is  stated  as  below  . 

Given  a  graph  G,  let  k(G)  =  {iq.fj :,■■■, vra}  be  a  clique  of  G  ,  1  < 
m  <  n  where  n  is  the  number  of  vertices  in  G-  It  is  trivial  that  in  graph  G, 
fer  any  arbitrary  clique  k,  cither  t  6  k  or  t  £  k  Tins  idea  can  be  extended 
to  a  set  of  Cliques,  that  is,  for  a  vertex  t,  wc  have  Km  —  /v»  (J  Kv,  where 

=  {Jt|u  6  k)  and  K-  =  {Xju  <?.k). 

Second,  if  a  vertex  u  is  connected  to  all  vertices  in  graph  G,  then  the 
cliques  /f„(G)  may  be  cither  {v}  or  {ijfc  =  k-  U  {v},ke  G  k(G')),  where 
C  is  derived  from  G  by  removing  e  and  its  adjacent  edges.  So  wc  have 
the  following  lemma. 

Lemma  1  .  If  v  is  a  vertex  which  connects  to  nil  vertices  in 
graph  G(V,E),  then  A,(G)  =  {{«},{*!*  =cu  {u),c  £  k(G‘)}}  where 
G'  =  (V-v,E-AE(v)). 

From  Lemma  1,  if  v  connects  to  all  vertices  ,n  Gj  then  AtqGjj  must 
be  cither  {i>}  or  {v}  U  A'(C;( V*  -v,E*~  A£(t>))). 

If  the  vertices  of  the  graph  G  arc  labelled  with  positive  integers,  then 
wc  have  the  following  lemma. 

Lemma  2  .  Vii  £  Jt„u  /  i  if  A(s)  <  A(uj  then  k,  C  V"  where  l" 
is  the  vertices  of  Gj. 

Proof  :  Suppose  the  lemma  is  false.  Ihat  is,  k,  £  V".  Then  there 
must  exist  at  least  one  vertex  w  6  kt,{v,w)  6  b  and  io  <2  V'*,  such  that 
either  A(m)  >  A(u)  or  A(ui)  <  A(u).  For  the  former,  it  contradicts  the 
definition  of  Gj  because  that  if  a  vertex  w  £  v,(v,w)  £  E  and  A(io)  > 
A(ti),  then  i»  must  be  a  vertex  of  G',  that  is  k,  C  V",  For  the  latter,  it 
contradicts  the  prerequisite  of  the  lemma  since  Ajuj  is  the  smallest  number 
among  all  vertices  in  kr.  Thus  w  can  notexist  in  kt-  ® 

According  to  lemmas  1  and  2,  we  have  Theorem  1. 

Theorem  1  .  A‘(G)  ~  (J  AV(G'), 
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Proof:  Assume  K(G)  =  U  Kv(Gl)+IV ,  and  assume  for  k1  £  IV,  k‘  = 
{ui,  U2,  •  -  •,  u„)  and  ui  is  with  the  smallest  label  among  A(u,).  According 
to  Lemma  2,  we  have  k‘  £  G*t ,  contradicting  to  our  assumption.  U 

This  theorem,  in  other  words,  means  that  the  cliques  in  graph  G  can 
be  found  by  discovering  all  the  cliques  in  the  restricted  induced  subgraphs 
of  every  vertex  in  graph  G. 

Next  step,  a  parallel  clique  finding  algorithm  based  on  MIMD  shared- 
memory  machine  with  n  processors  is  demonstrated. 

For  an  n  vertices  graph,  initially  the  processor  PE,  of  the  MIMD 
shared-memory  machine  holds  a  vertex  vj  with  A(uj)  =  i,  and  grasps 
its  restricted  induced  subgraph  G$)  independently.  The  K(G£f)  can  be 
obtained  by  unifying  {uj}  and  the  cliques  in  G‘(V*  -  Vj,E*  -  AE(vj))  . 
So  in  the  first  step,  we  add  vt  to  a  clique  list.  The  clique  list  is  a  list  whose 
elements  arc  the  members  of  a  clique.  Besides,  it  constructs  the  essential 
part  of  clique. 

Next  let’s  take  a  look  at  G'(V*  -  Vj,E*  -  AE(v,)).  If  this  subgraph 
is  a  clique,  then  any  combination  of  this  subgraph  (optional  part)  can 
form  a  clique with  the  clique  list.  The  exploration  docs  not  need  further 
extend  and  the  entire  procedure  can  be  terminated  If  the  subgraph  is  not  a 
clique,  the  processor  PE,  first  picks  up  a  vertex,  say  vt,  compute  GJt(V*— 
vt,EP  -  AE(vt)),  push  G"(K*  -  v,  -  vt,E*  -  AE(v,)  -  AE(u*))  into 
memory  pool,  and  exploit  the  algorithm  recursively  to  find  the  solutions. 

If  a  processor  PE,  finishes  the  job, The  subgraph  pushed  into  the  mem¬ 
ory  pool  previously  can  be  dispatched  to  the  free  processor  PEi  and  repeats 
entire,  process. 

The  output  of  our  algorithm  contains  two  parts  -  an  essential  and  an 
optional  part.  For  the  essential  part,  it  is  easy  and  straightforward,  just 
output  it.  However,  for  the  optional  part,  if  wc  need  to  know  every  clique 
in  the  graph,  we  may  adopt  any  arbitrary  parallel  combination  generating 
algorithm  on  it  and  combine  the  output  of  the  combination  generating 
algorithm  together  with  essential  part[l]. 

In  the  previous  paragraph,  wc  have  not  pointed  out  the  labeling  method¬ 
ology  used  in  our  algorithm,  but  sometimes  the  labeling  scheme  may  dra¬ 
matically  afTcct  the  load  of  the  processor  and  the  performance  of  the  algo¬ 
rithm. 

Thus  wc  proposed  the  following  labeling  scheme.  Label  every  vertex  v 
according  to  its  degree  d(u)  in  ascending  order,  the  smaller  the  degree  of 
a  vertex  is,  the  smaller  it  labels. 

By  applying  out  algorithm  and  labeling  scheme,  wc  prune  the  smaller 
'liques  of  the  graph  and  left  the  largest  clique  not  processed.  This  concept 
is  based  on  the  “Largest  clique  is  the  most  time  consuming  pnrt  in 
tlic  graph  in  computation”. 

2  Time  Complexity  Analysis  of  the  Clique 
Finding  Algorithm 

In  the  following  section,  we  try  to  analyze  the  time  complexity  of  the 
parallel  clique  finding  algorithm.  Note  that  under  the  MIMD  model  when 
any  processor  is  free,  wc  assume  it  gets  a  job  and  no  communication  exists 
between  any  two  sublasks.  So  vve  may  suppose  the  speedup  of  the  parallel 
algorithm-  is  n  relative  to  its  sequential  version.  Therefore  ,  if  the  time 

mplex.'.y  of  sequential  algorithm  be  denoted  as  E„(p)  then  the  lime 
complexity  of  parallel  algorithm  is  certainly  E„{p)/n  for  an  n  processors 
machine. 

The  judgment  criteria  of  the  algorithm  here  wc  define  is  the  number  of 
cliques  output.  Therefore,  according  to  our  algorithm  for  random  labeling 
scheme,  first  step  a  vertex  -V  is  picked  cut  for  computation  of  the  restricted 
induced  subgraph.  Suppose  the  degree  of  the  picked  vertex  X  is  x.  Then 
(he  probability  of  the  restricted  induced  subgraph 

Gx-is  )p*(! 

For  the  rcstt tvlcd  induced  subgraphs  Gj£ ,  a  clique  is  output  and  then 
the  vertex  X  is  deleted  from  it  The  rest  restricted  induced  subgraphs  will 
be  recursively  exploited  by  the  algorithm,  so  the  time  steps  required  for 
this  algorithm  is  £*(p)  for  the  rest  restricted  induced  subgraph;  therefore 
the  time  complexity  for  G*  part  is 

( "zl  )p,(1-pr-,-re*(p)+| 

where  1  is  the  time  used  for  the  essential  part- 
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Note  that  x  may  vary  from  0  to  n  — 1,  so  the  time  complexity  for  n 
from  0  to  n  —  1  is 

£"=o  (  "I1  )pr(1“ P)n-1-CEAP)  +  1 

After  computing  <?j£  part,  the  graph  G'(V  —  X,E —AE(X))  obviously 
contains  n  —  1  vertices,  so  the  time  needed  is  E„- i(p).  Therefore  the  total 
time  complexity  is 

£„(p) = eej-(  " 1 )  -  p)n-y-z  -£r(P)+ 1 + e„-ap) 

And  solve  the  above  equation,  we  may  get 

E^[p)  =  n  +  Ei=o(M*  +  1)irim=i(1  +  !?f>('n))](n  “  (*  +  !)))+ 

From  semi-log  chart  (sec  Fig.  1),  weknow  that  En  ~  ke 


3  Simulation  Results 

Since  the  performance  analysis  of  our  algorithm  with  sorted  degree  labeling 
strategy  is  quite  hard,  therefore  a  set  of  simulation  is  held  in  the  last 

section.  „ 

In  the  simulation,  first,  for  every  probability  p  and  number  of  vertices 
n  ,  the  experiment  iterates  129  times.  The  range  of  n  is  from  1  to  2o 
stcp.2  whereas  p  ranges  from  0.00  to  1-00.  Graph  representation  for  the 
simulation  results  is  shown  in  Fig.  2.  Semi-log  graph  for  Fig-  2  is  listed  in 

^After  carefully  examining  the  figure,  the  curve  seems  to  be  a  straight 
line  when  n  >  5,  so  the  technique  of  linear  regression  is  used  to  approxi¬ 
mate  this  curve.  Approximate  line  is  also  shown  in  Fig.  3.  Undoubtedly 
,  fitted  curve  is  very  proximate  to  the  original  curve.  So  the  average  time 
used-in  the  our  algorithm  is  about  log(  En)  sr  0.148  ♦  n  -F  c  where  En  is 

average  time  used  for  our  algorithm,  n  is  the  number  of  vertices,  c  is  a 
constant  and  0.148  is  the  slope  of  the  straight  line. 

Expanding  the  formula,  we  get  E„~  k-  e0M3n. 


4  Discussions 

Maximum  Clique  Problem  is  to  find  a  clique  k  where  |t|  >  |k'|,  k'  6 
Kail-  This  problem  is  an  NP-Complelc  problem. 

A  slight  modification  on  our  algorithm  will  be  more  efficient  for  the 
maximum  clique  problem.  For  sequential  algorithm,  first,  we  generate  all 
restricted  induced  subgraph  for  the  graph.  Say,  ,G*(nj  if 

there  arc  n  vertices  in  the  graph;  since  maximum  clique  is  the  clique  with 
greatest  number  of  vertices  in  the  graph,  next  step  compulation  starts 
with  G*(z j  where  the  number  of  vertices  of  is  the  largest  among 
<?/(,,,  G’py  •  •  ■ , the  above  procedure  will  be  repeatedly  executed 
until  the  maximum  clique  is  found.  During  the  procedure  wc  shall  keep 
track  of  the  size  of  vertices  in  the  restricted  induced  subgraph  generated 
Once  found  the  size  of  restricted  induced  subgraph  generated  is  smaller 
than  any  other  restricted  induced  subgraph  Gq,  then  the  procedure  jumps 
to  process  Gq.  This  algorithm  is  somewhat  similar  to  the  breadth  first 
search. 

For  parallel  algorithm,  wc  should  keep  a  location  for  maintaining  the 
current  maximum  clique  size  |I|,  and  every  processor  gets  a  restricted 
induced  subgraph  with  the  same  number  |fc|  of  vertices  and  then  repeat 
the  sequential  algorithm. 


ro*(S.c)  Number  of  Vertlcas  vs.  Time 


Figure  2:  Number  of  vertices  vs.  average  time 


bsPmlinsM.  Semllog  Curve  and  Regression  Curve 


Figure  3-  Semilog  Chart  vs.  Linear  Regression  Approximation 
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Abstract. 

An  interpolation  polynomials  older  .V  is  constructed  from  p  inde¬ 
pendent  subpolynomials  of  order  n  -  N/p  Each  such  subpolynomial  is 
found  independently  and  in  parallel.  Moreover,  cvaliuation  of  tire  poly¬ 
nomial  at  any  given  point  is  done  independently  and  in  parallel,  except 
for  a  fmal-step  of  summation  of  p  elements.  Ilcncc,  the  algorithm  has 
almost  no  communication  overhead  and  can  be  implemented  easily  on 
any  parallel  computer.  We  give  examples  of  finile-difTcrcncc  interpola¬ 
tion,  trigonometric  interpolation,  Chcbyshev  interpolation,  and  conclude 
with  the  general  Hermitc  interpolation  problem. 

1.  Introduction.  In  this  paper  wc  study  the  problem  of 
polynomialand  trigonometric  interpolation  on  large  parallel 
MIMD  computers.  There  are  wclbknown  sequential  methods 
for  both  problems.  However,  these  methods  arc  not  easily 
adaptable  to  parallel  systems,  and  especially  to  loosely  con¬ 
nected  systems  such  as  rings,  stars,  because  of  the  overhead 
due  to  interprocessor  communication,  see  for  example(2. 3,  5] 

In  this  work  we  present  new  algorithms  for  polynomial 
and  trigonometric  interpolation  that  require  almost  no  com¬ 
munication  between  the  processors.  Given  an  interpolation 
problem  of  order  N  —  np,  p  being  the  number  of  processors, 
we .  .  jaividc  it-into  p  smaller  interpolation  problems  of  order 
tt.  T  se  problems  are  solved  independently  and  in  parallel 
using  cii  appropriate  sequential  method.  The  value  of  the 
interpolation-polynomial  is  then  a  combination  of  the  corre¬ 
sponding  subvalucs. 

2.  The  interpolation  polynomial.  Let  f\x)  be  a  func¬ 

tion  defined  on  (a,  6],  whose  values  on  the  set  of  N  -t-  i  dis¬ 
tinct  points  X  =  {zo, *i,...,xlV},  is  given  by  f,  =  - 

0,1,...,  AT.  We  are  interested  in  constructing  a  representation 
of  the  polynomial  P[x)  of  degree  at  most  N  that  interpolates 
f(x)  on  X  and  is  most  suitable  for  parallel  computation.  Let 
{if, ,  Xi,  •  •  - ,  Xp}  be  a  partition  of  X, 

X  =  U,X„  and  X,  n  Xj  =  i  -f-  /- 

The  following  theorem  indicates  how  P(x)  can  be  constructed 
independently  and  in  parallel  by  p  processors,  each  solving  a 
smaller  interpolation  problem  on  one  of  the  subsets  Xj. 

Theorem  2.1.  Fort  =  define 

wiJ  —  nw*r  “ **)>  xjGXtt 

and  let  <?,  (z)  be  the  polynomial  of  degree  at  most  \X,\  -  1  that 
satisfies  the  following  interpolation  conditions: 

Qi(Xj)  =  w.jfj,  x;€A',.  (1) 


ity.  We,  therefore,  look  for  a  generalization  of  the  bary  centric 
representation  that  is  appropriate  for  the  formula  given  in  (2). 

Theorem  2.2.  Let  Q,(x)  be  as  m  Theorem  (2.1),  and 
let  R,(x),i  =  l,...,p,  be  the  polynomial  of  degree  at  most 
|Xi|  —  1  that  satisfies  the  interpolation  conditions 

R;(xj)  =  Wjj,  xj  e  X;.  (3) 

Then  P(x)  can  be  express .1  tn  the  form 

.  EL,  Q.(*)/nr,6A.(*  -  *■)  _  EL,  &(*)  m 
(S)  _  E?=i  *(x)/IWi(*  -  *.)  ~  EL,  *(*)' 

Proof.  See[l).  D 

Given  p  processors,  wc  assign  processor  i  =■  1,. . .  ,p,  to  com¬ 
puting  the  corresponding  terms  <f>i(x)  and  Vit.x)-  The  com¬ 
putation  of  the  w,j  takes  0(n;[N  -  n,-)j  additions  and  mul¬ 
tiplications  in  the  worst  case,  where  ft;  =  |X;|.  However, 
as  will  be  seen  in  the  following  sections,  in  many  cases  of 
interest  these  values  can  be  computed  analytically  in  much 
fewer  operations.  Assuming  that  the  Wjj  are  known,  and  that 
n,  ~  n  ~  N/p, i  -  I each  processor  is  faced  with  an 
interpolation  problem  of  order  n  that  can  be  solved  in  paral¬ 
lel  with  no  need  of  intcrprocessor  communication.  Once  the 
interpolation  polynomial  is  known,  its  value  at  points  not  in 
the  set  are  given  by  summing  and  dividing  tire  corresponding 
subvalucs  in  (4). 

In  Sections  3,1,3  wc  consider  the  problems  of  finite  differ¬ 
ence  interpolation,  trigonometric  interpolation,  and  Cheby- 
shev  interpolation.  For  ease  of  representation  we  will  use 
a  slightly  different  notation  as  follows:  We  assume  that  the 
function  /(z)  is  given  at  N  =  np  distinct  points  and  that 
each  of  the  p  subsets  Xj,  which  arc  now  numbered  by  i  = 
0, . . . ,  p  —  1 ,  contains  exactly  n  points.  We  denote  the  points 
in  the  subset  Xj  by  xy,  j  —  0,...,n—  1. 

3.  Finite  Difference  Interpolation.  Let  X  be  a  set  of 
equally  spaced  points  in  the  interval  [a,  6), 

x,  =  a  +  ih,  h  =  ~  for  i  =  0,l . N  —  1. 

Wc  assume  for  simplicity  that  N  =  np  and  p  is  the  number 
of  processors  available.  We  consider  here  two  partitions. 

In  the  first  partition  wc  assign  the  *th  group  of  n  consec¬ 
utive  points  to  the  ith  processor, 


Then  P[x),  the  interpolation  polynomial  on  X,  is  given  by 


Xj  —  {x,^  —  x,n+),  j  —  0,  ...,ft— l}, 


F(*)  =  £Qi(x)IW,(x-x*).  (2) 

ul 


Proof.  See  [l].  □ 

It  is  known[-l,  6, 7j  that  the  barycenlric  representation  for  La¬ 
grange  interpolation  enjoys  alarge  d<  ,rcc  of  numerical  stabil- 


for  i  =  0 . .  —  1-  Hence, 


w 


-i 

■j 


m-1 

JJ  fcm+j  xk) 


*V-1 

II 


«-«'■( ‘j1  )/(£;})■ 
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where  Ci  =  (~hyJ~n(N  —  l)!/(n  —  1)!  is  independent  of  i 
and  j.  We  notelhat  if  the  sameconstanl  C  multiplies  all 
the  Wij.  it  follo-.vs  from  (1),(3)  that  the  subpolynomials  Q,(z) 
and  R,(x)  arc  also  multiplied  by  the  same  constant  C  but  the 
interpolation  polynomial  Pn(x)  remains  invariant  by  (4).  In 
view  of  t.iis.  eacltprocessor  has  to  computc-the  vuircspuiiding 
polynomials  Qi(x)  and  i?,(z)  that  satisfy  the  interpolation 
conditions 


for  j  =  0, ...  ,n  —1,  and  this  computation  can  be  carried  out 
using  any  finite  dilFerencc  formuia. 

In  the  second  partition  the  subsets  X-,  are  formed  accord¬ 
ing  to 

Xi  —  {xjj  =  xn-jpt  j  —  0, —  ,n  — l}, 

for  i  =  0,1,...  ,p  —  1.  Consequently, 

w-i  =  .njj^  -  »*)  n£-Afrn(«w,  -  =>) 
ri/=o(*<'+j>  _  ■ci+‘>)  rif=i+i(?-i+» — 

where  Cj  =  Ci/p"""1  is  independent  of  i  and  j.  Each  proces¬ 
sor  has  to  compute  the  corresponding  polynomials  <?,(x)  and 
Ri(x)  that  satisfy  the  interpolation  conditions 

ftM  =  “7 i), 

«<"-•)  -  (-i)w(f+-j‘)/(nji). 

for  j  =  0,...,n  —  1.  As  before,  this  computation  can  be 
carried  out  using  any  finite  difference  formula. 

We  have  the  following  operation  count  for  constructing 
and  evaluating  the  polynomial,  when  p  N: 


sequential 

parallel  | 

Construction 

(rV  -  I)iV/2 

(n-l)n  | 

Evaluation 

N 

2(n  +  p)  | 

We  obtain  aspeed  up  of  order  p3/’i  iri  the  construction  stage, 
and  a  speed-up  of  order  p/2  in  the  evaluation  stage  as  com¬ 
pared  to  the  ordinary  sequential  finite  difference  methods. 

4.  Trigonometric  interpolation.  Let  be  equally 
spaced  pointsin  [0, 2-j  given  by 

=  j  =0,J,...,jV-  1, 

and  let  f(8)  be  a  function  defined  on  [0,2sr]  whose  values 

f}  =  f(9j),j  =0,1 . N  —  I.  are  given.  Furthermore,  let 

jV  =  2 M.  Then  there  exists  a  unique  balanced  trigonometric 
polynomial  T[6)  of  degree  M, 

1  i  I 

T(6)  -  -oq  -f-  (otcosM  -|-  fjriri  k8j  +  -asimsMQ  (5) 

-  fcsl 

interpolating  f(6)  at  the  points  6},j  =  0,1,..., H  -  l.seejl], 
A  complex  interpretation  of  T{0)  in  terms  of  the  variable 


z  —  elS  yicldsthc  balanced  complex  trigonometric  polyno¬ 
mial  P(z)  =  T(8)  of  degree  M, 

p(z)  =  +  £  ckzk  -f 

with  c_-,f  =  cm,  whose  coelhuents  c*  are  related  to  the  ak 
and  bk  in  (5)  through 


at=c*  +  c_t,  bk—  i  (c*  —  c_t),  k  =  0,l,...,Af. 
Of  course,  P(s)  satisfies  the  interpolation  conditions 

=  m)  =  f„  :j  =  --i.  -i  =  e 

for  j  —  0, 1 , . . . ,  Ar  —  1 ,  and  the  coefficients  cj, 


(6) 


c,  1  =  -M.-M  +  l,...,Af, 

Jr=0 

can  be  computed  in  0{NlorN)  operations  using  the  FFT.  In 
this  section  wc  introduce  a  new  representation  for  P(z)  that 
can  be  evaluated  in  parallel  using  the  FFT  on  smaller  sets  of 
points.  Let  N  —  np  with  n  =  2m,  and  consider  the  partition 

{Z0,Zu...,Zp.l)  ot  the  set  of  points  Z  =  {zq,zi . =.v_i}, 

where 

Zi  =  {z:r  =  =  zt-f,  r  =  0,l,.,.,n-I],  l  -  0,l,...,p-l 

Theorem  4.1.  Fori  =  o ,1,...,?- 1,  iti 

r  =-0, —  1, 

H'- 

and  lei  Qt(s)  be  the  balanced  complex  Irigonomtlnc  volyno- 
micl  of  degree  m  that  sdixfixs  Ihc  interpolation conditions 

Qtisp)  "  /i-frj T  3 s  0,1,...  ,n  —  1, 

on  i/ie  suf/set  of  points  Zj.  77/ ui  /'(=!,  the  halsnetd  trigono¬ 
metric  polynomial  th  at  salt* Jits  Ih  e  interpolation  condition*  in 
(6),  can  be  expressed  in '.hr.  form 

P(z)  m  z-^jrojziz.yTliz  -  zw) 

1=0  kr-l 

Proof.  Scell],  0 

As  before,  we  look  for  a  generalized  barvcentric  formula.  This 
touuuia  is  developed  in  tueorem  4.2  below. 

THEOREM  4.2.  Fnrl  =  0,i,...,p  -  1.  kl  Q;(s).  be  the 
balanced  complex  trigonometric  peA'jnom-.d  of  degree  m  that 
satisfies  the  interpolation  condition * 


&u:i  = 


r  =  1, 


on  the  subset  of  points  Z„.  Then  the  balanced  trigonometric 
interpolation  polynomial  F'iz)  of  Theorem  (f.U  eon  be  ex¬ 
pressed  in  the  form 


PC  I  : 


ZrM-y)(:rQd:Iz:)!UzldF  -  i) 


tz here,  R{s )  assumes  the  simple  forms 


PJs) 
Proof  Scc'lJ.  0 


I 

ifi-5  -r  s--1 ) 


if  p  is  odd, 
ifp  is  teen. 
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Now  that  we  have  obtained  the  barycentric  form  of  P(z),  we 
can  obtain  that  of  T(#),.the  real  form  of  P(z),  very  easily  as 
follows: 

T(e)  =  EL~o(-l)^i(g-^)/sinm(g-g,) 
T.&(-l),V,(6-6l)/:smm(0-9l)' 

where  Ui{4>)  =  Qi(s), -with  s  =  e'^,  is- the  balanced  trigono¬ 
metric  polynomial  of  degree  m  that  satisfies  the  interpolation 
conditions 


Ut{6pr)  =  (-1  )T{p-l)fi+,P>  V  =  0,l,...,n  — 1, 
and  V{4>)  is  given  by 

[  CO 


v(4>) 


cos  mfi 


if:p:is  odd. 
if  p  is  even. 


We  have  the  following  operation  count  for  constructing 
and  evaluating  the  polynomial,  when  p  <  N 


sequential^ 

parallel 

Construction 

NlogN 

nlog  n 

Evaluation 

N 

n  +  2p 

evaluation  of  the  polynomial  as  compared  to  the  sequential 
FFT  algorithm. 


5,  Chebyshev  interpolation.  Let  x, ,  be  ./V-  Chebyshev 
points 

Pj.=  cos6h  6j  =  2L±J.7r)  j  =  0,l,...,jV-l, 

in  [—1,1]-  Let,  f(x)  be  a  function  defined  on  [—1,1]  whose 
values/,-  =  /(*/),  j  ~  0,1,. ..,  N  - 1,  are  given.  Let  N  =  np, 
and  consider  the  partition  X  =  {-X'o.-X'i,  -  -  - ,  where 

■Xi  =  {®i,r  =  si+rp,  r  =  0,l,...,n-l},  Z  =  0,l,...,p  —  1. 

We  define  a  new  partition,  Y  =  {r0,  Yu  ■ .  ■ ,  Y,- 1},  q  =  [(p  + 
1)/2J  by 

Yi  =  Xi  U X\>,  l  =  0,1, ...  ,q  —  .1,  Z'  =  p  —  1  —  Z. 


LEMMA  5.1.  For  l  —  0,1 . 9  —  1,  define 

wi,r  —  II  (xi,t  —  xk,l)t  r  =  0,1,...,»  — 1, 

*5*1,1' 

and  letQfix)  be  the  polynomial  of  degree  \Yi\  -  1  that  satisfies 
the  interpolation  conditions 

Qli^ktr)  —  fk^rp^k.n  k  =  Z,  Z  ,  T  —  0, 1, . . .  ,71  — 1, 

on  thesubset  of  pointsYi.  Then  P(x),  the  interpolation  poly¬ 
nomial  on  X,  can  be  expressed  in  the  form 

p(z)~  13  Qi(x)  n  (*  -  **,!)•  (7) 

1=0  kit,l’ 

Proof.  The  result  in  (7)  follows  from  Theorem  2.1.  0 


THEOREM  5.2.  Letp  be  even,  and forl  =  0,l,...,q  —  l, 
ZcZ:Qi(x),  be  the-polynomial  of  degree  2n—  1  that  satisfies  the 
interpolation  conditions 

Q  l(^*,r)  =  /*+rp>  k  =  l,l  ,  f  =  0,1,,..,  71  —  1. 

Then  P(x)  of  Lemma  5.1  can  be  expressed  in  the  form 

P{x)  =  EL~o(-l),sin2ng,QJ(a)/(r2n(x)  -  TM) 
E?To1(-l)'sin27i0i/(r2n(x)-r2n(x,))  ’ 

where  T2n(x)  is  the  Chebyshev  polynomial  of  the  first  kind. 
Proof.  See[l).  D 

Theorem  5.3.  Let  p  be  odd,  and  for  l  =  0,-1,. . .  ,9  —  2, 
let  Qi(x),  be  the  polynomial  of  degte  2n—  1  that  satisfies  the 
interpolation  conditions 

QiM  =  {  t  Jv  r  =  0*  1 . n~  1- 

Furthermore,  let  Qq.i(x),  be  the  polynomial  of  degree  n  —  1 
that  satisfies  the  interpolation  conditions 

Qq-i(x)  =  /5-1+rp,  r  =  0, 1, . . . ,  n  —  1. 

Then  P(x)  of  Lemma  5.1  can  be  expressed  in  the  form 

Y'q-l  Z-lV 8in2n0|(?i(=l  ,  (-l)l»~1Q,-i(r) 

PI  s.  _  ^>=0  r7„ 2i„(r)  .  . 

’  rpr-X  (— l)‘2sin  nflfTnfx)  ,  |-1)H  '  W 

^'= 0  T7n(z)-T2n[z,)  T*  2T„(X) 

Proof.  See[l].  D 

We  next  show  how  to  find  the  corresponding  polynomials 
Ql(x),l  =  0,1,..., 9  —  1  using  the  FFT  algorithm.  We  give 
explicit  formulas  for  the  case  where  p  is  odd.  The  case  where 
p  is  even  is  solved  similarly.  Let  <5(a:)  be  a  polynomial  of 
of  degree  m  —  1,  and  let  its  representation  in  terms  of  the 
Chebyshev  polynomials  of  order  less  than  m  be 

<?(*)  =4“o  +  X>iT*(x). 

*  *=1 

Rewriting  the  series  in  terms  of  x  =  cos  9,  z  =  e'°,  we  get 
the  corresponding  complex  Chebyshev  polynomial  of  degree 
m  —  1 


m— 1  | 

c(z)  =  ]C  c*  -  c-*  =  &  =  0, 1, . , . ,  m  -  1. 

*=-m+ 1  Z 

Let  Q(x)  staisfics  the  interpolation  conditions 

Q(xi)  =  9h  xj  =  cose},  =  j  =  0,1, 1. 

Then  C(z)  satisfies  the  interpolation  conditions 

C(vj)  =  Fix,)  =  gj,  V]  =  e'°>, 
and  vice  versa.  Hence,  Q(x)  can  be  obtained  from  C(z). 

THEOREM  5.4.  LctC(s)  be  the  balanced  complex  trigono¬ 
metric  polynomial  of  degree  n  that  satisfies  the  interpolation 
conditions 

<?(**)  =  |4-.+,p,  C(4+})  =  \u-wr 

forj  =  0,1, l,  where  j'  =  n-  1  -  j  and  zt  =  e,2*/2n. 


In  developing  the  barycentric  formula  we  distinguish  between 
the  cases  in  which  p  is  even  and  odd. 


Then  C(z),.the  complex  Chebyshev  polynomial  of  degree  n—1 
corresponding  to  Q,_i(x)  in  (8),  can  be  expressed  in  the  form 

C(z)  =  C(z/z\/2)  +  C(lf(zz\/2)) 

Proof.  See[l].  0 

THEOREM  5.5.  LetC(s)  be  the  balanced  complex  trigono¬ 
metric  polynomial  of  degree  n  that  satisfies  the  interpolation 
conditions 


Let  Qi(x)  be  the  polynomial  of  degree  at  most  n,  —  1,  n,  = 
J2zjeXi  k},  LhaL  satisfies  the  following  interpolation  conditions. 

—t'.qjj,  t  =  0,1 . *j-l. 

Then  P(x),-the  interpolation  polynomial  on  X,  is  given  by 

P{x)  =  E  -  xrfr  s  E  <?.(*)(.(=)• 

1=1  1=1 


C(4)  =  f^r>  C(z?i)  =  fl.+yP 

forj  =  0, 1, ...  ,n  — 1,  where  j1 =n  —  l—  j„  zi  =  e!2lr/2n  and 
l  <5—1.  Then  C(z),  the  complex  Chebyshev  polynomial  of 
degree  2n  —  l  corresponding  to  (—2is\n2n$iQi(x))  in  (8),  can 
be-expressed  in  the  form 

0(4  «-«4  r  -  (f  )-n)c(  «4-r  -  (^)-n)c(^-) 

V[t  Vf  Vi  zvi i  zvii  zvi 

Proof.  See[l).  □ 

Again  we  obtain  a  speed-up  of  order  p  both  for  the  construc¬ 
tion  and  evaluation  of  the  polynomial  when  N  ~  n(2p),p  -C 

N, 


sequential 

parallel 

^Construction 

NlogN 

2hlog[2n) 

^Evaluation 

N 

2(n  +  p) 

6.  The  general'Hermite  interpolation  problem.  Let 
M  +  1  distinct  points  X  =  {x0)*i,...,*a/}»  >n  the  interval 
[a,  6],  be  given  and  let  f(x)  be  a  function  defined  on  [a,  6],  for 
which 

f\  s-fW{»j),  t  =  0,1 . kj  -  1,  j  =  0, 1 . M. 

We  are  interested  in  constructing  a  representation  of  the  gen¬ 
eral  Hermite  interpolation  polynomial  P(x)  of  degree  at  most 
N,  N  P  \  —  E>=o^jj  that  interpolates  f(x)  on  X,  j.c., 

P(t)(xA=  /j,  t  =  0,l ,...,fc,-l,  j-—  0, 1, ... , M, 

and  is  most  suitable  for  parallel  computation. 

Let  {Xi,X2,...,Xp}  be  a  partition  of  X, 

X  =  UjAT,-,  X;  n  Xj  =  <I>  for  i  $  j. 

The  following  theorem  indicates  how  P(x)  can  be  constructed 
independently  and  m  parallel  by  p  processors,  each  solving  a 
smaller  general  Hermite  interpolation  problem  on -one  of  the 
subsets  X;. 


Proof.  See[l).  0 

Theorem  6.2.  The  general  Hermite  interpolation  poly¬ 
nomial  P(x)  of  Theorem  6.1  has  the  bary centric  form 

p,  v 

where  R{(x),  like  Q;(x),  is  a  polynomial  of  degree  at  most 
nt  —  1  that  satisfies  the  same  interpolation  conditions  with  f3 
replaced  by  1,  and  fj  by  0,  t  =  1, . . .  ,kj  —  1,  for  all  j. 

Proof.  As  in  Theorem  2.2.  0 

We  can  find  the  formulas  for  vfj,  s  =  0,1 . k3  —  1,  in 

0(  E  -  Xi\  +  k ])  <  0(»,-|*  -X,\+  nj) 

XjGXi 

operations,  and  the  formulas  for  the  0,1, ,  kJt  in 

0(  E  *j)  <  0(n?) 

xjdXi 

operations.  Let  n,-  ~  n  ~  N/p,i  =  1 . .  and  assume  that 

the  v‘j  are  known.  Each  processor  is  then  faced  with  a  general 
Hermite  interpolation  problem  of  order  n,  that  can  be  solved 
in  0(n 2)  operations. 

7.  Conclusion.  We  have  presented  a  new  interpolation 
polynomial  that  is  especially  useful  for  parallel  computers  as 
its  construction  and  evaluation  requires  almost  no  commu¬ 
nication  between  the  processors.  The  interpolation  problem 
is  divided  into  smaller  independent  subproblems  that  can  be 
solved  independently  using  any  known  sequential  interpola¬ 
tion  method.  Thus  we  have  reduced  the  problem  from  order 
N  to  order  n  ~  N/p.  Furthermore,  we  have  developed  a 
barycentric  formula  that  enjoys  a  high  degree  of  numerical 
stability  as  in  the  case  with  the  barycentric  formula  for  the 
ordinary  Lagrange  interpolation. 
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Abstract. 

Wc  present  a  new  divide  and  conquer  parallel  algorithm:  for  finding 
the  Cholesky  decomposition  of  a  band  symmetric  positive  definite  ma¬ 
trix.  This  is  the  first  time  such  an  algorithm  is  presented.  All  previously 
known  parallel  algorithms  for  this  problem  are  direct  implementations 
of  the  sequential  methods,  which  as  though,  offer  almost  no  speedup. 
Here,  for  the  first  time  a  parallel  oriented  algorithm  is  presented,  with 
an  approximate  speedup  of  order  p/3  given  p  processors.  Moreover,  the 
algorithm  can  be  implemented  on  many  existing  parallel  computers. 

We  further  discuss  the  more  theoretical  aspects  of  the  algorithm, 
and  show.that  it  can  be  implemented  in  0(log  m  log  n)  time  using  p  = 
(n/m)M(m)/{log  m  log  n)  processors.  Here,  M(m)  =  mff,2  <  j)  <  3, 
and  m^/log  m  denotes  the  least  number  of  processors  required  in  order 
to  multiply  two  matrices  of  order  m.in  Oilog  m)  time.  This  improves 
by  a  factor  of  log  m  the  best  previously  known  result  for  this  problem. 

We  conclude  with  an  application  of  the  algorithm  to  the  finding  of 
the  eigenvalues  of  a  non-singular  band  symmetric  matrix.  We  show  (or 
the  first  time  how  to  implement  each  iteration  of  the  QR  algorithm  in 
the  same  complexity  as  above. 

1.  Introduction.  In  this  paper  wc  study  the  problem 
of  finding  the  Cholesky  decomposition  of  a  band  symmetric 
positive  definitc(s.p.d.)  matrix  on  large  parallel  MIMD  com¬ 
puters.  Such  a  decomposition  is-important  in  many-numerical 
methods  for  solving  systems  of  linear  equations  and  for  com¬ 
puting  the  eigenvalues  and  eigenvectors  of  a  corresponding 
matrix. 

All  previously  known  parallel  algorithm  for  this  problem 
are  direct  implementations  of  the  sequential  methods,  see  for 
example  [4,  6,  7].  As  such,  they  suffer  from  the  inherent 
sequential  nature  of  these  methods  and  in  most  interesting 
cases,  where  the  bandwidth  is  small,  they  offer  almost  no 
speed-up. 

In  this  work  we  present  a  new  divide  and  conquer  paral¬ 
lel  algorithm  which  offers  an  approximate  p/3  speedup  over 
known  sequential  methods,  given  p  processors.  The  problem 
of  finding  the  Cholesky  decomposition  of  a  band  matrix  of 
order  ti,  is  reduced  to  the  of  finding  p  independent  decomposi¬ 
tions  of  small  band  matrices  of  order  n/p.  Each  such  problem 
is  then  solved  independently  and  in  parallel. 


2.  The  algorithm.  Let  A  be  a  band  s.p.d.  matrix  of 
order  n  =  qrn  and  bandwidth  m,  i.e., 


/A,  Li 

U\  M  L2 


\ 


Vq-1  A?_) 

U,-j 


\ 


A,  ) 


U„Ai,Li  €  Af(m), 

U;  =  L\  is 
upper  triangular. 

(1) 


We  assume  for  simplicity  that  q  =  Ip,  where  p  =  2k+>  is  the 

number  of  processors.  Let  A’,  s  =0,1 . k  denotes  a  block 

structuring 


(A\  L\  \ 

U[  A\  L\ 

UU  AJ_,  LU 

\  vi- 1  K 


v  =p/2’  s  =  0, 1 . k, 

Uf  ,Af,L‘  €  M (2*n/ p) , 

A-  band  s.p.d. 

(2) 


Here,  Af,i  =  l,...,u  denotes  the  ith  principal  submatrix  of 
order  2’n/p,  i.e.,  rows  and  columns  (i-l)25n/p+l, . .  .,i2’n/p, 
of  A  The  offdiagonal  block  elements  if,  U*  are  given  by 


if  = 


0 


Lav  0 


0i. 


-(*  o),  l;J  0  ),  (3) 


Luv 


a‘-[o  '':)  =  (»  «)■  w-(  o'),  <*> 

where  if,  Uf  6  M(2sn/p  x-m). 

Let  Ef,  F‘,  G f ,  Hf,  matrices  of  order  m,  be  given  by 

(  El\ 


AW  =  Li,  Xf  = 


/  Gf  \ 


s  =  0 . .  .k, 

’  i  =  1,3...  p/2*  —  1. 


(5) 


A3X  =  Vf-u  Yi’  = 


s  —0...k  1,  ... 

,  ,  i  =  3, 5...  p/25  —  1.  W 

\H>  J 

We  further  let  D  —  A,  with  similar  notations  for  Df  as  in  (2), 

D\,  i  =  1,2 . p/25,  s  =  k,k-  1 . 0.  (7) 

We  describe  the  main  stages  of  the  algorithm  in  the  following: 

For s  —  k, k  —  1, ... ,0  do  in  parallel 

D-  =  A5  —  VUim-iY'LU,  i  =  2i  j  =  1,2 . p/2>+1- 

(8) 


Find  in  parallel  the  Cholesky  decompositions, 

D°  =  C,C\,  i  =  1,2,. ...p. 

Let, 


(9) 


Ci  = 


(  Li,\ 

I/;,.  Li} 2 


Vi, i-2  Li,i-i 

L;,,J 


(10) 


Solve  in  parallel  the  triangular  systems 

Li,iL;,z  =  Ln,  1  =  1,2 . .  —  1. 

The  decomposition  A  =  LLl  is  then  given  by 


(U) 


( 


i  = 


\ 


Lp-2^  £p- 1 

Vp-\,z  £j>  j 


(12) 
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Theorem  2.1.  Let Nt-  e  M(m),i  =  0,1, ...,p  - 1  6c 
<7»'t>en  6y 


(D?)-1!;  =  r  ^  J,,  -1  =  2j  + 1,  j  =  0, 1, . . .  ,p/2’+1  - 1, 

(13) 

fors  =  0,1,. . . ,  k.  Then, 

»a.«  F;  +  (/  -  G?Kj2.«  )-'£?,  »0  =  0.  (14) 


We  then  eliminate  TOff1,  in  parallel  m  a  similar  way,  i.e., 
we  subtract  limes  the  last  row  of  Tf~.\  from 

the  last  row  of  Tf~l ,  and  £|,“1|‘(S2l“1)_1  times  the  first  row  of 
T{~1  from  the  first  row  of  Tf ”},  The  ith  row- of  A’  finally 
receives  a  similar  form  to  (17),  i.e., 


(  Qf  V?  0  0  £ f 

V  = 

\  77?  0  0  W(  Ff 


(18) 


Proof:  see[2].  D 

COROLLARY  2.2.  Suppose  that  the  submalrices 


■f,Ff  i -1,3,..., p/2’  1  Qi  j  (is) 

\,Hi  i  =  3,...,p/2’-l  ’  . .  1  ; 


art.  ’—own.  Then  we  can  implement  each  step  of  the  first  stage 
of  the  algorithm  in  0(m3)  operations. 

3.  Computing  the  E’s,F’s,G’s,H’s..  The  algorithm  we 
present  is  part  of  the  author  parallel  algorithm  for  solving 
band  s.p.d.  systems  of  linear  equations,  see(l]  section  2.1, 
and  we  will -review  here  its  main  new  ideas.  We  denote  the 
iifcrowof  A’,  s  =  0,1, . . . ,  It,. given  in  (2),  by 

V  =  (o  Cl  M  %  o)  i  =l,2,...,p/2,(lG) 

Step  0.  We  diagonalize  the  submatrices  Af,i  =  1,2, ...  ,p. 


Let, 


Qf  V?  0  0  £f  \ 

*M0  :  X  i  0 

Tf®  0  0  Wf  Ff 


(17) 


debote  the  corresponding  rows  of  A°  after  step  0. 

Step  s=l,2,. . .  The  ith  row  of  A’  has  now  the  form 

7?  =(§=!)>  t=  1,2,  ...,p/2’, 


T;  = 


( sir-\  vir.\  o  o  sir.\ 

* 

o  o  w2r.\  ^r_> 

QlT1  VjT'  o 
0  * 
*sr' 


0 

o 


o  o  wi,->  Fi-1  / 


with  V/  as  V(°-_,)j.+1,  and  W?  =  W®2,.  We  eliminate  5J,”1 , 
in  parallel  by  subtracting  52f '(W^L*,)-1  times  the  last  row  of 
Tffi\  from  the  first  row  of  and  ■7r2llIi(V2r1)-1  times  the 
first  row  of  Tff1  from  the  last  row  of  Tf-Z].  As  a  result  we 
obtain 


V  = 


oir-\ 

Vjf-I 

0 

0 

c*rl 

u 

* 

'TJS-l 

•hi- 1 

0 

0 

7 ^rJ, 
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0 
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* 
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0 

Sir1 

0 

¥ 

0 

0 
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0 

0 

vv2’r> 

Fir' 

Theorem  3.1.  Let  Tf,  s  =  0,1 . k  be  as  in  (16). 

Then  at  the  end  of  step  s  of  the  algorithm 


e;  - (v/)-'£J,  Pi  =  mm.  •  z liz'.vir  - 1 


and 


(19) 


=  (vt'q:,  h;  =  (w;)-lH’,  1  • 

(20) 

Proof.  The  first  s  steps  of  the  algorithm  may  be  viewed 
as  an  elimination  procedure  applied  to  the  linear  systems 

A\Xi  =  L\,  m‘  =  Vf-u  i=  1,2,..., P/2‘,  (21) 

in  (3)  and  (6).  The  result  now  follows  easily  from  (18).  □ 


Complexity  and  Processor  assignments.  In  Step  0,  we 
assign  processor  number  i  =  1, 2, . . .  ,p,  to  the  ith  row  of  A°. 
Each  processor  then  diagonalize  its  corresponding  submatrix 
in  parallel  in  approximately  2 nnp/p  operations.  In  Step  s  — 
1,2,...,/:  the  pair  of  processors 


(1-1)2’ +  1,12’  1=1, 2,..., p/2’, 


(22) 


is  assigned  to  rows  21  -  1,21  of  A’-1.  Each  such  pair,  per¬ 
forms  the  corresponding  elimination  step,  exchanging  0[trP) 
information  and  performing  0(m3)  operations.  Hence,  for 
m,p  <C  n,  the  algorithm  performs  approximately 

2 nm2/p  +  0{m?log  p)  ~  2nm?/p  operations.  (23) 

4.  A  pseudo  code.  Let  A  be  a  band  s.p.d  matrix  of 
order  n  =  qm  and  bandwidth  m,  and  let  A  =  LLl  be  the 
Cholesky  decomposition  of  A  as  in  Section  2.  We  assume  for 
simplicity  that  q  =  Ip  where  p  =  2I:+I  is  the  number  of  pro¬ 
cessors. 

Bottom-up  sweep:  We  compute  the  E’s,F's,G’s,H’s. 
Step  s=0.  We  compute  in  parallel: 

Ef  =  F?  =  AJ1Li,  for  1  =  1,3 . . I. 

Gf  =  Hf  =  AfUi.u  for  i  =  3,5,...,p- 1.  v”  ' 

Step  s=I,2,. . .  ,k-l.  We  perform  in  parallel  step  s  of  the  elimi¬ 
nation  procedure  as  in  Section  3,  and  then  compute  in  parallel: 

Ef  =  (Vt)-l£!,  Ff  =  (VV')"IJr’1  i=l,3,...,p/2’  — 1. 

G\  =  Hf  =  (VVi’r'Wf,  i  =  3,51...,p/2*-l. 

(25) 
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Step  s=k.  Wc  perform  step  k  of  the  elimination  procedure 
and.compute 

F*  =  (26; 

Top-down  sweep:  We  find  A  =  LLl. 

Step  s=k,k-lr  . .  ,0.  We  compute  in  parallel 

=F{‘  +  G^j2.u)-'E!,  S0  =  0,  (27) 

for  i  =  2 j  +  1,  j  -  0,l,...,p/2,+1  -  1. 

Step  s=-l.  We  compute  in  parallel 

A+i  =  ■‘4/+1  —  tZ/S;,  i  =  1,2,  — ,p  —  1.  (28) 

Find  in  parallel  the  decompositions 

Ai  =  £,•£•,  for  *  =  1,2 . .  (29) 

and  finally,  solve  in  parallel  the  lincar  systems 

—  Lit  for  i  —  1,2,... ,p  —  1.  (30) 

The  triangular  factor  L  of  A  =  LL‘  is  then  given  as  in  (12). 

Complexity  and  Processor  assignments.  Wt  have  consid¬ 
ered  the  bottom-up  sweep  in  Section  3.  In  Step  s=k,k-lr  ..,0 
of  the  top-down  sweep,  processor  numbers 

*2’,  i  =  2 j  +  1,  J  =0,1,...,  pi 21+*  -  1  (31) 

compute  the  corresponding  S,-2.,  performing  0(m3)  operations 
and. exchanging  0(m?)  information  in  parallel.  Then,  in  Step 
s=-/,  processor  i  =  1,2, ...  ,p,  perforins  approximately  nm?fp 
operations.  Hence,  for  m,p  -C  n,  the  complexity  is 

O(m3logp)  +  nm2fp  -  nm2fp  operations,  (32) 

for  a  total  of  ~  3 nm2/p  operations.  We  conclude  that  the 
algorithm  can  be  efficiently  implemented  on  many  existing 
parallel  computers  with  Sp  ~  p/3  speed-up,  and  with  low 
communication  overhead. 

5.  An  O(logm  Iogn)  time  algorithm.  Let  A  be  a 
band  s.p.d.  matrix  of  order  n  •=  qm  and  bandwidth  m,  and 
let  A  =  LV  be  the  Cholesky  decomposition  of  A.  We  show  in 
this  section  how  to  implement  the  algorithm  given  p  >  q/log  q 
processors.  The  algorithm  proceeds  as  for  the  case  where  there 
arc  min(q,p)  processors,  only  now  matrix  operations  of  order 
m  arc  done  in  parallel.  We  show  how  to  implement  efficiently 
each  matrix  operation  such  as  add,  multiply,  invert,  and  find 
the  Cholesky  decomposition,  in  parallel.  We  distinguish  be¬ 
tween  two  cases  as  follows: 

q/lrtg  q  <  p  <  qnp/log  q:  We  perform  each  step  with  as 
many  processors  as  available.  For  example,  with  q  processors, 
we  implement  each  operation  in  Step  0  with  one  processor, 
and  Step  s  =  1,2, with  V  processors.  Using  standard 
parallel  methods,  each  of  the  above  matrix  operations  require 
at  least  O(m)  time.  As  there  arc  only  ~  2 log  q  steps  the  total 
complexity  is 

0(nm2fp)  +  0{mlog  q)  —  0(nm2/p)  lime,  (33) 
and  Sp  ~  p/3,  as  the  total  operation  count  remains  the  same. 


qm? /log  q  <  p  <  q.\4(m)/(log  m  log  ii„  We  proceeds 
as  in  the  previous  case,  using  only  the  basic  matrix  operations 
such  as  add,  subtract,  and  multiply.  Here,  M(->  )  =  mP,  2  < 
@  <  3,  and  mP /log  m  de...  .es  the  least  number  -  f  processors 
required  in  order  to  multiply  matrices  of  order  m  ,.i  0(log  m) 
time.  For  example,  using  the  standard  multiplier  ‘.ion  algo¬ 
rithm  0  =  3,  parallel  implementation  of  Strassen\  method 
gives  /?  =  log  7  ~  2.8  see  Chandra[5),  and  for  huge  sir.  matri¬ 
ces  P  can  be  reduced  even  further,  see  Pan  and  Reif[8]. 

The  botlom-up  sweep  is  implemented  as  in(l)  section  3, 
with  complexity  0(qM(m)/p).  In  the  top-down  sweep  we 
have  the  following: 

1.  We  multiply  matrices  of  order  m  in 

0(M(m)/p)  time,  using  p<M(m)/logm  processors. 

2.  Consider  the  inveises 

(J-Glt)-1=(7-2)->,  Z=GK, 

in  (27),  where  we  denote  for  simplicity  G?  by  G,  and  Ri2,+i 
by  R.  Here,  we  observe  from[2]  that 

||  (I  -  Z)~'  -  Su  ||  <  E  II  Z  |l(  <  aA,/(l  -  a),  a  <  1, 

i=M 

where, 

Af-f  hi, \f/2 

5m=  E2*=  n  (/+«*'), 

1=0  1=0 

and  the  solution  converges  quadratically.  For  example,  let 
<x  =  2"f/2'°  and  let  the  precision  used  be  e  =  2“‘.  Then  for 
t  >  8,  eleven  products  suffices  to  get  an  accurate  inverse.  The 
actual  convergence  rate  is  clc."  rly  a  dependent,  and  even  for 
a  =  1  -  l/jn°(‘)  the  scries  converges  in  0{log  m)  steps.  We 
will  assume  for  simplicity  that  a  is  independent  of  m.  The 
actual  properties  of  this  new  iterative  method  requires  further 
research. 

3  Wc  finally  find  the  Cholesky  decomposition  of  the  dense 
s.p.d  matrices  A3  in  (20),  using  the  author  new  divide  and 
conquer  parallel  algorithm  described  in[3j.  A  similar  iterative 
scheme  used  there  gives  a  complexity  of  order 

0(M(m)/p)  time  using  p  <  M(m)jlog2m  processors. 

As  a  by  product  we  obtain  the  inverses  of  the  triangular  fac¬ 
tors  and  the  triangular  systems  in  (30)  can  be  solved  by  mul¬ 
tiplication. 

Wc  conclude  that  the  total  complexity  is 

0(qM(m)/p)  using  p  <  qM(rn)/(logm  log n)  processors, 

with  Sp  =  O(p)  speed-up  over  sequential  algorithms.  Fur¬ 
thermore,  there  arc  only  0(log  q  -f  log  m)  =  0{log  n)  steps 
each  dominated  by  the  lime  to  multiply  matrices  of  order  m, 
an  operation  which  can  be  efficiently  implemented  on  many 
parallel  computers. 
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6.  An  application  to  the  QR  algorithm.  The  QR 
algorithm  finds  the  eigenvalues  of  A  by  repeatedly  performing 

•  Find  the  QR  factorization  A  =  QR. 

•  SetA  =  RQ. 

until  the  oifdiagonal  elements  become  negligible.  The  re¬ 
sulting  diagonal  matrix  is  similar  to  the  original  matrix  and 
therefore  has  the  same  eigenvalues.  Samch  and  Kuck  have 
presented  a  parallel  QR  algorithm  for  tridiagonal  matrices 
sec[10]  which  can  not  be  applied  to  general  band  matrices. 
We  present  for  the  first  time  such  an  efficient  and  fast  parallel 
algorithm. 

Let  A  be  a  band  symmetric  non-singular  matrix  of  order 
n  =  qm  and  bandwidth  m,  and  let  A  =  QR  be  the  QR 
decomposition  of  A.  Then  it  is  well  known,  see  Parlett[9], 
that  Q  is  lower  Hessenberg  of  bandwidth  m,  and  R  is  upper 
triangular  of  bandwidth  2m,  i.e., 

q,,  =  0,  j  <  i  -  m,  and  r1}  =  0,  j <  i,  j  >i  +  2m.  (34) 

Hence,  RQ  is  lower  Hessenberg  of  bandwidth  m,  but  since 
RQ  =  Q'AQ  is  symmetric,  ibis  again  a  band  matrix  of  band 
width  m.  We  have  therefore  the  following  algorithm: 

•  Set  B  =  A1  A  =  A2,  a  band  s.p.d.  matrix. 

•  Find  the  Chclcsky  decomposition  B  —  LL‘. 

•  Solve  the  triangular  system  LX  =  AL. 

Now,  since  A  =  QR  it  follows  that  L  =  Rl  and  therefore 

X  =  L~lAL  =  R-*AR‘  =  Q‘R‘  =  RQ,  (35) 


is  the  transformed  matrix  sought.  Let  us  denote  X  by 

\ 


fXy  Yl 
Zy  Xl  Yl 


x  = 


and  let 


a,_i  y,_, 
V 1  A,  J 


f  Rl  Sy  * 

Rg  S2  * 


Zi  =  Yf  is 
’  upper  triangular  , 


R  = 


Rq-l  Sq  -  1 

V  ^  J 

where  all  submatrices  arc  of  order  m.  Then, 

(  Ey  Fy  \ 

*  Ei  Ft 

*  *  Ez  i*3 

AL  =  *  *  *  E*  F* 

*  *  *  Eq_,  Fq.y 

\  *  *  *  E,  ) 

and  therefore  X  can  be  found  as  follows: 


E„Fi  6  M(m), 

F,  is  lower 
triangular , 


Solve,  m  parallel  the  triangular  systems 

R\Yi  =  F;,  for  t  =  1,2,.. . ,g — 1.  (36) 

Solve  in  parallel  the  triangular  systems 

R\X,  =  E,  -  S^Y.y,  for  i  =  1,2,...  ,9,  (37) 

Complexity:  The  complexity  of  the  algorithm  is  domi¬ 
nated  by  the  time  to  find  the  decomposition  B  =  R‘R. 

7.  Conclusion..  We  have  presented  a  practical  parallel 
algorithm  for  finding  the  Cholesky  decomposition  of  a  gen 
eral  band  s.p.d.  matrix  that  does  not  implement  the  known 
sequential  method.  We  have  suggested  a  divide  and  conquer 
approach  whose  inherent  tree  structure  make  it  simple  to  im 
plement  on  many  parallel  computers.  Moreover,  in  most  prac¬ 
tical  cases  the  operation  count  is  approximately  only  as  thrice 
as  the  sequential  method  and  the  overhead  due  to  interpro¬ 
cessor  communication  is  negligible. 

Other  numerical  algorithms  such  as  the  conjugaie:gradi- 
ent  algorithm  for  solving  sparse  systems  of  linear  equations 
and  Lanczos  methods  for  finding  the  eigenvalues  of  symmetric 
sparse  matrices  arc  also  sequential  in  nature  and  we  believe 
that  more  parallel  oriented  algorithms  for  these  problems  can 
be  found. 
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A  RECURSIVE  DOUBLING  ALGORITHM 
FOR  SOLUTION  OF  SOME  SECOND  ORDER  RECURRENCES 
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06531,  Ankara-Turkey 


Abstract.  The  second-order  linear  recurrence  formulae  which  results 
from  ‘.he  Fourier  series  coefficients  of  the  Jacobian  elliptic  functions 
mm(u,k),  cnm(u,k),  and  dnm(u,  k)  with  m  >  1,  are  evaluated  by  the  method 
of  recursive  doubling  on  an  Intel  iPSC/d4  and  performance  results  are  dis¬ 
cussed. 


1.  INTRODUCTION. 

In  the  evaluation  of  functions  by  series  approximations,  the  accuracy 
increases  with  the  increase  in  the  number  of  terms  of  expansions  which 
results  in  an  increase  in  computer  time. 

The  Fourier  series  expansion  for  the  twelve  Jacobian  elliptic 
functions  (JF.Fs)  have  been  studied  and  given  by  several  authors 
(Abramowitz  and  Stegun  (1),  Byrd'and  Friedman  (2),  Du  Val  (3]  Whit¬ 
taker  and  Watson  [10].  Two-term  recurrence  formulae  have  been  ob¬ 
tained  for  the  coefficients  of  these  series  corresponding  to  powers  of  the 
JEFs  (Kiper  [5])-  The  resulting  recurrence  formulae  are  of  the  second 
order  and  linear.  Parallel  evaluation  of  these  recurrences  using  nested 
recurrent  product  form  algorithm  and  using  method  of  recursive  dou¬ 
bling  on  a-MIMD  system  was  considered  by  Kiper  [6]  and  :Kiper  and 
Evans  [7],  respectively.  In  this  paper  an  implementation  of  the  recur 
sive  doubling  algorithm  on  an  Intel  iPSC/d4  hypercube  multiprocessor 
was  developed  for  the  evaluation  of  the  mentioned  recurrences  and  the 
results  were  discussed  in  terms  of  the  speed-up  and  the  efficiency  of 
the  parallel  algorithm. 

2.  GENERALISATION  OF  RECURRENCE  FORMULAE 
OF  THE  FOURIER  COEFFICIENTS  FOR  POWERS  OF 
THE  JEFs. 


Th?  analysis  of  the  relations  for  the  Fourier  coefficients  for  powers  of 
the  JEFs  (Kiper  (5])  shows  that  for  a  prescribed  k  (k  is  the  modulus 


of  the  elliptic  functions)  these  recurrences  may  be  represented  by  the 
common  expression 


(0? 

u>n 

4’ 


=  a 

=  P 

=  a(n,  r)4r-11  4-  b(r)ojn~2\  r  =  2, 3, . . .  L 


•  n  =  0,l,...m 


(2-1) 

where  l  Is  the  required  power  and  m  Is  the  required  number  of  terms 
in  the  expansion.  Equation  (2.1)  is  a  second  order  linear  recurrence 
relation  R(i,  2). 


where 
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If  the  first  m  terms  of  the  expansion  for  a.power  l  is  required,  then 
a  matrix  system  of  size  ( t  -  1)  must  be  solved  (m  4- 1)  times  with 

n  —  0,I,2,...m.  The  size  of  ihe  system  increases  with  the  increasing 
required  power  and  ihe  number  of  solutions  of  the  system  increases 
with  the  increasing  number  of  terms. 

Another  parallel  approach  to  the  solution  of  the  recurrence  relation 
(2.1)  was  considered  by  Kiper  and  Evans  [7],  Equation  (2;1)  yields  a 
form  of  second  order  linear  recurrent  equation  which  generates  a  vector 
result  in  two  dimensions.  Since,  if  we  let 


yW- 

r7l 


,(r-: 


and  A$  = 


a(7i,r)  6(r) 
1  0 


(3.2) 


t  =  2,3,.../;  j»  =  0,l,2,...m,  then  (2.1)  for  the  prescribed  power  l 
can  be  written  as  (Modi  [8],  Schcndel  (9J) 


K1W  =  40-4<',) . 4S)-K,0).  n  —  0,1,2, ...in.  (3.3) 


The  associative  property  of  matrix-matrix  multiplication  leads  us  to 
use  the  recursive  doubling  process  (DJ  in  O(log5 1)  steps  for  each  n  (n  = 
0,l,2,,..m).  It  must  be  noted  that  computations  need  0(1)  steps 
for  each  n  in  the  sequential  mode.  The  numerical  experiments  of 
the  proposed  algorithm  were  carried  out  on  ihe  Sequent  Balance  8000 
multiprocessor  nith  5  processors  and  a  comparative  discussion  of  the 
results  were  given  in  [7). 


3.  PREVIOUS  EVALUATIONS. 

A  sequential  evaluation  of  the  coefficients  for  the  Fourier  expansion  of 
the  JEFssn'!,(u,e),enm(u,fc)  and  dnm(u, k)  *  :h  m  >  I  wereobtained 
and  the  numerical  values  are  given  for  various  values  of  k  (0.1  <  Jfca  < 
0.9)  (Kiper  (5)).  It  is  seen  that  the  rate  of  convergence  decreases  as 
the  value  of  k  and  the  power  of  the  JEFs  increase. 

A  parallel  evaluation  of  the  coefficients  "as  formulated  by  Kiper 
[6]  using  the  nested  recurrent  product  form  algorithm  in  which  the 
relation  (2.1)  has  been  expressed  as  the  solution  of  a  matrix  system 

(3.1) 


4.  RECURSIVE  DOUBLING  ALGORITHM  ON 
HYPERCUBE  MULTIPROCESSORS. 

An  implementation  of  the  recursive  doubling  algorithm  whose  formu¬ 
lation  has  been  already  given  in  [7]  was  considered  on  an  Intel  iPSC/d4 
hypercube  multiprocessor. 
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The  algorithm  consists  of  thefollowing  there  steps: 


Table  1 


Step  1:  Compute  V(r]  locally 

V[r]  =  A[r]*V[r-l],  r  =  2,3,...,* 

p :  the  number  of  nodes 
n  ;  the  problem  size 
i:  n/p 

Step  2:  Use  the  recursive  doubling  to  send  and  receive  V[l\ 
for  k  =  1  to  log(p)  do 
begin 

if  (MyNode  <=  (p  —  1  -  2*"1))  then 
send  V[l\  to  (MyNode  -f2-_1); 
if  (MyNode  >=  2s-1)  then 
begin 

receive  tmp-Vl ; 

V[l]  =  V[l)  * tmp.VL-, 

end; 

end; 

Step  3:  Compute  o.-[rJ 

if  (MyNode  <=  p— 2)  then 
send  V[t]  to  (MyNode  - 1); 
if  (MyNode  <  >  0)  then 
receive  trip.  VL\ 
for  k  =  lt.-f  -  1  do 

V[fc][0][0]  =  V[itj[0][0]*tTnp_W(0](0]-fV(fcl(0][l]*tmp_Kf{l][Oj; 


p 

1 

2 

4 

i 

T1 

Tp 

Sp 

Ep 

Tp 

Sp 

Ep 

16 

1.0 

1.6 

0.60 

0.30 

3.5 

0.28 

0.07 

32 

1.2 

2.1 

0.60 

0.30 

3.9 

0.32 

0.08 

64 

2.5 

2.9 

0.85 

0.42 

4.3 

0.57 

0.14 

128 

4.9 

4.8 

1.03 

0.51 

5.2 

0.94 

6.24 

25G 

9.9 

8.4 

1.17 

0.59 

7.1 

1.40 

0.35 

512 

19.8 

15.9 

1.24 

0.62 

10.8 

1.83 

0.46 

1024 

39.6 

31.0 

1.28 

0.64 

18.8 

2.10 

0.53 

2048 

99.6 

63.7 

1.56 

0.78 

34.2 

2.91 

0.73 

4096 

223.1 

153.8 

1.45 

0.73 

68.1 

3.27 

0.82 

8192 

467.1 

333.0 

1.40 

0.70 

158.6 

95.0 

0.74 

8 

16 

Tp 

Sp 

'  Ep 

Tp 

Sp 

Ep 

9.3 

0.10 

0.01 

21.0 

0.05 

0.00 

9.9 

0.13 

0.02 

21.2 

0.06 

0.00 

9.9 

0.25 

C.03 

21.2 

0.12 

0.01 

10.2 

0.48 

0.06 

21.5 

0.23 

0.01 

11.3 

0.88 

0.11 

22.1 

0.45 

0.03 

13.0 

1.52 

0.19 

23.3 

0.85 

0.05 

16.7 

2.38 

0.30 

24.5 

1.62 

0.10 

25.4 

3.93 

0.49 

28.6 

3.49 

0.22 

39.6 

5.64 

0.70 

38-4 

5-81 

0.36 

78.1 

5.98 

0.75 

56.2 

8.30 

0.52 

Variations  of  the  speed-up  and  the  efficiency  with  the  problem  size 
are  also  given  in  graphical  forms  in  Fig.  1  and  Fig.  2  respectively. 


The  algorithm  can  be  analysed  as: 


Step  1;  takes  4(d  -  1)  multiplication  and  2(f  -  I)  addition  steps. 

Step  2:  takes  8*log(p)  multiplication  4*log(p)  addition  and  2«log(p- 1) 
communication  steps. 

Step  3:  takes  2(f  —  1)  multiplication,  m  —  1  addition  and  2p -  3  commu¬ 
nication  steps. 


The  total  number  of- arithmetic  and  communication  steps  involved  are 
(9f  -  4  4-12  *  log (p))  and  (2p  -  3  4-  2  *  log(p  -  1))  successively. 

The  major  advantage  of  the  hypercube  multiprocessor  implemen¬ 
tation  is  that  the  iPSC/d-l  is  a  circuit-switched  machine  (contrasts 
to  the  store-and-forward  counterpart)  and  the  neighboring  nodes  of 
each  node  have  not  been  found  out  (in  order  to  implement  the  recur¬ 
sive  doubling  algorithm)  as  Egecioglu,  Ko$  and  Laub  [*ij  did  in  their 
paper. 

S.  EXPERIMENTAL  RESULTS  AND  CONCLUSIONS. 

The  effect. of  multiple  processes  was  investigated  by  running  the  pro¬ 
gram  on  1,  2,  3,  8  and  16  nodes  (p)  successively  and  computing  the 
total  amount  of  time  TP  (milliseconds)  needed.  The  performance  of 
the  algorithm  was  measured  in  terms  of  the  speed-up  (Sp)  and  the  ef¬ 
ficiency  (Ep).  The  numerical  results  with  respect  to  the  problem  size 
and  the  number  of  nodes  used  are  given  in  Table  1. 


As  it  will  be  seen  from  the  numerical  results,  both  the  speed-up 
and  efficiency  improve  with  the  increasing  problem  size.  Also  it  can 
be  recognised  that  the  maximum  values  attained  for  speed-up  and 
efficiency  are  proportional  to  the  number  of  nodes  used. 

2 


// 
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Fig.  1.  Speed-up 
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Fig.  2.  Efficiency 
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Abstract.  Using  a  matrix  representation  of  a  certain  family  of  permuta¬ 
tions  we  model  bypercube  parallel  data  transmissions.  Our  model  provides 
a  theoretical  framework  for  the  estimation  of  the  number  of  parallel  trans¬ 
missions  involved  in  a  given  algorithm  as  well  as  the  algorithms  that  achieve 
the  lowest  number  of  parallel  transmissions. 

1. -  Introduction.  A  d-dimensional  hypercube  architecture  consists  of  24 
node  processors  linked  by  the  edges  of  a  d-dimensional  hypercubc.  The 
processors  are  numbered  in  a  way  such  that  the  minimal  number  of  edges 
between  any  pair  of  them  is  thenumber  of  different  digits  in  the  binary 
representation  of  their  labels.  Thus,  two  node-processors  are  joined  if  and 
only  if  their  binary  labels  differ  at  exactly  one  bit.  In  such  an  architecture, 
a  nonnumerical  issue  that  is  crucial  to  the  performance  of  algorithms  is 
the  frequency  and  cost  of  communications  among  processors.  These  figures 
will  depend  on  the  underlying  problem,  on  how  the  data  is  mapped  onto 
the  processors,  and  on  the  numerical  algorithm.  In  this  work  we  present  a 
formal  complexity  analysis  for  the  interprocessor  communication  problem 
associated  to  the  product  of  a  2‘*x  24  complex  matrix  times  a  2',-dimenaional 
vector.  Our  analysis  assumes  that  all  interprocessor  communications  are 
describable  by  the  action  of  a  certain  group  of  permutations  on  the  nod-'s  of 
the  hypercube.  A  matrix  representation  of  these  permutations  allows  us  to 
use  matrix  algebra  techniques  to  estimate  the  minimal  number  of  parallel 
transmissions  involved  in  a  given  algorithm  as  well  as  to  find  the  algorithms 
that  achieve  that  estimated  lower  bound.  In  this  paper  we  briefly  present 
the  theoretical  foundations  of  our  communication  complexity  model  and 
use  some  techniques  derived  from  it  to  analyse  the  complexity  and  design 
optimal  communication  algorithms  for  computing  some  members  of  a  well 
known  family  of  permutations. 

2. -  Theoretical  Background.  Given  x  £  No  =  {0,1,2,...},  we  write  x  = 

£nLoe»(I)2"i  where  e„(x)  £  {0,1},  for  each  n.  We  also  set  Sx  =  {n  £ 
jY0  ;  c„(x)  y-  0}.  This  finite  set  is  called  the  spectrum  of  The  largest 
integer  in  Sx  is  termed  the  degree  of  x.  Given  x  and  y  €  No,  one  can  define 
the  so-called  dyadic  sum,  x+y,  of  x  and  y  by  x+y  =  |c„(x)  —  cn(y)|2“. 

Proposition  I.-  No,  under  dyadic  addition,  is  an  abelian  group.  In  partic¬ 
ular,  0  is  the  additive  identity  and  every  element  in  No  is  •*«  own  inverse. 


representation  of  Zo,  R :  Zj  -*  M3,  as 

*(°)=(o  “)=/oand  R(l)=(°  jul, 

Let  0  denote  the  tensor:{a!so  Kronecker  or  direct)  product  of  matrices. 
Since  G2r  is  the  direct  product  of  d  copies  of  2j,  the  map  K(  ,d)  :  x  £ 
Gjr-*  K{x,d )  €  GLus(C),  where 

K(x,d)  =  fife-  i(z))  ®...®R{cq[z)) 
d 

is  a  matrix  representation  of 

The  d  perfect  NNT  permutations  on  C2*  arc  represented  by  the  matrices 
K(2J,  d),  j  ss  0,1,  ...,d  — T.  In  general,  being  ~K(  ,d)  a  representation, 
K[z+y,d)  =  K(x,d)K(y,d)  and  the  set  U2*  —  {K[z,d)  .  x  £  C3«}  is  a 
commutative  subgroup  of  GL^*  (C).  Furthermore,  /f(x,  d)  is  its  own  inverse. 
If  d  —  2,  the  elements  in  U&  are 


K(  0,2)  = 


/I  0  0  0\ 
0  10  0 
0  0  10 
\0  0  0  lj 


,  K  (1,2) 


io  1  0  0\ 
10  0  0 
0  0  0  1’ 
o  o  i  07 


If  (2,2)  = 


(0  0  1  0\ 
0  0  0  1 
10  0  0 
0  10  0  ) 


and  Jf(3,2)  = 


(000 
0  0  1 
0  1  0 
1  0  0 


0 

0 

0  J 


Proposition  4.-  Let  A  =  (Ao,Al,...,A2s_1)  and  let 


UM- 


Then,  for  all  y  £  G2r,  K[y,d)D\X\K[y,d)  =  D((AoU.,  Au_, . \2r-ij4s)|- 

Definition.-  For  any  matrix  A  £  A/2r  and  x  £  G2i  we  define  the  24  x  24 
diagonal  matrix 


D(x,A)  =  D[co.xt<il,|.txt.-.,<>2<*>,(2<-i)+s! 


The  initial  segment  of  No,  G3t  =  {0, 1,  ...,24  -  1}  is  a  subgroup  of  No  under 
dyadic  addition.  Indeed,  C2i  is  the  direct  product  of  d  copies  of  2^  —  {0,l}, 
the  abelian  group  of  integers  under  addition  modulo  2. 

The  Hamming  aeight  ir(x),  ofx  £  JV„,  is  defined  by  tc(x)  =£„c„(x).The 
addition  here  is  the  ordinary  addition.  One  can  see  that: 

Proposition  2.-  (a)  w[x)  >  0,  Vs  £  No, 

(b)  u>(x+y)<  u?(x)  +  tc[y),  Vx,y  £  No- 

In  particular,  in  an  initial  segment  G2r,  the  Hamming  weight  ranges  through 
the  integers  between  0  and  d.  Another  measure  of  sixe  used  in  this  context 
is  the  Hamming  distance.  Given  z  and  y  £  Ao,  the  Hamming  data  nee, 
A(s,y),  between  x  and  y,  is  defined  by  A(x,y)  =  £„|c„(x)  -  c„(y)l.  Since 
c„(xiy)  =  |e„(x)  -  c„(y)|,  it  is  clear  that  A(z,y)  =  te(x+y).  Some  basic 
properties  of  the  Hamming  distance  are  given  in  the  following  proposition 

Proposition  3.-  (a)  For  any  x,y,x  £  No,  A(s+x,  y+x)  =  A(x,y) 

{b)  If  S, fUS.USv)  =  0.  then  A(x,y+x)  =  A(z+z,y)  =  A(z,y)  +  A(z,0) 
(e)  If  d  >  max  {  degree  to,  degree  x  },  then,  for  any  x,  y  £  jV0l 

h[24x+z,24yris)  =  A(x,y)  +h[  x,te). 


Note  that  if  x  and  y  £  G2r  axe  complementary,  i.e.  c„(z)  y£  cr.(y),  Vn,  then 
A(x,y)  =  d.  This,  in  fact,  is  a  necessary  and  sufficient  condition  for  two 
integers  in  G2r  to  be  complementary. 

A  permutation  a  :  G2a  — •  G2e  will  be  called  a  nearest  neighbor  transmission 
(NN'T)  permutation,  if  A(r,<r(x))  =  I,Vx£G2r.  Thus,  such  permutations 
modify  a  single  bit  in  the  binary  representation  of  each  x  6  C2s.  The  NNT 
permutation  will  he  called  perfect  if  the  bit  modified  ts  always  the  same. 
For  instance,  <?i(x)  “itl  and  <sa(x)  —  z*2  art  perfect  NN’T  permutations 
in  C2>.  In  general,  it  is  clear  that  for  each  d  =  1,2,...,  there  art  rf  perfect 
NNT  permutations  on  C2«  and  they  are  of  the  form  <t, (x)  =  x+2’,  Vr  £ 
G3i,  j  =  0,  l,...,d—  I.  Let  C  be  the  set  of  all  complex  numbers,  Af2i(C) 
the  linear  space  of  all  T*  x  2*  complex  matrices  and  CL-ifCJ  the  linear 
space  of  non-singular  matrices  with  complex  entries.  In  order  to  gel  a 
matrix  representation  foi  the  NNT  permutations  we  first  define  the  matrix 


We  have  the  following  important  result. 

Theorem  1--  Any  matrix  A  £  M3,  can  be  written  as 

A  =  £  D[x,A)K(x,d). 

*ec,, 


This  representation  is  nnique  in  the  sense  that  if  A  =  J2tec,t  DxK[x,d), 
where  each  Bx  is  a  diagonal  matrix,  then,  necessarily  Bx  —  D[x,  A),  Vx  £ 

G34m 

Corollary  1.-  For  any  matrix  A  £  M3e,  the  following  decomposition  holds 


A=  £  K{x,d)D[x,AT), 
sec,. 


where  AT  is  the  tranposed  matrix  of  A. 
Example: 

/2 


(  2  l  3  4  \ 

-7  3  0  8 

—3  5  1  y/2 

\y/i  -1  0  7  J 


-3 


1 


-I  J 


M 


-7 


sfl 


hOJg 


iJo&J,. 


Si) 


By  using  the  matrix  icprcscntation  given  in  iheoiem  *  and  its  uniqueness, 
vre  can  easily  compute  the  generalised  diagonals  of  ordinary  and  tensoi 
product  of  matrices.  In  fact. 

Theorem  2.-  (a)  Let  A  €  Afji,  and  B  €  Af.r,,  Then  for  any  r  £  G3t,,*„ 


D[z,A0  B)  =  D{t,A)& D{y,D) 


where  x  and  y  are  the  unique  elements  m  J3.,  and  G,,,  icspccti.cly,  such 
that  z  =  x2,»+tr. 
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(b)  Let  A,  B  £  A/jr.  Then,  for  any  z  6  C73i 

Z>(z,AB}=  £  0(x,A)D(y,f?.) 

where  jB*  =  if(z,d)Sff(=,d). 

The  following  quantity  will  be  useful  in  the  estimation  of  the  number  of  par 
allel  transmissions  involved  in  computing  with  A.  Given  any  A  £A f^fC), 
A  yt  [0],  we  dehne  <S(A)  —  max(tr(z)  :  D(x,  A)  r  [Oj}.  We  call  this  quantity 
the  Hamming  diameter  of  A. 

Proposition  5.-  (a)  Given  any  A  £  Myt,  B  £  M~,„  5(A  ®  B)  -  6(A)  t 
6(B). 

(b)  Given  any  A,  B  £  My,  then  6(AB)  <  min{d,fi(A)  t  5(B)}  This 
inequality  can  bt  strict  even  if  "both  matrices  are  different  from  the  zero 
matrix. 

3.-  Hypcrcubc  Parallel  Tbransmissiona.  Our  hyper' u  tie  machine  con¬ 
sists  of  2*  node  processors.  Each  processor  is  endowed  with  a  certain  number 
of  vector  registers  of  length  2!.  Given  a  vector  register  »r  in  processor  Pi 
and  a  vector  register  oj  in  processor  Pa,  it  will  be  always  possible  to  send 
the  content  of  the  j’-th  component  of  vj  to  the  y-th  component  of  «j.  Fur- 
thermore,  eimultar.eousextisgfles  of  the  contents  of  the  j-th  components 
of  any  two  vector  regisierc.rp. -allowed.  Thus,  if  we  assume  that  at  a  cer¬ 
tain  stage  of  a  computpiieftal  process,  the  2<<+<-diinensional  data  vector  c 
is  loaded  as  a  two-dimensio;’„l  array:  [c(r,j)J,  r£  Gy  and  j  £  Gy,  where 
s:aud  j  are  the  processor’s  and  vector  register  component’s  labels  respec¬ 
tively,  all  possible  interprocessor  data  movements  are  representable  by  a  set 
of  permutations  on  Gji,  :  j  6  Gy).  Each  of  these  permutations  acts 

on  the  segment -ey  —  {c{0,j},e(l,y} . c{2^  — 1 ,]))  of  e,  and  therefore  the 

whole  action  of  the  permutations  Pj  corresponds  to  the  action  of  the  direct 
sum  P  =  ©ysc,.  JV on  c.  antQexicographically  ordered.  The  permutation  P 
will  be  called  an  kjperceit  parallel  communication  (HPC).  By  representing 
each  Pj  in  terns  of  onr  formulas  in  section  2, 

P  =  Q*<7„(  £  P(z,P,)K{z,«0). 

»65,i 

An  hypcrcubc  parallel  transmission  (HPT}  is  now  denned  as  the  special  type 
of  HPG  where  Pj  —  DjK(2^:^,d).  Here  U,  is  a  diagonal  matrix  with  1’s 
and  0'»  on  its  diagonal  and  0  <  r(y)  <  d  —  J.  If  r(j)  =  r  for  all  /, 

P^  {e,c7„)  (fyOK(2'.d)). 

Any  HPC  is  performed  through  a  sequence  of  HPT’s.  A  lower  bound'for 
the  number  of  HPT'*  involved  in  an  hypcrcubc  parallel  communication  is 
max  (d(Pj)  -  j  €.  Cj>}.  This  lower  bound,  however,  is  not  always  achievable 

Theorem  3.-  Any  permutation  on  a  ^-dimensional  data  vector  is  com¬ 
putable  with  a  minimum  number  of  HPTs. 

Proof:  Let  A  be  a  matrix  representation  of  a  permutation  on  C1*.  Th.-n 
A  =  ,D(z,A)K(x,d).  Let  !mD(z,A)  and  ImD(x,Ar)  be  the 

image  subspaces  of  D(x,A)  and  J9{=,Ar)  respectively.  Since  A  is  a  permu¬ 
tation,  C5*  E5  Bxec,iIrnD(z,A)  =  S ,£5ll/mD(i,Ar),  and  the  permu¬ 
tation  A  can  be  written  as  the  direct  sum  A  =  Ox^GyPi,  where  T*  is  the 
restriction  of  K(z,d)  to  /mJ5(r,Ar).  Now,  the  minimum  number  of  HPTs 
required  by  A  is  equal  to  the  max{f(T,) :  i  £  Gj«},  which  is,  in  fact,  equal 
to  6(A). 

Theorem  4.-  Let  A  €  Myt,  be  such  that  A  =  B  ©  C,  with  B  £  Af-i  and 
C  £  M2 1.  Let’s  also  assume  that  computing  with  B  requires  6(B)  HPTs. 
Then  computing  with  A  also  requires  6(B)  HPTs. 

Proof:  Since  A  —  B®C=(D&  ly)(Iy  ©  G),  the  process  cf  computing 
z  =  Au  can  be  made  in  two  steps,  (1)  y  =  (Iy®G)u  and  (2)  z  =  (B@[y)y. 
To  implement  Step  (I)  we  divide  u  into  2 *  segments  ux,  s  £  Gy,  each  of 
length  2'.  Then  we  load  tr*  in  processor  r  and  compute  y,  =  Cvx.  Thij 
computation  requires  no  intcrprocessor  communications.  As  for  step  (2), 
according  to  Proposition  6,  (a),  6(BO  ly)  =  6(B)  +6(ly)  =  6(B). 

Theorem  4  establishes  that  a  significant  reduction  in  the  number  of  HPT* 
involved  in  computing  with  A  is  achievable  whenever  A  support*  a  tensor 
product  factoriiation.  This  result  explains,  for  instance,  the  good  commu¬ 
nication  properties  shown  by  the  Cooley-Tfcckey  FFT. 

Besides  estimating  the  HPT  complexity  of  any  algorithm  expressible  in 
matrix  language,  our  model  helps  in  Ending  the  best  interprocessor  data 
flow  alternatives.  We  will  consider,  by  way  of  example,  algorithms  com¬ 
puting  certain  permutations.  First,  we  need  to  set  up  some  corollaries  of 
Proposition  5. 


Corollary  1.-  ’d  a  .  Gy  -»  Gy  is  a  permutation  such  that  o3  —  id  and 
if  we  write  =  G(z,P,)  where  Pe  is  a  matrix 

representation  of  o;  then  K(y,d)y>1  =  /f (z,  (y,  d) yt1  ]. 

Definition.  Let  A  £  My.  V/e  deSncEx  =  {i£  Gy :  D[z,A)  £  (0)}. 

Corollary  2.-  If  o :  f?-J  -•  Gy,  then  (a)  =  :  j  £Gy), 

(b)  For  any  j  fe  Gy,  there  is  one  and  only  one  z  i  Z*  such  that  v)  —  1- 

Now,  wo  apply  our  theoretical  framework  to  the  analysis  and  design  of 
algorithms  for  computing  well  known  permutations  such  as  the  bit-reversal 
and  the  index  digit  permutations.  For instance,  let’s  consider  ft  -.  Gy  — * 
Gy  the  3-digit  bit-reversal  permutation.  Then  ft  is  determined  by  the 
transpositions  (1  4),  (3  6).  Now,  for  »  =  0,1, 2, 3;  2i+ft{2»)  =  0  and  2i  -F 
l+ft(2-.  + 1)  =  5.  Thus,  D(0, P^)  =  Djl, 0,l,0,0,l,0,lj  and  D(5,P^)  = 
DjO,  1,0,1, 1,0,  l,Cj.  Therefore,  ft  is  reduced  to  if  (5, 3)  acting  on  the  space 
ImD(b,Pfi.).  Now,  since  tr{5)  =  2,  6(K(h,  3))  =  2  and  therefore  the  HPT 
complexity  of  computing  ft  is  2.  An  algorithm  achieving  that  complexity 
is  obtained  by  simply  factoting  /f(5,3).=  jf(l,3)/f(4,3) 

Our  second  example  starts  with  the  permutation  r  determined  by  the  cy¬ 
cle  (0123).  Such  a  cycle  induces  a  permutation  a  .  Gy  -  Gy.  This 
permutation  is  defined  as 

®(cj(x)23  +  c2(x)27  +  Ci(z}2  +  eo(z))  =  erlj,(z)2s  t  c,12)27  -f  fr(i)2  F  c,j0j 

and  sometimes  termed  index-digit  permutation.  A  direct  calculation  shows 
that  BP,  =  (0,3,5.6,9,10,12.-15}.  Since  max  (in(z)  :  x  £  Er,}=to(lS)  = 
4,  6(P„)  =  4.  The  algorithm  performing  Pa  in  four  HPTs  is  obtained  by 
restricting  the  actions  of  K(z,d)  to  Im  D(z, P,),  for  z  6  Bp,. -For  x  in 
Bp,,  x  y£  15,  the  operator  K(x,d)  factors  as  a  product  of  two  perfect  NNT 
permutations.  However,  since  u(!5)  =  4,  if (15, 4)  will  factor  as  a  product 
of  four  perfect  NNTs. 
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Abstract.  We  have  generalised  earlier  work  cn  anchoring  of 
nematic  liquid  crystals  by  Sullivan  and  by  Sluckin  and 

Pr.niewierski  in  order  tq  study  -transitions  which  may  occur 
in  binary  mixtures  of  nematic  liquid  crystals  as  a 
function  of  concentration.  Possible  phase  diagrams  of 
anchoring  angle  versus  dopant  concentration  have  been 
calculated  for  a  simple  liquid  crystal  model. 

1.  INTRODUCTION 

If  a  nematic  liquid  crystal  !LC!  is  spread  cn  top  of  an 
anisotropic  substrate,  the  energy  of  the  LC  molecules  at 
the  nematic-substrate  interface  will  depend  cn 

orientation,  thus  inducing  preferential  alignment  of  the 

nematic  director1-2-3.This  phenomenon,  known  as  anchoring, 
plays  a  crucial  role  in  the  fabrication  of  LC  display 
devices,  which  rely  cn  a  delicate  control  of  anchoring 

surfaces  (see  e.g.  ref.  3).  However,  the  underlying 
physical  mechanisms  are  not  yet  fully  understood. 

Recently  it  was  shown  that  discontinuous  changes  in 
anchoring  direction  -  anchoring  transitions  -  can  occur  as 
a  result  cf  changing  concentrations  of  one  or  more 

adsorbates4.  We  are  concerned  with  modelling  the 

anchoring  transition  observed  by  Pieranski  et  2 lS'6,  which 
is  driven  by  changes  in  the  amount  of  water  vapour 
adsorbed  on  a  gypsum  substrate.  This  is  a  transition 
between  two  monostable  planar  anchorings,  which  is 
notoriously  difficult  to  study  theoretically.  We  therefore 
started  by  considering  a  simpler  case,  that  of  a 
transition  between  homeotropic  and  planar  anchorings. 

2.  THEORY 

7  •  f 

Following  Sullivan  and  co-workers  .  we  used  a 
mean-field  approximation  to  the  Helmholtz  free  energy 
functional  of  a  non-uniform  nematic  liquid  to  derive  a 
simpler,  Landau-de  Gennes  free  energy  functional.  The  main 
advantage  of  this  method  is  that  we  obtain  explicit 
expressions  for  the  phenomenological  coefficients 
appearing  in  Landau-de  Cerates  theory  in  terms  or  the 
intermoiecular  (and  surface)  potentials.  Besides 
mean-field,  the  basic  approximation  is  the  assumption  of  a 
step-function  variation  of  the  density  and  order  parameter 
profiles.  Although  this  is  clearly  incorrect,  as  it 
neglects  the  role  of  surface  adsorption  *H.  we  expect 
the  resulting  theory  to  provide  at  least  qualitative 
insight  into  the  mechanism  determining  the  equilibrium 
alignment. 

We  first  generalised  Sullivan  and  co-workers'  approach 
to  consider  a  single-component  uniform  nematic  phase  at  a 
(plane)  surface.  Neglecting  blaxiality.  the  surface  term 
in  the  expressicn  of  the  surface  tension  is. 

/  =  w  +  w  P  (cos  \»  ♦  w  P  (cos  <v) 
$022  *  * 

where  t>  =  cos''(n.k)  Is  the  tilt  angle,  i.e.  the  angle 
between  the  normal  to  the  surf  ace.  k.  and  the  nematic 
director,  n.  and  P  Is  the  nth-erder  Legendre  polynomial. 

ti 

We  can  estimate  the  orientation  favoured  by  the  surface  by 
minimising  only  f_  instead  of  the  full  surface 

tension'3-11.  Equation  (U  truncated  after  the  P^Ccos  p) 


term  is  <_;owr.  in  tiic  1,'erature  as  the  Rapmi-Papoular 

form  of  the  surface  anchor,  'g  energy1*,  which  has  been 
extensively  used  in  both  theoretical  and  experimental 
work. 

This  theory  is  straightforw.-dly  generalised  t o  a 
binary  LC  mixture  at  a  surface.  /  :s  still  given  by  (1) 

and  the  vr  are  linear  combinations  ot  IJJ,  the 

n  nil 

third  moments  of  the  coefficients  in  the  spherical 
haimomu  expansion  of  the  intermoiecular  potential  between 
species  L  and  f  for  (11^)  =  1000),  (220).  (202).  (222) 

and  (224),  and  Frat,  the  integrated  LC-surface 
interaction.  In  particular,  iv^  fs  a  function  of  F{224) 

only.  Tne  coefficients  in  the  linear  combinations  are 
products  ef  the  total  density  and  of  tne  concentrations 
and  order  parameters  of  the  two  components. 

Minimisation  of  /  with  respect  to  yields  the  phase 
diagram  shown  in  tig.  1. 


Figure  I:  The  anchoring  phase  diagram  of  a  LC  in  (u-^.u*) 
space. 

As  w„  and  iv_  change  as  functions  of  temperature  and 

concentration,  the  trajectory  of  a  system  in  lw  ,w  )  space 

may  cross  one  or  more  of  the  boundaries  between  different 
anchoring  domains,  at  which  point  an  anchoring  transition 
obtains  which  is  first-order  if  <  0  or  second-order  if 

vv^  >  O.  Sullivan  and  co-workers7'’  argued  that  the 

V(224;rJ  terms  in  the  interaction  potential  /*  coming  from 
•;  ».»d.  -qiAdti.;,  Ie  interactions  and  short-range 

afelnfa  repulsive  and  attractive  forces)  are 
essentially  positive,  leading  to  non-negative  and 

sewnd-rder  transitions  (tow ever,  may  vanish,  as  we 

shall  seel 
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’  In  order  to  calculate  and'  y!i  we  need  a  specific 
model  for  VU^ljr).  In  a  first  approach,  we  used  the 

simple  Telo  da  Gama  model  of  LCs14,  which  includes 
(000),  (220),  (202)  and  (022)  (=(202)  terms,  augmented 
with  a  (224)  term  coming  from  quadrupolar  interactions13 
and  an  inverse-power  law  surface  potential10.  Note  that, 
in  this  simple  mean-field  theory,  only  (Z  ^  i2i)  terms  with 

1=0  contribute  to  the  free  energy  of  the  bulk  phases14 
and  therefore,  given  our  step-function  approximation  for 
the  density,  concentration  and  order  parameter  profiles, 
the  addition  of  (202)  or  (224)  terms  will  not  change  the 
order  parameter.  C(J,  the  strength  of  the  (202)  term,  is 

proportional  to  the  average  polarisatility  times  the 
polarisability  anisotropy.  We  consider  equal-sized 
molecules  and  initially  assume  all  cross-interaction 
potential  coefficients  to  be  given  in  terms  of  those  of 
the  pure  components  by  the  Lorentz-Berthelot  rule  (this  is 
exact  in  the  case  of  quadrupolar  interactions,  which 
allows  for  the  vanishing  of  w  if  the  quadrupole  moments 

of  the  two  components  have  the  same  magnitude  but  opposite 
signs). 

3.  RESULTS 

Fig.  2  shows  a  cross-section  (taken  at  constant 
reduced  quadrupole  moment  ?//(Cv5)  of  the  (x  ,Q*)  phase 

diagram  of  a  binary  LC  mixture  whose  components  differ  by 
i)  the  sign  (but  not  the  strength)  of  their  quadrupole 
moments),  and  ii)  the  fact  that  the  surface  favours 

homeotropic  alignment  of  component  1  (V*  <  0)  and  planar 

alignment  of  component  2  (V2  >  0).  x  is  the 

ext  2 

concentration  of  component  2.  B*  is  a  normalised 

combination  of  V  and  V(l  ,l  ,1). 

ext  1  2 


Figure  2:  A  cross-section  of  the  (x2,Q‘)  phase  diagram  of 

the  binary  LC  mixture  described  in  the  text  for 
Q*  =1.0.  Bv  is  the  strength  of  the  surface 
potential. 

As  Q*  =  Qj*=  -Qz*  increases,  re-entrant  conical 

anchoring  becomes  possible.  In  fig.  3  we  plot  the 
anchoring  angle  versus  along  trajectories  I  and  II  in 

fig.  2.  The  latter  clearly  displays  anomalous,  or 
re-entrant,  behaviour. 


Figure  3:  Tilt  angle  vs.  ae along  trajectories  I  and  II 
in  fig.  2. 


4.  CONCLUSIONS 

We  used  a  simple  mean-field  theory  to  derive  a 
Landau-de  Gennes  expression  for  the  surface  free  energy  of 
a  mixture  of  nematic  LCs  in  contact  with  an  anisotropic 
substrate.  In  spite  of  the  fact  that  it  contains  a  number 
of  oversimplifications,  the  theory  predicts  fairly  rich 
and  interesting  anchoring  behaviour,  including  re-entrant 
conical  anchoring,  as  a  function  of  composition,  when 
applied  to  a  simple  LC  model. 
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Abstract  -  Using  algebraic  processors  general 
properties  of  S0(3)  -  invariant  free  energy 
expansion  of  biaxial  liquid  crystals  are 
studied.  This  is  achieved  by  decomposing 
invariants  in  terms  of  integrity  bases  as 
proposed  by  Judd  et.al. ,  Gaskell  et.al.,  and 
Bistricky  et.al.  With  the  help  of  this 
approach  a  rigorous  continuum  free  energy  of 
general  biaxial  nematics  is  analyzed  as  an 
expansion  in  components  of  a  symmetric  and 
traceless  tensor  order  parameter  field  Q  a  and 


its  derivatives  3.  O  Next,  a  general  theory 

H  up 

of  flexopolarization  and  a  classification  of 
local,  polar  structures  in  biaxial  systems  is 
offered.  Finally,  some  consequences  for 
biaxial  smectic  systems  are  summarized. 

I.  INTRODUCTION 

Algebraic  processors,  like  Macsyma  or  Mathe- 
matica,  have  been  designed  to  perform  symbo¬ 
lic,  numerical  and  graphical  calculations 
easily  and  to  arbitrary  precision.  One  can 
also  use  these  processors  to  prepare  input 
for,  or  analyse  output  from  other  external 
programs.  Below  we  would  like  to  summarize  the 
results  for  continuum  theory  of  biaxial  liquid 
crystals  obtained  by  combining  symbolic  and 
numerical  possibilities  of  Macsyma. 

A.  Order  Parameters 

Orientational  properties  of  liquid 
crystals  are  described  in  terms  of  irreducible 

spherical  tensor  fields  Q^(r)  of  angular 

momentum  L  and  of  components  Q^)  (r)  [1].  Out 

of  them  the  most  important  is  L=2  quadrupole 
tensor  which  describes  anisotropic  part  of 

electric-  or  magnetic  susceptibilities.  In 

(2)  .  ,  , 

cartesian  representation  Q'  '  is  identified 
with  a  second  -  order,  symmetric  and  traceless 
tensor  field  Q(r)  of  components  Qa(J(r) .  For 

polar  liquid  crystals  additionally  (r) 

field  must  be  retained. 

B.  Integrity  bases 

Theoretical  studies  of  physical  properties 

of  the  systems  described  in  terms  of  are 

based  on  the  nonequilibrium  free  energy 
density  expansion  around  an  isotropic  phase 

i.e.  Q ^  =  0.  This  expansion  is  an  SO(3) 


symmetric  polynomial  in  the  components  of 

irreducible  spherical  tensors  and  their 

derivatives.  Consequently,  an  important 
problem  to  solve  is  that  of  determining  all 
so ( 3 )  invariants  which  are  homogeneous 

polynomials  in  components  and  derivatives 

a  q(L^.  One  can  prove  that  for  a  finite  set  of 
U*  m 

Q  fields  it  is  possible  to  construct  a 
finite  basis  of  invariant  polynomials 
(integrity  basis)  such  that  all  other 
invariants  can  be  written  as  polynomials  of 
these  basic  invariants.  This  very  elegant 
group  theoretical  method  has  been  applied  to 
problems  with  SO(3)  symmetry  by  Judd 
et.al. [2],  Gaskell  et.al. [3]  and  Bistricky 
et.al. [4). 

For  large  L,  calculations  of  the  integrity 
basis  elements  and  studies  of  their  properties 
are  nontrivial  algebraic  problems,  which 
appear  to  be  perfectly  suited  for  algebraic 
processors  [5-7]  .  Here  we  summarize  some  of 

the  results,  obtained  for  the  L  =  2  tensor 
field  and  for  the  L  =  1  vector  field.  Some 
other  examples  are  found  in  refs. [2-7]. 

II.  ELASTIC  AND  FLEXOPOLARIZATION  MODES 
OF  BIAXIAL  LIQUID  CRYSTALS 

Elastic  free  energy  of  biaxial  liquid 
crystals  is  defined  as  an  expansion  in  Q ^  and 

d^Q a/3'  w^ere  °nly  *irst  and  second  order  terms 
in  derivatives  d,,Q  „  are  retained.  Thus,  the 

expansion  contains  SO(3)-  symmetric  invariants 
built  up  from  the  tensors  Qa/3QrS  •  •  ’Qpa^pv 

and  0  „Q  „...Q  (Q  )  >■)  obtained  by 

means  of  contractions  with  the  Kronnecker 
deltas  and  the  Levi-civita  tensors. 

Similarly,  the  deformation  induced  polariza¬ 
tion  of  biaxial  systems  depends  on  Qa<3  and 

q  at  each  point.  Since  the  effect  is 

CCfS  1 1} 

linear  in  deformations  the  corresponding 
flexopolarization  part  of  the  free  energy  must 
include  the  class  of  all  linearly  independent 
SO (3 )  —  symmetric  invariants  ‘  ,Qpirx 

(0  ) ,  where  P_  is  the  polarization  field  ( 


P?  «  P 


(1)  *Q(1)). 

decomposing  the  invariants  of 


and 


l?a  in  the  corresponding  integrity 


basis,  one  finds  that  the  most  general  free 
energy  expansion  to  all  powers  of  Q  „  and  up 
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to  second  order  in  Q  .  contains  39  basic 

Up  /  <r 

elastic  modes  [6],  where  three  of  them  are 
chiral.  These  generalise  the  concept  of  the 
splay-,  bend-,  and  twist  deformations  of  the 
director  field,  introduced  by  Oseen,  Zocher 
and  Frank.  The  associated,  temperature 
dependent  elastic  constants  are  analytical 

functions  of  TrQ2  and  TrQ3. 

Similarly,  the  general  flexopolarization 
free-energy  density  of  chiral  biaxial  liquid 
crystals  is  composed  of  12  basic  deformation 
modes  [7],  These  are  multiplied  by  arbitrary 

polynomials  in  TrQ2  and  TrQ3  which  define 
temperature-  and  position  dependent 
f lexocoef f icients . 

In  both  cases  simpler  forms  of  the  free 
energy  densities  are  obtained  from  the  general 
expansion  by  imposing  additional  symmetry 
restrictions  on  the  field  Q.  Details  are  given 

in  refs. [6,7] . 


III.  POLAR  STATES  OF  BIAXIAL  LIQUID  CRYSTALS 

With  the  help  of  integrity  basis  one  finds 
very  convenient  approach  to  study  selection 
rules  -for  broken  symmetry  states  in  an 
arbitrary  Landau  free  energy  expansion  [7].  As 
an  example  we  investigate  the  correlation 
between  polar  nematic  states  and  the 
properties  of  the  integrity  basis  for 


invariants  composed  of  the  components  of  P 


(l) 


and  Q 


(2) 

The  integrity  basis  for  invariants  of  two 

HI  (2) 

order  parameters  P'  '  and  Q'  '  is  composed  of 


six  invariants  1^,  whose  degrees  of  P 


>(2) 


(1) 


and 


are  «  and  (3,  respectively.  The  invariants 


in  Cartesian  representation  can  unambiguously 
be  identified  as  [7]: 

I02  =  Tr§  ' 


I03  =  TrQ  , 


*20  =  P«V 


I21  PaQaf3Pi3’ 

X22  =  P«<4P0  -  5  Tr<22)  V«' 


and 


I33  PaP/3P*  Cauv 


where 


108  (i33r  - 


54  I02  *20  ^22^  +  54  *02 


{'l2l)  *22  "  9  ^02^  ^21^  ‘20 


+  2  ^02)2  (J20)3  -  36 


03  v  21' 


+  108  I 


03 


21 


X22  X20 


-  12  <?20>3  -  108  (X22)3- 

Consequently  ,  the  Landau  free  energy 
expansion  for  polar  nematics  is  a  stable 
polynomial  in  1^  and,  at  most,  a  linear 

function  in  I33>  One  finds  that  in  addition  to 

the  uniaxial  and  biaxial  ferroelectric  nematic 
phases  which  are  generated  by  the  first  five 
invariants,  there  exists  a  biaxial  chiral 
ferroelectric  nematic  phase,  generated  by  the 

I33  t®r,n* 

From  the  form  of  I33  it  is  clear  that  the 

following  must  be  fulfilled  for  the  possible 
existence  of  the  chiral  biaxial  phase:  i) 
chiral  molecules  with  a  large  dipole  moment 
component,  perpendicular  to  the  long  molecular 
axis  ii)  large  molecular  biaxiality,  probably 
of  the  same  order  as  the  one  observed  in 
thermotropic  biaxial  nematics. 

*  Similar  statements  hold  for  the  smectic  - 
C  phase.  One  finds  that  if  the  Sc*  phase  is 

stabilized  due  to  the  piezoelectric  coupliny 
between  P  and  a  density  wave  then  it  must  be 
described  as  a  biaxial,  uniform  spiral  with, 
at  least  two  nonvanishing  commensrrate 
harmonics.  Since  the  polarization  in  the  Sc* 

phase  is  perpendicular  to  the  local  director, 
additionally  the  biaxial  piezoelectric 
coupling  invariant  I33  must  vanish. 

For  nonzero  value  of  the  I33  invariant 
another  phase  with  the  Sc*  symmetry  may  be 

more  stable.  In  this  phase,  the  polarization 
is  not  perpendicular  to  the  local  director. 
Intrinsic  biaxiality  of  chiral  liquid 
crystalline  molecules  is  the  driving  force, 
stabilizing  this  phase. 

The  above  predictions  are  in  accordance 
with  recent  expectations  that  the  non 
centrosymmetric  biaxial  molecules  with 
negative  dielectric  anisotropy  may  be  good 
candidates  to  form  phases  with  local 
ferroelectric,  biaxial  nematic  order. 

A  thorough  discussion  of  the  phase 
diagrams  for  the  cases  discussed  above  will  be 
presented  elsewhere. 
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Abstract.  We  use  the  Erickscn-Eeslie  equations  to  investigate  the 
stability  of  simple  shear  flow  between  moving  parallel  plates  for 
hon-flow-orienting  nematic  liquid  crystals.  We  show  numerically 
that  as  the  velocity  of  the  plate  is  increased  the  first  instability 
can  be  cither  in  the  shear  plane  (tumbling)  or  out  of  the  shear 
plane,  depending  on  the  material  constants.  We  also  present  nu¬ 
merical  results  for  the  continuation  of  the  out-of-plane  solution 
from  its  bifurcation  point. 

1.  ERICKSEN-LESLIE  EQUATIONS 

We  consider  simple -shear  flow  between  parallel  plates  at  a 
distance  2 h  apart  which  arc  parallel  to  the  x-y  plane.  We  assume 
that  the  upper  plate  at  z  =  h  is  at  rest  while  the-lower  one  at 
z  —  —h  moves  with  velocity  V  m  the  y  direction.  The  state  of  the 
nematic  liquid  crystalis  described  by  its  velocity  v  =■  v^x,  y,z,t) 
and  its  anisotropic  axis  n  =  n(x,y,z,t)  where  |n|  =  1. 

'We  first  investigate  simple  shear  flows  of  the  form 

v  =  (0,u(z,<),0)  n  =  (0,  cos  #(z,i),  sin  0(z,  £)).  (1.1) 

For  flows  of: the  form-(l.l)  the  Ericksen-Leslic  equations  are 

'I <'-2> 

<«> 

where 

g(8)  =  a i  sin2  8  cos2  8  +  a-i  ^  °2  sin2  8  +  a-6  --  cos2  8  + 

m(8)  =  (7,  +  72  cos  28)  /2;  }{0)  =  K\  cos2  8  +  n 3  sin2  8\ 


p  is  the  density;  ai ,...,  as  arc  the  Leslie  viscosities;  k j,  K2,  kj 
arc  the  Frank  clastic  constants;  and  71  =  a-j  -  a-ji  72  =  ac  —  os- 
Thermodynamic  inequalities  imply  that  g(8 )  ^  0  and  f(8)  >  0 
for  all  8  and -that  -,i  >  0  [4j.  We  shall  only  consider  flows  in  the 
non-flow-orienting  regime  71  >  I72I,  so  m(8)  >  0  for  all  6. 

We  utilize  the  “strong  anchoring”  condition  foi  11,  i.e., 


8(-h,t)  =  8(h,t)=8p.  (1.4) 

where  8p  =  0  or  rr/2  and  the  “no-slip”  boundary  condition  for  v 

v{~h,t)  =  V,  u(/t,£)  =  0.  (1-5) 

For  steady  flow, 

where  c  is  ail  integrating  constant  for  (1.2),  and  (l.C)  can  be 
used  to  eliminate  Oo/Oz  from  (1.3)  to  obtain 


.  .  om (oo\’ 

2/(%7  +  7rVs)  -2c^M-°' 

0(-h)  =  8(h)  =  8p. 


!This  work  w?is  supported  in  part  by  the  National  Science  Foundation  and 
the  Air  Force  Office  of  Scientific  Research  through  grants  DMS  835-1080 
and  DMS  €71-8881,  tile  Army  Research  Office  through  grants  DAAL03- 
88-K-O110  and  DAAL03*89*G-O0Slt  and  by  the  Minnesota  Supercomputer 
Institute. 


2.  STABILITY  EQUATIONS 

We  have  solved  the  linearized  stability  equations  for  (1.2), 
(1.3)  given  by  the  following  eigenvalue  problem  for  the  pertur¬ 
bations  e,AIV(z)  of  v(z)  and  c‘MQ(z)  of  8(z) 


W-!(: + 

0  (  0Q\  Of  0*8  -  02f  (ddV 

2A7i Q  =  2Tz  +20dd?Q+  W  \dz) 

OmOv ^  ta\dV 

V(-h)  =  V(h)  =  0  0(-/r)  =  0(A)  =  0. 


(2  1) 
0 

(2.2) 

(2:3) 


Previous  authors  [2,7,8]  have  dropped  the  inertial  term  \pV  in 
thchuear  momentum  equation  (2.1)  and  have  set  the  integrating 
constant  in  (2.1)  equal  to  0  to  obtain  the  equation 


%  §0  +  ffW^  +  M^0  =  °-  (2-4) 

They  then  use  (2.4)  to  eliminate  dV/dz  in.  (2  2)  and  to  obtain 
the  Sturm-Liouville  eigenvalue  problem 


2A 


+  08  Oz2 


J*f  (0d\ 
+W  \Tz) 


0- 


n0m0v  nm(8)0g0v 
1 08  Oz  *  g(8)  08  0z 


0, 


0(-/»)  -  0(A)  =  0. 


(2.5) 

(2.6) 


If  the  “no-slip”  boundary  conditions  are  replaced  by  the  bound¬ 
ary  conditions 


g(8(-h))~(-h)r,Cu  v(ll)  =  0,  (2;7) 

where  Cr  is  the  given  shear  stress  on  the  bottom  plate,  *  hen  the 
integrating  constant  in  (2.4)  is  0  and  the  linearized  stability  is 
given  by  (2.5),  (2.6). 

For  A  =  0  the  equations  (2.1)— (2.3 )  aie  the  equations  denning 
a  turning  point  for  stationary  solutions  of  (1.2)— (1.5)  parame¬ 
trized  by  the  plate  velocity  V  whereas  for  A  =  0  the  equations 
(2.5),  (2.6)  are  the  equations  defining  a  turning  point  for  the 
stationary  solutions  of  (1.2)— (1.4)  parametrized  by  the  boundary 
shear  stress  Cj  in  (2.7). 

We  have  computed  liquid  crystal  flows  of  the  more  general 
form 


v(z,  t)  =  ( u(z ,  £),  v(z ,  t),  w(z,  £))  (2-7) 

n  (z,t)  =  (cos  <P(z,t),  sin  4>(z,t)  cos  8(z,t),  sin  <p(z,  t)  sin  8  (z,L)). 

using  the  Erickscn-Leslic  equations.  Since  the  flow  is  incom¬ 
pressible,  w  =  0.  The  linearized  stability  equations  for  the 
Erickscn-Lcslie  equations  for  steady  flows  of  the  form  (1.1)  with 
respect  to  flows  of  the  form  (2.7)  are  given  byr  the  eigenvalue 
problem  (2.1)-(2.3)  for  in-plane  perturbations  c,x‘V(z)  of  v(z) 
and  c,A'0(z)  of  6(z),  and  by  a  similar  eigenvalue  problem  for 
the  out-of-planc  perturbations  c,XtU(z)  of  u(z)  and  clAl,I>(z)  of 

m  [5]. 
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Fig.  1.  At  i  =  .5  the  out-of-plane  instability  occurs 
first.  At  e  =  .86,  the  in-plane  instability  occurs  first. 


3.  COMPUTATIONAL  RESULTS 
Computational  results  for  solution  branches  were  obtained  us¬ 
ing  the  software  package  .AUTO  [3].  Our  computational  results 
show  that  the  first  instability  can  be  in-plane  or  out-of-plane,  de¬ 
pending  on  the  material  constants  [5].  We  model  the  behavior 
of  8CB  just  above  the  smectic  A-nematic  transition  temperature 
with  0p  =  7t/2  by  the  following  material  constants  for  e  >  0: 

®i  =  12e|a2|,  or2  =  -.7,  a3  =  e|a2|, 
or.i  =  .58,  a5  =  .7,  orfi  =  e|a2|, 

Ki  =  1.41  x  10°,  K2  =  1.023e/ci,  K3  =  2.605eKj,  p=  1, 

where  viscosities  are  in  poise,  clastic  constants  are  in  dyne,  den¬ 
sity  is  in  g/cm3,  and  h  =  1  cm.  In  Figure  1  above,  the  first 
in-planc  instability  occurs  at  the  first  turning  point  and  the  po¬ 
sition  of  the  first  out-of-plane  instability  is  marked  by  “+." 

Next,  we  present  computational  results  for  the  out-of-planc 
solution  branch  of  the  form  (2.7)  which  has  been  continued  from 
the  bifurcation  point  for  8CB  at  35°  C  [5].  These  computations 
used  the  boundary  data  6(-h)  —  9(h)  =  0,  <j>(-li)  =  <P(h)  =  s/2. 
The  position  of  the  bifurcation  point  in  Figure  2  is  marked  by 
“+.”  Profiles  of  the  solution  u(z),  <f>(z),  and  6(z)  are  given  in 
Figure  3  at  the  points  on  the  solution  branch  marked  by  A-W. 
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HYDRODYNAMIC  INSTABILITIES  IN  A  NEMATIC  LIQUID  CRYSTAL  DEVICE 
UNDER  OSCILLATORY  SHEAR 
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Clarendon  Laboratory 
Oxford 


Abstract  -  We  present  the  results  of  an  experimental 
study  of  some  hydrodynamic  instabilities  found  in 
a  large  aspect  ratio -nematic  liquid  crystal  device 
which  is  subjected  to  a  linear  oscillatory  shear. 

The  instabilities  depend  on  shear  rate,  frequency  and 
gap  width  of  the  cell.  They  also  fall  into  two  dif¬ 
ferent  basic  classes  ^or  thick  and  thin  cells. 

1 .  INTRODUCTION 

Hydrodynamic  instabilities  in  thin  homogenously 
aligned  nematic  liquid  crystals  which  are  subjected 
to  linear  oscillatory  shear  were  first  investigated 
by  Clark,  Saunders,  Shanks  and  Leslie  (1981).  They 
found  an  instability  m  the  form  of  I  cm  wide  bands 
aligned  in  the  direction  of  the  shear  which  have 
alternating  in-phase  and  out-phase  twist  separated 
by  their  dark  regions.  The  layers  were  approximately 
10um  thick  and  the  frequency  range  was  10-100H,. 

Thus  the  bands  are  large  scale  effects  as  the 
width  of  each  is  approximately  1000  layer  thicknesses. 
In  addition,  Clark  et  al  carried  out  a  stability 
analysis  of  the  equations  of  motion  and  obtained 
good  agreement  between  theory  and  experiment.  One 
crucial  assumption  in  their  analysis  is  that  the 
critical  shear  rate  for  the  appearance  of  the  in¬ 
stability  is  independent  of  frequency.  This  appeared 
to  be  borne  out  by  their  observations  for  thin  layers. 

Clark  et  al  also  observed  the  formation  of 
mechanical  Williams  domains  for  shear  rates  above  the 
first  instability  described  above.  These  are  the 
mechanical  equivalent  of  the  Williams  domains  found 
in  electrohydrodynamic  convection  (see  for  example 
Blinov  (1983)).  They  have  length  scales  of  the  order 
of  twice  the  layer  thickness  and  are  thus  micro¬ 
structures  when  compared  with  the  bands  described 
above.  The  mechanical  Williams  domains  have 
recently  been  investigated  by  Kozhevnikov  (1986)  for 
normally  orientated  nematics  with  applied  oscillatory 

2  S 

shear  frequencies  in  the  range  10  -  10  H3-  Finally, 

Guazzelli  (1990)  has  also  observed  mechanical 
Williams  domains  when  an  elliptical  oscillatory  shear 
is  applied  to  thin  layers  of  nematics. 

In  the  present  study  we  have  extended  the  work 
of  Clark  et  al  to  investigate  the  effects  of  layer 
thickness  on  the  observed  instabilities.  Vie  have 
found  that  the  critical  shear  rates  for  the  first 
appearance  of  the  large  scale  instabilities  are 
strongly  dependent  on  frequency  although  there  is  some 
evidence  for  independence  at  high  frequencies.  Fatches 
of  Williams  domains  are  the  first  instabilities  to 
appear  with  increase  of  shear  rate  for  layers  thicker 
than  -  25  nm  whereas  the  banded  structures  arise 
first  for  thin  layers  in  agreement  with  the  results 
of  Clark  et  al.  Finally,  a  nonlinear  interaction 
between  the  mean  flow  field  and  the  Williams  domains 
can  ro-orientdto  the  rolls  so  that  there  is  both  a 
change  in  direction  and  length  scale  of  the  micro¬ 
structure.  This  in  turn  is  accompanied  w5th  a  novel 
long  term  'memory  effect'  in  the  device. 


i.  EXPERIMENT 

The  apparatus  consisted  of  two  optically  fiat 
(A/5)  glass  blocks  of  dimensions  10x8xi  cm  mounted  on 
an  INVAR  frame  and  spaced  using  three  micrometers 
which  are  accurate  to  i  0.5  un.  The  lower  block  is 
mounded  on  linear  bearings  and  is  connected  to  a 
large  electromagnetic  vibrator.  The  amplitude  of  the 
applied  vibration  is  measured  both  by  a  linear  dis¬ 
placement  device  and  using  the  Michelson  interfero¬ 
meter  technique  suggested  by  Ben-Yosef,  Ginio  and 
Weitz  (1974). 

The  nematic  liquid  crystal  used  was  108s  TNC 
which  has  a  positive  coefficient,  u^.  This  material 

was  aligned  using  rubbed  PVA  on  the  glass  surfaces. 
The  Williams  domains  can  be  observed  directly  from 
the  scattered  light  and  in  detail  through  a  micro¬ 
scope.  On  the  other  hand  the  ba.ided  instability  were 
observed  using  cross  polars  as  alternate  bands 
correspond  to  211  and  -211  twists  separated  by  thin 
dark  lines  of  zero  twist. 

RESULTS 


Fig.  1.  Stability  curves  for  a  30  urn  cell.  The 
upper  curve  shows  the  lower  limit  of  stability  of 
the  band  made  as  a  function  of  frequency.  The 
lower  curve  is  for  patches. 

The  results  shown  in  figure  I  .re  the  crical 
shear  amplitudes  plotted  as  a  f uncti ,n  of  frequency 
for  a  30  pm  layer.  The  lower  curve  corresponds  to 
the  appearance  of  patches  of  Williams  domains  and 
the  upper  is  for  the  banded  structure.  The  estimate 
of  the  critical  amplitudes  are  obtained  by  fixing 
the  frequency  and  increasing  the  amplitude  of  the 
vibration  in  small  steps  until  the  instability  is 
observed.  Each  instability  has  a  rapid  growth  rate 
and  so  determination  of  a  critical  point  is  relatively 
straightforward.  In  addition,  there  is  no  evidence 
of  any  hysteresis  in  the  transition  and  so  the 
critical  value  can  be  determined  by  the  appearance  or 
disappearance  of  the  instability. 

The  strong  dependence  of  the  critical  ampli¬ 
tude  on  frequency  for  both  instabilities  is  obvious., 
and  their  representative  set  is  typical  for  all 
observations  in  the  range  10-50  um.  For  layers 
thinner  than  20  urn  the  bands  appear  before  the 
patches  with  increase  in  amplitude  and  vice  versa  for 
layers  thicker  than  25  Mm.  The  exchange  of  priority 
between  the  two  types  of  instability  is  an  area  of 
current  investigation. 
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As  observed  by  Clark  et  al  the  bands  fill  the 
whole  cell  and  have  the  form  of  cm-wide  stripes 
separated  by  chin  dark  lines  and  are  orientated  along 
the  direction  of  the  shear.  The  patches  are  generally 
directed  in  the  same  way  but  they  n.-ver  fill  the  whole 
domain,  i.e.  the  patches  are  separated  by  regions 
which  have  r.o  apparent  structure. 

The  number  of  bands  or  patches  is  dependent  on 
the  applied  frequency  and  thicknes  of  the  ceil.  Each 
of  the  states  are  repeatedly  formed  over  a  range  of 
frequencies  w,Lth  quasistatrc  increase  of  amplitude. 

The  exchange  of  priority  between  neighbouring  states 
involves  hysteresis  and-multiplicity  of  states,  i.e. 
two  different  patch  or  band  e_ructures  at  the  same 
supercritical  parameter  values.  An  example  of  this 
exchange  process  is  sketched  in  figure  2  for  the 
change  over  between  two  and  three  patches. 


Fig.  2.  Schematic  of  the  exchange  between  two  and 
three  patches  for  a  50  pm  cell  (a)  15-45  Hj 
(Z  patches)  (b)  45-75  K-  (mixed  mode) 

(c)  75-80  «3  (mixed  connected  mode)  (d)  80-100 
(3  patches) . 

Over  the  lower  frequency  range,  two  patches 
are  formed  while  at  hiqher  frequencies  three  are 
•produced  with  slow  Increase  in  amplitude.  The  inter¬ 
vening  range  is  covered  by  the  interesting  mixed 
mode  behaviour.  Starting  flam  the  low  frequency  end, 
four  small  patches  are  formed  and  one  of  the  pair  on 
a  diagonal  link  across,  swing  through  45°  and  the 
other  two  small  patches  grow  to  form  a  three  patuh 
configuration.  The  process  is  symmetrical  so  that 
the  growth  along  either  diagonal  is  found. 


Fig.  3.  Williams  domains,  (a)  Normal  to  shear 
direction,  (b)  Aligned  with  shear:  note  edge  of 
patch. 

Finally,  we  show  in  figure  3  photocopies, of 
photograhs  of  the  two  types  of  mechanical  Williams 
domains  formed  in  the  patches.  The  ones  showr.  in 
figure  3(a)  are  aligned  at  right  angles  to  the  shear 
and  have  a  wavelength  of  approximately  two  layer 
thickness  depending  weakly  on  frequency.  The  second 
type  shown  in  figure  3(b)  are  aligned  in  the  direction 
of  the  shear  and  have  a  length  scale  approximately 
three  times  Iiorter  than  those  shown  in  3  (a) .  They 
are  formed  i.  the  layer  is  left  in  a  supercritical 
state  for  periods  of  minutes  and  seem  to  arise  from 
an  interact!  >n  with  the  v.«ak  moan  flow  field.  Once 
areas  of  the  cell  have  been  reorientated  like  this 
then  the  ori. station  of  the  Williams  domains  becomes 
the  preferrec  structure  for  periods  of  several  hours. 
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DEFECT  MEDIATED  TRANSITIONS  t-BTWEEN  CONVECTIVE  STATES 
IN  A  NEMATIC  LIQUID  CRYSTAL:  EXPERIMENT  AND  SIMULATION  1 
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91405  Orsay  Cedex,  France 

Abstract-  Hydrodynamical  systems  under  constraint  constitute 
rich" examples  of  pattern-forming  systems  governed  by  nonlin¬ 
ear-differential  equations.  The  basic  solutions  may  be  either 
ordered  states,  or  inhomogeneous  states  including  (structural) 
defects,  for  instance,  the  convection  in  a  nematic  liquid  cry  i 
tal  may  exhibit  a  series  of  structures  leading  tochaos.  We 
study  here  .a  direct  transition  between  two  structures  of  dif¬ 
ferent  symmetry  and  we  show  that  the  defects  play  an  impor¬ 
tant-role  if  the  transformation.  The  complex  evolution  of  the 
physical  system  is  satisfactorily  reproduced  in  numerical  sim 
ulations  using  an.  appropriate  nonlinear  model  of  a  so-called 
“amplitude:  equation”. 

I.  INTRODUCTION, 

A  nenratic  liquid  crystal  subjected  to  an  AC  electric  field 
constitutes  an- example  of  a  pattern  forming  system  that  can 
exhibit-ordered  states  as  well  as  “complex  states”.  As  the  am- 
pli  jde  of  the  applied  field  is  continuously  varied;  the  system 
undergoes  a  series  of  bifurcations  (transitions)  to  ordereu  „on 
vective  structures  of  decreasing  symmetry,  the  Normal  Rolls 
(NR),  the  Oblique  Rolls  (OR),  Varicose,  Bimodal,  and  finally 
the  full  chaotic  state  [1J.  Each  struv..„re  is  characterized  by  a 
global  symmetry.  As  is  the  case  for  every  ordered  otre,  ...  *, 
typical  defects  of  the  ordering  exist  and  they  «ppear  as  jeal 
states  whereby  the  symmetry  is  broken.  The  topology  of  the 
defects  is  related  to  the  broken  symmetry.  For  instance,  it  is 
observed  that  the  Normals  Rolls  have  one  type  of  defect:  the 
(edge-)  dislocation.  It  consists  of  an  extra  pair  of  rolls  added 
to  the  structure  at  some  point  (the  core). 

II.  TRANSITION  FROM  THE  NORMAL  ROLLS  TO 
THE  OBLIQUE  ROLLS  INDUCED  BY  THE  DEFECTS 

We  ha’'e  recently  found  a  direct  transition  from  the  first 
structure,  the  Normal  Rolls,  to  the  second  one,  the  Oblique 
Rolls,  whe.»  two  control  parameters  are  simultaneously  varied 

[2].  The  evolution  of  the  structure  is  first  characterized  by  a 
growing  undulation  of  the  rolls  along  their  axis  (modulational 
instability).  Then,  dislocation  pairs  nuJcate  in  the  bending 
zones  of  the  rolls,  leading  to  the  formation  of  small  Oblique 
Rolls  domains.  As  a  consequence  of  the  glide  motion  of 
the  defects  (motion  perpendicular  to  the  rojl  axis)  the  sue 
of  the  OR  domains  grows  and  very  large  OR  domains  are 
finally  obtained  (OR  structure).  In  this  process,  the  role  of 
the  defects  is  clearly  related  to  their  complex  dynamics,  which 


acts  as  a  local  wavelength  selection  mechanism  (local  tilt  of 
the  rolls)  and  constitutes  an  efficient  mechanism  leading  to  a 
fast;  transition  to  the  OR  structure. 

m  T.  c  .AFION  OF  THE  TRANSITION  FROM 
TL'T  V  \L  ROLLS  TO  THE  OBLIQUE  ROLLS 

ai  a  .  .  this  couple.,  transition  is  actually  un 
tractabiv  c  x  basis  of  die  ‘'microscopic  e>)  .>'itions".  How 
ever,  th;p.  ists  an  alternative  approu;h  lasoJ  on  the  so  called 
amplitude:  quations  [3,4,5].  This  nonlinear  model  describes 
the  eve!..  .  me  2-D  envelope  of  the  rolls,  supposed  to 
vary  slot.  _  .•>  -  -  iarg-.  dtsiam  es  (with  respect  to  the  wave¬ 
length  Ok  u.  jucturey.  4  colocation  corresponds  then  to  an 
isolated  ze  .  o.’  the  (couq-Iex,)  amplitude.  For  some  values  of 
theparameurs  in  the  model  .and  of  the  initial  state,  we  are  able 
to  rimulate’the  observed  NR  --»  OR  transition.  In  particular, 
wc  reproduce  die  initial  modulational  instability,  as  well  as 
the  nucleatjon  of  the  defects,  which  by  their  glide  motion  a;e 
responsible  of  We  formation  of  the  OR  domains. 

IV.  CONCLUSION 

The  convection  in  a  nematic  liquid  v’ystal  provides  a  very 
pertinent  model-for  the  study  of  extended'  .jnlinear  systems. 
The  defects  are  not  merely  a  h.cal  loss  of  order  inside  a  well 
defined  structure.  They  may  play  i  very  important  lole  in  the 
structural  transition  between  two  states  of  different  symmetry. 
We  show  also  that  the  “amplitude  equations"  aie  an  efficient 
nonlinear  simple  model  to  simulate,  at  least  qualitatively,  sue.i 
a  complex  behavior. 

’  This  work  was  supported  by  the  Direction  des  Recherches  et 
Etudes  Techniques  under  contract  DRET/ERS/901616.  The 
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(France). 
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Abstract.  The  classical  \sory  of  TRANK  explains  fn,rly 
well  point  Rejects  that  uiir  in  the  equilibrium 
configurations  of  hemal.,.  ~<quid  crystals,  but  ,t  fails  l< 
describe  both  disclinat ions  ana  surface  defects.  ERICKSEN 
ms  recently  proposed  a  model  that  aims  to  accomodate  all 
defects  in  a  unified  theory.  It  is  shown  here  by  example 
flow  -disclinations  and  surface  defects  fit  into  ERICKSlX  s 
model.  In  both  cases  a  defect  arises  when  a  material 
modulus  attains  a  critical  value. 


Liquid  crystals  arc  fluids  that  exhibit  a  preferred 
direction  which  varies  in  space :  such  a  direction  is  the 
cptical  axisol  the  material.  Tne  orient’tion  of  the  optical 
axis  is  customarily  described  by  a  unit  /ector  field  n.  Here  I 
shall  confomuto  such  a  tradition,  but  I  warn  the  reader  that 
employing  n  tc;describe  the  orientation  of  the  optical  axis 
might  be  inappropriate,  especially  when  one  wishes  to 
model  general  defects,  that  is,  regions  in  space,  of  any 
dimension,  where  n  suffers  discontinuities-  The 
orientation  of  the  optical  axis,  that  one  is  to  represent  L,  n, 
is  unaffected  by  a  reflection  that  changes  n  into  -h 
everywhere.  Thus,  if  n  is  reflected,  say,  across  a  surface,  a 
fictitious  defect  arises  since  the  optical  axis  is  just  the  same 
on  the  two  sides  of  the  surface,  while  n  suffers  a  jump. 

A: way  to  fix  this  up  might  be  to  describe  the  optical 
axis  through  the  tensor  field  defined  by 

(1)  N:=n®n. 

In  general  the  fields  t  and  N  are  not  equivalent  in  the 
whole  region  where  uwy  are  defined.  We  denote  by  E  the 
three-dimensional  Euclidean  sp^ce  and  by  V  its  translation- 
space.  Let  3  be  the  region  of  E  occupied  by  the  liquid  c«y.  wl 
and  let  n  be  a  field  of  B  into  S2,  the  unit  sphere  of  V.  By  (Id 
one  readily  associates  to  n  a  field  N  of  B  into  the  manifold 
N  of  allsymmetiic,  rank-one  tensor  whose  trace  is  1.  On  the 
contrary,  if  a  field  N  of  B  into  N  is  given,  in  general  one 
cannot  retrace  any  field  n  of  B  into  ?2  which  is  related  to  N 
through  (1),  without  introducing  fictitious  defects. 

For  rhe  problems  I  review  here  the  fields  n  and  N  are 
globally  equivalent.  Thus,  I  will  stay  with  n,  though  I  hold 
that?  description  of  the  kinematics  of  liquid  crystals  in  the 
maniioid  N  wants. 

The  degree  of  orientation  of  a  nematic  liquid  crystal  is 
a  scalar  s  that  ranges  in  the  interval  [-1/2,1]  .  It  is  expained 
in  Section  2  of  [1]  how  the  formal  definition  of  s  can  be 


derived  from  the  statistical  distribution  of  molecular 
orientatations.  Qualitatively,  s  measures  at  a  macroscopic 
scale  the  degree  of  microscopic  order,  rjkt-r,  it  may  vary  in 
space  The  end-points  of  the ,  .  :rval  [-1/2,1]  represent  two 
ideal  situations,  when  s  =  -1/  all  the  molecules,  which 
resemble  rods,  are  orthogona.  'o  n,  bw.  do  not  lie  in  any 
preferred  direction,  when  s  =  1  all  the  m  jlecules  are 
parallel  to  each  other.  Whens  vanishes  the  orientation  of 
the  molecules  is  completely  disordered,  at  a  macroscopic 
scale,  this  means  that  the  liquid  crystal  has  become  an 
isotropic  fluid  and  n  makes  no  sense  at  all. 

Vhen,  besides  n,  also  the  degree  of  orientation  s 
comes  on  the  scene,  the  free  energy  per  unit  volume  a  is 
allowed  to  depend  on  both  s  and  its  gradient,  besides  n  and 
its  gradient.  ERICKSEN  has  discussed  in  [1]  a  general 
formula  for  a;  here  we  employ  a  special  case  of  that 
formula: 

(2)  o=K{I|Vs|2  +  s2|Vni2-,y/(s)}; 

both  K  and  lare  positive  constants,  w--  a  .unction  which 
describes  a  double-well  potential  having  h-.  ucei 
minimum  ats  =  0  and  the  absolute  minimum  .u  o  =  sq  > 

0.  The  main  qualitative  features  of  vy  are  described,  for 
examlpe,  in  Section  2  of  [2]. 

Though  there  is  enough  evidence  that  y  often  prevails 
on  the  other  terms  of  (2)  (c/.  [3],  for  example),  I  shall  omit 
if  in  (2)  and  let  its  role  to  be  played  instead  by  a  condition 
that  sets  s  =  sq  wherever  in  9B  n  is  prescribed. 

When  s  is  constant  (2)  becomes  the  one-constant 
approximation  to  FRANKS  classical  energy  that  has  been 
widely  studied  FRANK’S  theory  has  been  successful  in 
solving  a  number  of  problems,  but  defects  other  than  point 
defects  escape  its  scope  (see  [4]  and[5]). 

On  the  other  hand,  line  defects,  also  called 
disclinations,  are  often  observed  in  ordinary  liquid 
crystals,  while  surface  defect?  occasionally  occur  in 
polymeric  liquid  crystals.  The  want  for  a  unified  treatment 
of  defects  prompted  ERICKSEN  to  amend  FRANK’S  theory. 
In  the  new  theory  the  spatial  changes  in  the  degree  of 
orientation  prevent  the  free  energy  from  being  highly 
concentrated  about  defects;  these  are  indeed  to  be  identified 
with  the  regions  where  s  vanishes:  there  the  liquid  crystal 
becomes  isotropic  and  the  optical  axis  has  no  meaning 
whatsoever.  Thus,  the  new  theory  interprets  defects  as 
localized  transitions  of  the  liquid  crystal  to  its  isotropic 
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phase,  although  no  change  in  the  temperature  is  involved. 

The  degree  of  orientation  s  and  the  optical  axis  n  are 
delivered  in  8  by  the  mappings 

s:  B  — >  [-1/2,1]  ,  n :  B'S(s)  -)  S2  * 

where  S(s)  .=  {p  e  B|  s(p)  =  0}  is  called  singular  set. 

The  points  of  the  singular-set  are  the  only  sites  where 
defects  of  n  actually  occur  (c/.  [6]).  Thus,  if  S(s)  £  0,  we 
say  that  n  is  singular,  otherwise  we  say  that  it  is  regular. 

The  total  free  energy  is  the  functional 

F[s,n]  :=k/b  [fc|Vs|2  +  s2|Vn|2  }  . 

The  existence  of  minimizers  for  F  and  the  degree  of  their 
regularity  has  been  established  by  AMBROSIO  (see[7]  and 

[9])  and  LIN  (see.  [6]  and  [8] ).  Building  upon  their  work,  we 
consider  now  two  variational  problems  for  F  whose 
solutions  describe  a  disclination  and  a  surface  defect, 
respectively. 

Let  B  be  a  circular  cylinder  and  let  D  be  the  lateral 
boundary  of  B.  We  prescibe  both  n  and  s  on  D  as  follows 

(3)  n  =  er  ,  s  =  sq  on  D  . 

These  boundary  conditions  are  axisymmetric,  and  so  one 
would  expect  that  the  minimizers  of  F  subject  to  (3)  are 
axisymmetric  too.  Such  a  conclusion  is  in  general-false,  as 
is  shown  in  Section  5  of  [10],  but  here  one  can  prove  that 
the  minimizers  of  F  within  a  quite  broad  class  (which  also 
includes  non-axisymmetric  fields)  are  indeed  axisymmetric 
(see  [11]).  This  variational  problem  was  solved  in  [12]. 

There  we  reached  the  following  conclusion: 

lfk£l  then  F  subject  to  (3)  attains  its  minimum  when 
h  is  radial  everywhere  in  B  and  s  vanishes  along  the  axis 
of  B,  where  there  is  a  disclination.  If  k  >  Lthen  the  field  n 
that  .minimizes  F  subject  to  (3)  is  regular  and  closely 
resemoles  the  celeorated  solution  of  CLADIS  &  KLEMAN 

[13] ,  which  is  fluted  along  the  axis  of  the  cylinder. 

Let  how  B  be  the  region  of  E  between*  two  square 
parallel  plates.  We  call  D+  and  D",  respectively,  the  plates 
that  bouno  P;  we  set  D  =  D+  U  D\  We  prescribe  n  and  s  on 
D  thus: 

n  =  e^  on  D*,  n  =  cosotQ  e^+sinaQ  e^  on  D+,  s  =  Sq  on  D, 

where  ocq  e  ]0,ji[  and  ej ,  are  un‘l  vectors  directed  along 

two  adjacent  sides  of  the  plates.  The  variational  problem 
for  F  subject  to  these  boundary  conditions  was  solved  in 

[14] .  Here  is  tne  .  onclusion  we  reached  there. 

If  it  <  (a.  fn)2  then  F  attains  its  minimum  when  n  is 
discontinuous  at  the  mid  plane  between  D+  and  D",  and 
constant  elsewhere.  If  k  -•  ?aQ  /re)2  then  the  field  n  that 

minimizes  F  >*  regular  and  represents  a  non-uniform  twist. 
Ihus,  for  k  sufficiently  small  a  surface  defect  arises 
between  two  adjacent  domains. 

The  effect  of  a  pofentiallike  y  on  the  occurrence  of 
such  a  defect  has  been  studied  in  [15]  within  a ;  .social  class 
of  minimizers:  the  qualitative  features  of  the  phenomenon 


seem  to  be  unaffected  by  y,  but  the  critical  value  of'fc 
decreases. 
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4X4  MATRIX  OPTICS  THE  "SLOW"  WAY 
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Abstract  -  The  4X4  matrix  method  of  computing 
reflection  and  transmission  by  layered  structures 
can  be  very  fast  if  a  few  simple  mathematical  and 
programming  procedures  are  followed  to  enhance 
efficiency.  Failure  to  utilize  these  procedures 
has  led  to  a  common  misapprehension  that  the  4X4 
matrix  method  is  extremely  time  consuming. 
Structures  with  n-1  regular  periodic  variations 
parallel  to  the  surface  can  be  treated 
approximately  using  a  4nX4n  extension  of  the 
method,  to  which  most  of  these  procedures  for 
enhancing  efficiency  also  apply. 

INTRODUCTION 


matrix  squarings  required  to  get  through  \  would 
be  about  log2{62,800)  =  16,  rather  than  62,800. 

By  using  an  exponential  series  expansion1'4'5 
adroitly,  the  thickness  of  "one  step"  may  be 
increased  to  \  /2n.  For  an  accuracy  of  about  one 

o 

part  in  10  ,  six  matrix  multiplications  are 
required  in  that  expansion.  The  number  of  matrix 
multiplications  required  to  get  through  is  thus 

reduced  to  6  +  log2(2ll)  =  9,  not  16,  much  less 

62,800. 


The  4X4  matrix  method1-3  is  a  generalization, 
for  anisotropic  media,  of  the  Abeles4  double-2X2 
matrix  method  for  computing  reflectance  and  trans¬ 
mittance  of  plane,  isotropic  layered  structures. 
Since  the  4X4  method  was  first  used  to  compute 
reflection  and  transmission  in  twisted  liquid 
crystal  structures3  there  have  been  continued 
attempts  to  find  faster  ways  to  solve  the  problem. 
However,  the  fact  that  many  groups  use  the  4X4 
method  regularly  to  design  twist-  and  super-twist 
cells  with  phase-retarding  plates,  color  filters 
and  polarizers  all  in  the  structure,  attests  to 
its  practicality  if  it  is  efficiently  programmed. 

Closed-form  solutions  for  isotropic  materials4 
and  for  uniaxial  and  biaxial  materials  in  certain 
special  orientations  have  been  known  for  many 
years.1*5  It  was  also  mentioned  in  several  early 
publications1'2* 5  that  the  transfer  matrix  for  a 
uniform  slab  of  any  thickness  could  be  obtained 
through  solving  for  the  eigenvalues  of  the  4X4 
differential  transfer  matrix,  to  obtain  the 

propagation  vectors  of  the  four  optic  modes  in  the 
medium.  The  secular  equation  for  these  modes  was 
given  in  compact  form  by  Teitler  and  Henvis,2 
Eq.16.  Wohler  et  al,6  recently  published  the 
solution  to  the  secular  equation  in  closed  form, 
and  the  resulting  elements  for  the  4X4  transfer 
matrix,  for  a  uniform  layer  of  uniaxial  material 
of  any  thickness  and  any  orientation.  Use  of 
these  solutions  has  recently  been  termed  the 
"fast"  method. 

Host  nematic  twist  cells  can  be  reasonably  well 
approximated  by  using  rather  few,  thick  sub-layers 
of  uniaxial  liquid  crystal.  Host  polarizers  are 
also  uniaxial,  as  are  most  retarding  films.  The 
"fast"  method  is  advantageous  in  these  regions. 

If  the  liquid  crystal  in  the  cell  is  subdivided 
into  very  many  short  segments  for  high  precision 
the  "slow"  method  is  faster  than  the  "fast" 
because  eigenvectors  are  not  computed.  If 
ferroelectric  smectic  displays  and  nematic 
displays  with  high  field  gradients  are  of 
interest,  then  biaxiality  may  be  significant.  The 
"fast"  method  is  then  tedious  and  slower. 

Two  misconceptions  discourage  people  from  trying 
the  "slow"  method,  despite  its  simplicity  and 
possible  speed.  The  first  is  the  supposition  that 
it  is  necessary  to  divide  the  structure  into 
segnents  of  thickness  Tn  that  are  so  thin  that  the 
square  of  the  phase  change  of  the  wave  across  each 
segment  is  negligible;  less  than  the  wavelength  in 

the  medium,  \B,  divided  by  2n-io‘S.  The  second  is 

that  one  must  therefore  multiply  4X4  matrices 
62,800  times  just  to  get  through  a  thickness  of 
one  wavelength  within  the  medium. 

I  had  ■  the  first  misconception  at  the  outset  of 
my  work  with  T.J. Scheffer.  However,  I  used  the 
"nethod  of  repeated  squaring"  to  greatly  reduce 
the  number  of  matrix  multiplications.  This  method 
is  still  the  answer  to  the  second  objection. 
Without  any  other  improvements  the  number  of 


METHODS  FOR  MAKING  EFFICIENT  "SLOW"  PROGRAMS 
A:  Fast  Matrix  Multiplication 

Multiplication  of  two  4X4  matrices  of  complex 
numbers  requires  that  the  computer  find  the  loca¬ 
tions  in  storage  of  16-2-2  =  64  real  numbers,  then 
do  4-4-16  =  256  multiplications  of  real  number 
pairs,  then  32-3  =  96  additions,  and  finally  store 
the  32  sums.  For  the  case  of  8X8  matrix  optics7, 
the  number  of  multiplications,  which  take  most  of 
the  time,  is  2048.  Actual  measurement  confirms 
that  matrix  multiplication  is  the  most  time- 
consuming  part  of  the  fastest  4nX4n  programs  that 
we  have  made  using  the  "slow"  method,  but  when 
n=l,  (4X4  matrix  optics),  it  is  usually  only 
somewhat  longer  than  the  rest  of  the  computation. 

Many  4X4  multiplications  are  to  be  done  even  if 
individual  transfer  matrices  are  to  be  found  by 
the  "fast"  method.  Hence  it  is  important,  in  any 
case,  to  write  an  efficient  matrix  multiplication 
program.  With  most  compilers  a  great  saving  in 
tine  is  achieved  by  writing  out  the  4X4  matrix 
product  elements  explicitly;  avoiding  loops  and 
computed  indexes. 

B:  Repeated  Squaring  Technique 

Let  Tn  designate  the  thickest  layer  for  which 
the  transfer  matrix  can  be  computed  in  "one  step" 
without  making  significant  approximation  errors. 
This  thickness  depends  on  the  method  used,  as  men¬ 
tioned  before.  The  next  problem  is  to  obtain  the 
transfer  matrix  P(T)  over  a  slab  of  thickness 

T  >  Tra  using  the  relation  P(T)  =  P(H)3  P(jH) 
adroitly,  where  H  <  Tn.  The  fastest  method  is  to 


r  \  -  / 
that  j=2n 


j  -  .  Thus  H  =  T/2n,  where  n  is  the  smallest 
integer  larger  than  log2(T/Tn).  Of  course,  if 

T  <  Tm  then  n  =  0,.  H  =  T,  and  no  squaring  is 

necessary. 


C:  Matrix  Differential  Equation  and  Exponential 
Series  Expansion  for  a  Thin  Layer 

The  4x4  matrix  method  starts  with  a  matrix 
differential  equation,  equivalent  to  Maxwell's 
equations,1-7  dfi/dz  =  (2n/\)  where  \  is 

the  vacuum  wavelength.  Contraction  over  repeated 
indexes  is  implied.  ^  is  a  4X4  differential 

matrix  whose  elements  depend  only  on  the  direction 
of  propagation  of  the  incident  beam  and  the 
possibly  complex  optical  dielectric  tensor,  e,  at 
that  level  in  the  multilayer.  (The  principal 
values  of  e  are  the  squares  of  the  principal 
refractive  indexes,  np+ikp) .  The  four-element 

"vector"  V  contains  the  four  electric  and  magnetic 
field  components  parallel  to  the  surface  of  the 
layered  structure,  or  normal  to  the  "z"  axis. 

Lot  S  be  the  sine  of  the  angle  of  incidence  of 
light  fron  vacuum,  and  assume  tnat  e  is  symmetric. 
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Then  the  differential  matrix  is  A  =  ^D/ezz  = 


“sexz 

ezz-s2 

-seyz 

0 

exxezz-exz 

°11 

®xyezz“exzeyz 

0 

0 

0 

0 

1 

°23 

Dl3 

(eyy-s2)ezz-exzeyz 

0 

We  compute  the  P-natrix  from  the  last  surface  to 
the  first.  This  avoids  the  necessity  of  doing  a 
matrix  inversion  at  the  end,  which  saves 
significant  computer  time  arid  programming  effort. 
If  z  increases  in  going  from  the  entrance  to  the 
exit  side  of  the  layered  structure  then  the  solu¬ 
tion  to  the  matrix  differential  equation  in  a 
region  of  invariant  optical  dielectric  tensor  of 
thickness  H  <  Tn  is1!4*5 

V(Z-H)  =  P(-H):Y(Z)  =  [1  -  hA  +  (h^)2/2! 


“  <hA)3/3!  +  (hA)Vi!  -  — 3  s-YCZ) , 


where  h  =  2IIh/\.  P(-H)  is  the  transfer  matrix 

relating  the  field  Y  at  the  side  of  the  layer 
where  the  beam  enters  to  that  at  the  exit  side, 
and  ' ' An-,  defines  the  ij  element  of 

(hA)n-  Accuracy  of  one  part  in  108  nay  be 
achieved  if  no  element  of  h/\  has  magnitude  larger 
than  about  unity,  and  if  the  series  runs  to 

(hA)  U/H!. 

To  find  an  appropriate  value  of  h  for  a  uniform 
layer  of  thickness  T,  first  find  the  square  of  the 
matrix,  Ai^A^j  -  (This  squared  matrix  is  used 
again  in  the  two  series  to  follow,  so  it  is  not 
wasted. )  Find  the  absolute  square  of  and 

°f  A3kAk3  and  select  the  larger.  This  number  is 
the  magnitude  of  the  largest  element  likely  to 
appear  in  A4-  Call  its  fourth  root  Aa-  The 
series  will  converge  rapidly  if  hAn  <  1.  Count 
the  number  of  times,  n,  that  the  layer  thickness  T 
must  be  halved  before  H  «*  T/2n  <  V(2nA  )  Then  n 
is  the  number  of  tines  P(H)  must  be  squared  to  get 
P(T),  and  h  =  2m/\. 

To  achieve  the  eleventh  order  expansion  with  six 
matrix  multiplications,  write 

P(-H)  =  1  +  (hA)Z/2!  +  (hA)4/4!  +  (hA)6/6! 

+  (!>A)8/8!  +  (hA)10/io: 

-hA-(l  +  (hA>2/3!  +  (hA>4/5!  +  (hA>6/7! 

+  (h^)8/9!  +  (hA)10/H!)- 

If  T  <  1/(2!!^^)  =  T-,,  then  the  preceding  two 

series  nay  be  truncated.  Accuracy  of  one  part  in 
10  is  maintained  when  the  tenth  power  terms  are 
neglected  if  log2(T/Tn)  <  -0.9;  the  eighth  power 
if  <  -2-0;  ar.d  the  sixth  if  <  -7.5. 

If  the  medium  does  not  absorb  light,  then  e  is  a 
real  tensor  or  scalar  and  A  *s  then  purely 
imaginary.  Hence  A2  is  a  matrix  of  real  numbers. 
Additional  speed  nay  then  be  obtained  in  such 
. edia  by  writing  a  separate  program  to  multiply 
real  4X4  matrices.  Such  a  program  is  nearly  four 
times  faster  than  one  for  complex  numbers. 
However,  the  special  program  is  useful  only  for 
expanding  the  power  scries,  not  for  subsequent 
repeated  squaring. 

0:  Abeles'  Method  for  Isotropic  Regions 

For  isotropic  media,  exx=eyy=ezz=e«(n+ik}2  and 
exy=syz*ezx”D-  Hence  the  local  4X4  matrices,  A 


and  P(T) ,  have  zeros  in  the  off-diagonal  2X2 
quadrants.  The  4X4  matrix  is  then  composed  of 
Abeles'5  two  2X2  matrices  along  the  diagonal: 


A  = 


o 

e 

o 

o 


i-(s2/e)  o  o 

o  oo 

o  0  1 

o  e-s2  o 


The  square,  h2A^jAkj  *s  3ust  a  constant, 

(complex  if  the  medium  absorbs  light) ,  multiplied 
by  the  unit  4X4  matrix.  That  constant  is 

h2(A12  A21)  =  h2(A34  A43)  =  h2(e  -  s2). 

The  two  series  reduce  to  power  series  in  this 
(possibly  complex)  number.  The  first  series 
generates  the  cosine  and  the  second  (except  for  a 
factor)  the  sine  of  the  number.  These  are  the 
Abeles  closed-form  solutions.  No  matrix 
multiplication  is  required  to  obtain  the  4X4 
transfer  matrix  in  this  case,  but  the  magnitude  of 
the  constant  should  be  less  than  unity,  as  in  the 
more  general  case  of  the  4X4  matrix. 

One  may  prefer  to  use  pre-programmed  functions 
for  the  complex  sines  and  cosines,  which  nay  or 
nay  not  take  account  of  the  slow  convergence 
problen  for  large  arguments. 

There  is  nothing  comparable  to  Abeles'  method 
for  8X8  or  higher-order  matrix  optics.  The 
possibility  of  a  skew  angle  between  the  incident 
bean  and  the  direction  of  the  lateral  periodic 
structure  leaves  open  the  possibility  of  non-zero 
elements  in  any  region  of  the  matrix. 


CONCLUDING  REMARKS 

We  find  that  each  computation  of  reflectance'  and 
transmittance  by  a  supertwisted  nematic  liquid 
crystal  cell  takes  1.53  seconds  using  only  the 
"slow"  neth-d  on  a  386-series  16-bit  16-MHz  PC 
with  math  co-processor,  when  the  following 
parameters  are  used:  The  cell  has  two  1-an  glass 
cover  plates,  two  absorbing  uniaxial  polarizers, 
two  absorbing  InSb  oxide  conductive  layers,  a 
uniaxial  compensating  fractional-wave  plate,  and 
the  non-absorbing  liquid  crystal  is  subdivided 
into  36  layers.  The  "fast"  method  would  enhance 
the  speed  somewhat  in  going  through  the  polarizers 
and  retarding  plate,  but  less  in  going  through  the 
much-subdivided  liquid  crystal. 

If  one  had  a  computer  with  an  array  processor, 
computing  the  transfer  matrix  for  a  uniform  slab 
might  be  about  as  fast  as  computing  a  sine,  cosine 
or  exponential  on  a  single-processor  computer.  In 
that  case  the  "slow"  method  might  be  somewhat 
faster  than  the  "fast"  method  of  4X4  matrix 
optics,  especially  for  biaxial  materials,  since 
the  eigenvector  problem  would  be  avoided  at  each 
different  layer.  However,  an  array  processor 
could  probably  be  used  to  better  advantage  in 
liquid  crystal  cell  simulation  to  run  several 
different  wavelengths  or  directions  of  incidence 
simultaneously.  For  8X8  and  higher  order  matrix 
diffraction  problems  the  potential  for  faster 
matrix  multiplication  with  an  array  processor 
night  enhance  the  speed  considerably. 
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Abstract 

Numerical  calculations  of  director  configurations  am!  eleclrooplical 
cliaracteristics  in  symmetrical  ami  iionsyiunietrical  nematic  layers 
arc  presented,  when  weak  anchoring  in  the  tilt  mid  twist  angle  of 
the  director  is  assumed.  In  cells  with  Instabilities  wo  investigate  the 
influence  of  the  anchoring  parameters  and  dev  ire  parameters  on  the 
width  of  the  hysteresis.  Using  the  •!  x-l-inalri.y  formalism  ol  1 5  Ml  Ilf. - 
man,  we  demonstrate  the  influence  of  the  weak  anchoring  on  the 
transmission  vs.  voltage  characteristic  and  GIB  color  coordinates. 

Our  main  emphasis  was  to  implement  an  elficieiiLcode  which  works 
properly  and  fast-over  a  hroail  range  of  material  aud  device  param¬ 
eters. 

1  Introduction 

The  director  configuration  in  twisted  nematic  layers  like  TN||J., 
OMI[2j-  or  SBE(3]-cc!ls  is  determined  by  the  following  three  major 
features:  first,  the  elastic  forces  in  the  liqird  crystal,  described  by 
the  well  known  Frank-Osecn-Zochcr  free  energy  density.  Second,  the 
influence  of  an  external  applied  voltage  modeled  through  an  electric 
energy  term  of  the  form  where  D  is  the  displacement  vector 
and  />  the  internal  electric  field  vector,  and  third,  the  anchoring  of 
the  director  at  the  substrate  boundaries  of  the  layer.  Itcccntly,  some 
experimental  studies  of  the  anchoring  have  been  published^,  0,  Gj, 
showing  that  typical  values  of  the  anchoring  energy  arc  in  the  range 
10"6N/m  to  10-5N/tn  for  horncotropicaliy  anchored  nematics  and 
10"®N/m  to  10-3N/m  for  planarly  oriented  nematics.  In  the  last 
ease,  the  twist  anchoring  energy  is  one  order  of  magnitude  smaller 
than  the  tilt  energy. 

In  the  following,  the  two  kinds  of  anchoring  are  combined  and 
studies  are  presented  of  the  influence  on  the  hysteresis  width  and  on 
the  clcctrooptical  properties  in  symmetrical  as  well  as  in  nonsyrn- 
metrical  cells. 

2  Theory 

We  consider  a  nematic  cell  of  thickness  d  located  between  the  planes 
t  =  0  and  z  =  d  of  a  Cartesian  coordinate  system.  The  director  if  is 
described  by  the  lilt-angle  0  (measured  from  the  layer  normal)  and 
the  twist  angle  <p.  The  dielectric  constants  arc  denoted  by  cjj  and  c^. 
The  elastic  constants  for  splav,  twist  and  bend  are  denoted  l»v  l;tl, 
A-jj  and  A-jj  respectively.  The  pilch  of  the  material  induced  through 
a  chiral  dopant  is  named  jyj. 

Using  the  abbreviations 

ot  =  A-jj  cos7  fl  +  A'n  sudd 
n2  =  (A'ayCOS7  0  +  A'22  sin7  0)  sin7  0 
n.l  =  pjA'jjsin7  0 
^  =  fq(«JL  +  Ac  cos7  0), 

the  free  energy  density  in  the  Imlk  can  lie  written  as: 

Id  =  ^O|0'1  +  \nt'p'7  -  nj¥>'  -  (2) 

where  the  prime  indicates  differentiation  with  respect  to  z  and  where 
is  the  electric  potential  inside  the  layer.  Note  that  the  last  term 


represents  the  electric  contribution  when  we  assume  a  dicier* 

trie  material  law  for  uniaxial  nematics  in  the  form: 

Di  =  (ejAy  +  Ac  n(Oj)Ejt  13) 

with  Kj  Sl  — t)/K 

The  n.ak  am  Inning  in  the  tilt  and  twist  angle  at  the  lop  and 
bottom  of  the  cell  is  described  by  a  surface  free  energy  of  the  llaptm- 
I’apmrlar  typc[7j: 

=  K/sitt7(0(<f)-^)  +  iC^irt7(v'(./)-v'r)  ‘  ' 

The  factors  C^'1  resp.  measure  the  anchoring  strength  itt  the  till 
attd  twist-angle  respectively,  (pretilt)  describe  the  preferred  till 
nttglc  of  the  director  at  the  surfaces,  vv(prclwist)  is  the  difference 
between  the  preferred  orientations  in  tire  twist  angle  at  the  top  and 
bottom  surface.  The  influence  of  the  sitrfacc  is  restricted  to  the  place 
of  the  aligning  substrate. 

The  total  free  energy  per  unit  area  of  the  cell  is  now  given  by: 

r/A  =  Jofndz+r^  +  r*  (5) 


3  Numerical  Procedure 


The  first  step  in  the  calculation  of  optical-properties  consists  in  the 
determination  of  the  director  configuration.  To  this  end,  we  trans¬ 
form  the  Eulcr-Lagrangc  equations  resulting  from  the  extrcmalisa* 
lion  of  the  bulk  free  energy  into  a  system  of  Hamilton  equations  by 
performing  a  hcgondrc.lransfnrmation  with  respect  to  the  variables 
0,  ip  and 


(fi) 

where  jfc-Vt  the  Legendre  transform  of  In'- 

lh(0,r,  (0  =  0T  +  v?'/'  +  *'{/  -  In,  (7) 

and  b,  r=  i— f, i  a  I, -I,  and  T./’.N  are  the  conjugated  momenta: 


/■ 

/' 

U 


•^=njV-'-oa 

3*  = 


(*) 


As  <f  and  ■h  are  cyclic  variables,  the  corresponding  momenta  /’  and 
V  represent  integration  constants  for  the  problem,  lo  tliese  cipia- 
lions  we  have  to  add  the  boundary  conditions  expressed  in  the  new 
variables  at  z  s  0: 


T  =  +'-^  =  CJsin(0-t?)cos(0-t?) 
/’  =  ■=  Cjsinv>cos^5, 
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and  the  corresponding  equations  at  z  — rf. 

The  equations  (G)  and  (9)  represent  a  nonlinear  boundary  value 
problem,  which  we  solve  numerically  by  a  multidimensional  shooting 
method  using  standard  library  routines. 

The  second  step  is  to  solve  the  Maxwell  equations  inside  the  layer. 
For  this  problem  we  use  the  4  X  4  formalism  of  Berreman[8,  9]. 

On  a  IBM  PC/AT  with  10  MHz,  for  instance,  the  calculation  of  an 
clcctrooptical  characteristic  needs  about  len  minutes  independent  of 
the  existence  of  bistabilities. 

4  Results 

4.1  Director  Configurations 

In  fig.  1,  we  show  director  configurations  for  a  symmetrical  anil  non- 
symmetrical  90*-TN-ccll  with  Oj,  =  $0°  and  (?/  =  10-4N/m  in  both 
cells;  C{.  is  10“4N/m  whereas  Cj  is  10“*K/m  for  the  nonsymmetrical 
cell.  The  parameter  for  the  curves  is  the  applied  voltage. 


Figure  1:  Director  configurations  for  asymmetrical  (lop)  and  for  a 
nonsymmetrical  (bottom)  TN-cclI  with  =  G9*;  material  parame¬ 
ters  arc  fjj-  =  0.885,  0.-138, eg  =  8,tx  =  3-5;  the  cell  thickness 

is  5.G/tm. 

With  increasing  voltage,  the  director  tries  to  align  parallel  to  the 
applied  electric  field,  c.g.  the  till  angle  decreases,  whereas  the  twist 
becomes  more  and  more  nonlinear. 

4.2  Width  of  the  Hysteresis 

In  highly  twisted  celts  with  nonzero  pretilt,  there  is  the  possibility 
of  bistable  director  confignralions(lO],  which  becomes  evident  by  a 
hysteresis  in  the  0„  vs.  voltage  curve.  In  fig.  2,  we  have  plotted  the 
width  of  the  hysteresis  AV  for  a  symmetrical  cell  as  afunclion  ofCv. 
and  yP  for  fixed  Ce  =  lO^N/m  and  6f  —  15*;  i'-o  is  chosen  in  such  a 
way,  that  it  matches  yr.  We  get  a  monolomc  increase  of  Av  in  y-. 
Further,  it  can  he  Seen  that  for  fixed  yr,  the  width  of  the  hysteresis 
falls  with  dccreasing-C,.. 

•1.3  Transmission  vs.  Voltage  Curves,  Color  Coordi¬ 
nates 

One  of  the  most  important  features  for  a  twisted  nematic  layer  Is 
its  transmission  vs.  voltage  characteristic.  In  fig.  3  (left),  tee  show 
these  enrves  for  a  M*-TN-reII  for  which  the  surface  parameters  ate 
the  same  as  in  section  1.1,  except  that  we  vary  ffj,. 

It  is  seen,  that  an  increase  in  the  asymmetry  of  the  ceil  decrease* 
the  optical  threshold  voltage. 

The  color  coordinates  of  the  cell  with  the  applied  voltage  a*  p», 
rameler  are  shown  in  the  right  of  fig.  3.  The  cell  with  the  greatest 
asymmetry  gives  smallest  color  changes. 


Figure  2:  Hysteresis  width;  Material  parameters  are  gj  =  2.1,  {“  = 
O.d,  eg  =  20,  tj.  =  10;  the  cell  thickness  is  5.G/im. 


Figure  3:  Left:  Transmission  vs.  voltage  characteristic  the  optical 
birefringence  indices  arc  it9  —  1.5  and  nt  =  I.G5,  polarizer  and  an¬ 
alyzer  arc  parallel;  the  solid  line  represents  the  curve  for  =  S9*t 
the  dashed-dotted  line  for  =  79*,  the  dashed  line  for  =  G9*. 
Right:  Corresponding  color  coordinates 
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Abstract-  Within  the  general  field  of  pattern  formation  studies,  one  of 
the  most  interesting  situations  corresponds  to  the  analysis  of  a 
transient  dynamical  evolution  to  a  stable  steady  pattern.  Here  we  will 
deal  with  a  particular  realization  of  such  a  process  which  connects 
two  homogeneous  steady  states  through  a  transient  inhomogeneous 
structure.  The  problem  will  be  here  addressed  in  relation  with  the 
Freedericksz  transition  in  nematic  liquid  crystals.  The  general 
nematodynamic  equations,  incorporating  hydrodynamic  contributions 
and  internal  degrees  of  noise,  will  adopt  the  form  of  a  Time 
Dependent  Ginzburg  Landau  model.  The  pattern  dynamics  is 
monitored  in  terms  of. the  temporal  evolution  of  the  structure  factor 
for  the  orientational  fluctuations. 

I.  INTRODUCTION 

The  magnetically  induced  Freedericksz  transition  occurs  in  a 
nematic  slab  when  the  director,  describing  the  state  of  orientation  -  of 
the  nematic  molecules  inside  the  sample,  reorientates  following. an 
applied  magnetic  field  larger  than  a  critical  one  Hc.  The  standard 
description  corresponds  to  the  appearance  of  distortions  in  the 
orientation  with  respect  to  the  original  one,  the  degree  of  distortion 
being  homogeneous  in  each  plane  of  the  sample,  and  of  maximum 
intensity  in  the  mid  plane  far  from  the  plates  limiting  the  nematic 
material  [I], 

This  simple  picture  of  the  Freedericksz  instability  is  however  too 
simplified  to  account  for  some  experimental  observed  facts.  Under 
appropriate  conditions,  transient  spatial  structures  are  found 
corresponding  to  modes  of  inhomogeneous  distortions  in  the  planes 
of  the  sample.  A  wide  experimental  evidence  of  this  phenomenon, 
[2,3],  supplemented  with  detailed  theoretical  analysis,  [4,5],  have 
been  accumulating  during  these  past  years.  The  suggested 
explanation  involves  a  dynamical  coupling  between  the  director  field 
and  the  hydrodynamic  motion  associated  with  the  reorientation  .  Such 
a  coupling  gives  rise,  during  the  transient  process,  to  spatial  domains 
with  a  well-defined  periodicity. 

The  characteristic  wavenumber  of  these  transient  patterns  has  been 
commonly  described  in  terms  of  a  most  unstable  mode.  A  linear 
analysis  of  the  nematodynamic  equations  around  the  initial 
undistorted  configuration  identifies  the  mode  of  fastest  growth.  It  is 
assumed  that  this  mode  dominates  the  transient  dynamics.  However, 
this  approach  although  useful  in  understanding  the  main  physical 
ingredients  involved. in; the  phenomenon,  is  far  less  valid  if  one  is 
interested  in  the  dynamics  of  the  pattern  formation  process  itself. 
With  this  specific  aim  we  have  recently  proposed  a  model,  [4],  which 
permits  us  to  identify  the  basw  ume  scales  governing  the  reorientation 
of  the  nematic  sample. 

The  analysis  is  based  on  the  evolution  equation  for  the  time- 
dependent  structure  factor  which  describes  the  orientational 
distortions  of  the  director,  once  thermal  fluctuations  and 
hydrodynamic  effects  have  been  taken  into  consideration.  A  central 


role  is  played  by  an  effective  viscosity  which  accounts  for  a  tradeoff 
of  rotational  for  shear  viscosities  leading  to  a  compromise  at  some 
intermediate  nonzero  wavenumber  for  which  the  increase  m  elastic 
energy  contribution  is  favorably  balanced  by  a  higher  energy 
dissipation  rate  In  what  follows  we  will  describe  this  behavior  for 
the  simplest  realizations  of  the  magnetically  induced  Freedencksz 
transition. 


D.  PATTERN  FORMATION  EQUATIONS 


The  simplest  geometry  we  can  envisage  corresponds  to  a  twist 
geometry.  In  this  situation  the  sample  is  contained  between  two 
plated  perpendicular  to  the  z  axis.  The  director  is  initially  aligned 
along  the  x  axis,  and  the  magnetic  field  is  applied  along  the  y  axis. 
The  transient  behavior  we  will  describe  corresponds  to  the  switch  at 
t=0  from  an  initial  value  H,  <  Hc  to  a  final  one  H>HC.  Under  these 
conditions  it  has  been  experimentally  shown  that  in  addition  to  the 
usual  twist  deformations  along  the  z  axis,  the  system  may  transitorily 
develop  a  more  complicated  structure  involving  bend  modes  along  the 
x  direction  (Fig.  1). 


F1G.1  Photomicrograph  of  uniform  periodic  structure.  Field  strengh  7.4kG; 
temperature  25°C;  sample  thickness  50  pm;  spacing  between  stripes  «■  48  pm. 
(Rcpnnted  from  Y.  W.  Hui  et  at.  J.  Chcm.  Phys.  S3. 288  (1985)) 


The  appropriate  scheme  of  nematodynamic  equations  is  here  used 
assuming  for  simplicity  that  macroscopic  flow  exists  only  along  the  y 
direction,  and  that  homogeneity  extends  on  the  direction  of  the 
applied  magnetic  Field.  For  typical  on-plane  reorientations  we 
introduce  the  dinamical  variable  $  as 

n„  u,z)=  cos^U.z) , 

n/(x,r)=  siniU.z)  ,  (1) 

/ix=0  - 

A  minimal  coupling  approximauon  is  then  invoked  to  obtain  a  pair  of 
closed  equations  for  $  and  vy; 
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The  Gaussian  random  forces  appearing  in  the  above  Langcvin-type 
equations  satisfy,fluctuatibn-dissipation  relations  in  terms  of  pure 
rotational  and  shear  viscosities,  respectively  yi  and  .  L  and  p 
stand  respectively,  for  a  linear  transversal  dimension  and  the  mass 
density  of  the  sample.  A  series  of  technical  manipulations  are  then 
strictly  convenient.  First,  one  introduces  the  hypothesis  of  negligible 
inertia  which  enables  us  to  obtain  a  closed  equation  Jr  the 
deformation  angle.  This  equation  is  more  easily  handle-'  in  .r  of  a 
Fourier  representation  appropriate  to  the  strong  boundary  o  aitions 
prescribed  for  the  nematic  at  the  limiting  plates,  z=id/2: 

cos<2m  + 1  , 

m  q-  d 


$(xtz;f)=*  22^,(^cos{2m  +\)Zj-c<q'* , 

tn  qt  d 


(3) 


.  1TZ  «tX 


n,„u.2,n=2  !EK.,,!i')cos(2m  +  n-? 

” «,  " 

The  resulung  equation  for  die  amplitude  of  the  reonentauonal  mode  is 

given  by 


ri 


[ XaH2~K2i(2m 


e=__k__ 

(2m  +  l)-j~  Y'  Y'  Vc+V^Q'2 
The  important  point  to  be  noticed  is  that  the  temporal  evolution  of 
the  reonentauonal  process  is  no  longer  dictated  by  the  pure  rotational 
viscosity  yi  but  is  governed  by  an  effective  wavenumber  dependent 
viscosity  ft  .Thus,  the  coupling  of  the  director  and  velocity  fields 
results  in  a  reduction  of  the  viscosity  for  all  modes  with  qx  *  0.  This 
permits  modes  of  bend  deformation  along  the  x  direction  to  grow 
faster  than  the  homogeneous  one,  giving  rise  to  pattern  structuration. 
Actually,  for  H  >  Hc  =  (K22tt2/Xad2),  K22  being  the  twist  elastic 
constant  and  ihe.anisotropic  diamagnetic  parameter,  twist  modes  of 
wavenumber  m  become  unstable.  However  due  to  the  dependence  of 
Yi  on  qx,  bend  modes  with  qx  =  0  may  lead  the  response  of  the 
system  provided  that 


.  h2(m)>  1+— , 
*12  a 

l‘=a\/y,)]n  rt=ij1/rjc 


AJ(»i)s//2/{(2m  -fl)2//,?] 
ft 2 ~  “y y  |l 1  -f  A)  , 

1/j  =  V,  , 


(5) 


where  K33  is  the  bend  elastic  constant  and  the  remaining  parameters 
in  (5)  are  convenient  and  standard  redefinitions  of  nematic 
vnositics.  Thus,  one  predicts  the  appearance  of  a  periodic  pattern 
for  magnetic  fiels  satisfying  the: above  condition.  This  occurs  for 
fields  not  much  larger  than  the  critical  one  h?  =  1,  although  there  still 
exists  a  range  of  magnetic  intensities  for  which  the  homogeneous 
response  dominates. 

The  early  dynamical  stages  of  the  transition  can  be  easily  followed 
by  converting  Eq.(4)  into  an  equation  for  the  structure  factor.  Using 
standard  methods  one  obtains 
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(6) 


A  convenient  way  of  monitoring  the  dynamical  emergence  of  the 
pattern  consists  in  analyzing  the  time  evolution  of  the  mode  CW 
corresponding  to  the  maximum  of  the  structure  factor  for  the  most 


unstable  twist  deformation  mode  (m=0).  This  is  depicted  in  Fig  2 

Oman 


FIG.2  Maximum  of  the  structure  Factor  vs.  time  (taken  adimensionalized  in  units 
of  to  =  Yl  7  XaH? ).  Parameter  values  concspond  to  those  of  MBB  A  (Rcf.4). 


Different  and  well-resolved  time  scales  can  be  distinguished  in  this 
figure.  A  first  time  scale  is  associated  to  the  sharp  increase  of  Qmax 
when  the  systermtakes  off  from  the  initial  conditions.  This  time 
should  be  interpreted  as  the  characteristic  time  of  appearance  of  the 
periodic  pattern.  A  second  time  scale  for  the  slow  growth  of  Qmax  is 
reasonably  associated  with  the  development  of  the  inhomogeneous 
structure.  Late  stage  dynamical  scales  accounting  for  the 
dissapearance  of  such  transient  patterns  can  not  be  described  within 
the  limits  of  this  approach  and  instead,  a  proper  analysis  of  the 
mobility  and  recombination  of  defect  walls  is  more  adequate  [6] 
Sometimes,  the  transient  nature  ot  the  predicted  periodicity  is 
already  apparent  within  the  linear  approximation  here  used.  This  is 
for  example  the  case  for  slightly  supercritical  conditions  in  the  splay 
geometry  [7],  as  shown  in  Fig  3.  This  situation  is  relevant  to  recent 
experiments  for  the  electrically  induced  Freedericksz  instability  [8] 


FIG.3  As-in  Fig.  2,  but  corresponding  to  the  transversal  component  of  the 
structure  factor  for  the  splay  geometry  (Rcf.7). 
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DIRECTOR  PATTERN  AND  OPTICAL  PERFORMANCE 
OF  2D  INHOMOGENEOUS  NEMATIC  LC  LAYERS 

M.  Schmidt,  M.  Grigutsch  and  H.  Schmiedel 
UniversitSt  Leipzig,  Sektion  Physik,  Linnestrafie  5,  0-7010  Leipzig 


Abstract-We  present  a  numerical  computation 
of  director  configurations,  switching 
behaviour  and  optical  performance  of  a 
nematic  liquid  crystal  (LC)  layer  in  two 
dimensional  inhomogeneous  (2D)  electrical 
fields.  Coupling  between  director  deformation 
and  electrical  field  is  fully  included.  The 
computations  are  applied  to  LC  spatial  light 
modulators  (SLM).  For  the  first  time  the 
anisotropy  of  the  modulation  transfer  func¬ 
tion  of  SLM  is  specified.  Its  dependence  upon 
device  and  LC  material  parameters  is  studied. 

I.  INTRODUCTION 

Usually,  a  nematic  LC  display  is  treated  as 
a  stratified  medium.  The  corresponding  one 
dimensional  theory  is  well  understood  /l/. 
The  optical  performance  of  an  LCD  is  computed 
in  two  steps:  First,  the  distribution  of  the 
optical  axis  n  in  the  LC  layer  (  director 
pattern  )  is  determined  from  continuum  theory 
/3/ .  Second,  the  optical  properties  of  the 
display  are  computed,  commonly  with 
Berreman's  4x4  matrix  formalism  /2/  for 
stratified  media  /1,5/. 

In  practice  the  optical  response  of  the  LC 
often  depends  on  a  spatially  non-uniform 
electric  field,  resulting  e.  g.  from  pixel 
structures  on  matrix  displays  or  intensity 
distributions  on  a  photo  conductor  in  LC  SLMs 
/6/ .  With  the  ever  decreasing  display 
structures,  director  patterns  in  spatially 
inhomogeneous  fields,  limits  of  spatial  and 
temporal  resolution  of  LC  layers  and  their 
optical  performance  become  important. 


II.  CALCULATION  OF  DIRECTOR  PATTERNS 

We  consider  a  nematic  layer  of  thickness  d 
between  the  planes  z=0  and  z=d  of  a  Cartesian 
coordinate  system  under  the  influence  of  an 
electrostatic  potential,  with  boundary 
conditions  for  the  director  tilt  angle  0  and 
the  potential  V: 

O(x,z=O)=0o  O(x,z=d)=0o  (1) 
V(x,z=0)=Vo  V(x,z=d)=Vi(x)  (2) 

We  restrict  ourselves  to  constant  twist  angle 
0  and  two  principal  cases  of  director 
alignment:  in  the  xz-plane  of  the  field 
inhomogeneity  (0=0),  and  perpendicular  to  it 
(0=90*).  We  assume  invariance  in  y-direction. 

Our  aims  are:  1)  the  determination  of  the 
equilibrium  director  pattern  0(x,z)  and 
corresponding  electric  potential  V(x,z);  and 
2)  the  compitation  of  the  director  response 
to  sudden  changes  in  Vi(x).  The  second 
problem  can  be  treated  as  follows:  Since  the 
time  constant  of  the  electric  field  is  much 
smaller  than  that  of  LC  dynamics,  we  assume 
the  electric  field  to  be  quasi-static  and  for 
a  given  director  pattern  0(x,z,t)  the 
corresponding  potential  V(x,z,t)  is  found 
from  the  equations  of  electrostatics  of 
inhomogeneous  media: 


(ej_+Acca0)  vxx+2Acsece  (vxz-vxex+v2ez)  + 

+  (c_l+Acs20)  Vzz+A c  (c20-s20)  (Vx0z+Vz0x)  =0 

for  0=0  (3a) 

cJLVxx+(cjL+Acs2e)+2Acsec0V20z=O  for  0=90*  (3b) 

(  vi^.-a2v/sia j ,  ei=a0/ai,  se=sine,  ce=cose  ) 

Ae=(c n-cx) ,  cu  and  Cj_  are  the  dielectric 

constants  parallel  and  normal  to  n,  resp.  Now 
we  integrate  the  nematodynamic  equations  4a, b 
for  0(x,z,t)  /3/  keeping  V(x,z,t)  constant 

during  each  integration  step.  Inertia  and 
backflow  are  neglected. 

*  Iet=axx  (K1s2e+K3c2e)  +0zz  (Klc2e+K3s20)  + 

+  (K3-Kl)  sace  (2exz-02+e2) >  (K3-Kl)  (c20-s20)  exez 

+COAC(S0C0(V2-V2)  +  (C20-S20)VXVZ) 

for  0=0,  (4a) 

7l0t=K20xx+0zz(Klc20+K3s20)  + 

+(K3-K1)sec002+coAcs0c0V2  for  0=90*. (4b) 

The  are  LC  elastic  constants,  ? 3  is  the 

rotational  viscosity.  We  repeat  this 
procedure  to  compute  the  complete  director 
response  using  a  finite  difference  method 
/4/ .  The  resulting  set  of  ordinary  equations 
is  solved  by  a  relaxation  method.  An  implicit 
time  integration  scheme  is  applied. 

This  procedure  is  applicable  as  well  to  the 
computation  of  the  equilibrium  director 
pattern.  However,  we  prefer  a  faster 
approach.  Eqs.  (3,4)  without  the  dissipative 
term  y_j0t  are  coupled  self-consistently.  They 

are  solved  by  a  multigrid  relaxation  method 
/4/  which  speeds  up  computation  remarkably. 


III.  OPTICAL  PERFORMANCE  OF  A  2D-DEFORMED 
LIQUID  CRYSTAL  LAYER 

Now  we  calculate  the  optical  performance  of 
the  untwisted  nematic  layer  with  a  given 
director  tilt  profile  0(x,z).  For  normal 
light  incidence  and  a  director  tilt  profile 
varying  in  x-direction  slowly  compared  to  the 
wavelength  \  of  the  light  we  can  use  the 
geometrical  optics  approximation  (GOA)  11/ 
and  describe  the  light  propagation  inside  the 
LC  layer  as  locally  one-dimensional.  The 
transmitted  intensity  is 

T(x)=sin2(  2x(ne,eff(x)-n0)  )  (5) 

with  nQ,  ng  and  ng  eff(x)  being  the  ordinary, 

extraordinary  and  effective  extraordinary 
refractive  indices  of  the  nematic. 


806 


IV.  OPTICAL  PERFORMANCE  AND  RESOLUTION  OF  SLM 

We  consider  a  transmissive  SLM  consisting 
essentially  of  LC  layer  and  photoreceptor. 
Resolution  and  field  fringing  of  the 
photoreceptor  have  been  investigated  recently 
/6,8/,  the  influence  of  the  LC  layer  was 
however  neglected,  in  this  paper  we  study  the 
resolution  capability  of  the  LC  layer  and 
calculate  the  optical  response  to  harmonic 
boundary  voltage  distributions 

Vi(x)  =  Vo  +  |  vi(t)(l-cos[2E])  (6) 

which  are  caused  by  periodic  intensity 
modulated  stripe  patterns  imaged  at  the 
photoreceptor.  In  the  following  we  set  the 
potential  at  the  second  electrode  Vo=0.  For 
given  material  and  device  parameters  one  has 
to  compute  now  the  electro-optic 
characteristics  between  crossed  polarizers 
from  the  one-dimens_ional  theory.  Optimum  bias 
Vo  and  amplitude  Vi  are  determined  by  the 
requirement  of  maximum  contrast  and  minimum 
response  time.  In  the  computation  we  used  the 
parameters  Ki=11.3pN,  K2=8pN,  K3=12.5pN, 
e  n=24 . 8,  ex=6.4,  0Q=O,  ne=1.610,  nQ=1.489, 

?j=78.3mPas,  A=550nm,  d=0. 010mm.  We  compare 

two  possible  switching  regions;  switching 
between  the  first  two  extrema  _of  the 
transmission  vs.  voltage  curve  (Vo=0.94V, 
Vi=0'.  27V)  t  and  between  the  last  two  extrema 
(Vo=1.51V,  Vi=0.76V)-.  Figure  1  shows  the 
transmitted  intensity  as  a  function  of  x  for 
0=0  and  0=90*  and  both  switching  regions 
calculated  according  to  eq.  (5)  with  an 
assumed  grating  constant  g=0. 020mm. 


Fig.  1.  Light  transmittance  as  function  of  x. 
0=0  for  curves  1,3,  and  0=90*  for  2,4. 
Switching  between  the  first  two  extrema 
(1,2)  and  the  last  two  extrema  (3,4). 

One  can  see,  that  imaging  is  always  better 
for  0=90*  compared  to  0=0.  The  0=0 
transmission  curve  becomes  strongly 
asypnetric  in  the  high  voltage  region.  This 
was  already  expected  from  eqs.  (3a), (4a) 
whereas  eqs.  (3b), (4b)  are  invariant  with 
respect  to  a  transformation  x  ->  -x. 

Usually,  the  modulation  transfer  function 

MFT  =  (T  -T  ,  ) / (T  +T  ,  )  (7) 

max  oin  box  min  '  7 

is  introduced  to  characterize  the  resolution 
capability  of  the  layer.  T  and  T  are 

min  box 


Fig.  2.  Time  development  of  transmittance  for 
0=90*  when  Vi  is  switched  from  0  to  0.76V 
in  the  high  voltage  switching  region 
(cf.  curve  4  of  fig.  1).  The  parameter 
gives  the  time  in  ms  after  switching  Vi . 


MTF  t  (tniKatnln)/(IniH*(nln)  in  y. 


Fig. 3:  MTF  as  a  function  of  the  grating  g  for 
the  0.01mm  cell  (  notation  of  the 
graphs  corresponds  to  that  of  fig.l  ). 


the  minimum  and  maximum  transmittances  of  the 
read  beam.  Fig.  3  shows  the  MFT  vs.  grating 
constant  g.  The  contrast  decreases  rapidly 
with  decreasing  g  and  reaches  a  saturation  at 
large  g.  The  calculations  show  that  the 
resolution  of  ah  SLM  improves  with  decreasing 
layer  thickness  d  and  large  Ae/ej_.  It  is 

optimum  at  K3/K1SI  .  For  0=90*  the  resolution 
is  higher  with  decreasing  K2.  Resolution  can 
be  further  improved  by  raising  the  surface 
pretilt  angle  up  to  6o=10*. 
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Abstract  -  Numerical  modelling  has  been  used  to  optimise  the 
performance  of  liquid  crystal  displays.  The  modelling  and 
optimisation  are  described,  and  the  predicted  performance  is 
compared  with  that  of  actual  displays.  The  accuracy  of  the 
modelling  permits  its  use  in  LCD  fault  diagnosis  and  as  a  research 
tool  in  exploring  novel  liquid  crystal  systems. 

I.  INTRODUCTION 

Liquid  crystal  displays  (LCDs)  are  being  used  in  an  ever-increasing 
variety  of  applications.  Although  the  bulk  of  the  LCD  market  is 
still  in  simple  watch  and  calculator  displays,  their  use  as  complex 
alphagrapnic  panels  for  lap-top  computers,  portable  televisions, 
car  and  cockpit  instrumentation,  and  in-flight  entertainment 
systems,  is  growing  rapidly.  These  high  added-value  products  need 
to  be  well-tailored  to  the-customer’s  requirements,  so  that  the 
ability  to  optimise  their  performance  has  become  increasingly 
important.  Whereas  the  simple  watch  displays  can  be  designed 
analytically  or  by  rule-of-thumb,  complex  displays  and  those 
requiring  good  off-axis  performance  must  be  optimised  using  a 
numerical  model.  This  paper  describes  the  metnods  adopted  at 
GEC  for  this  purpose  and  presents  some  examples  of  our  results, 
comparing  the  predicted  performance  with  that  achieved  in 
practice. 

II.  NUMERICAL  MODEL 

The  modelling  problem  falls  into  two  parts.  First,  the  LC  director 
profiles,  i.e.  n(*.) ,  must  be  calculated  for  the  different  display 
states  and,  second,  the  optical  properties  of  these  must  be 
calculated.  We  follow  the  methods  developed  by  Berreman  [1], 
and  find  then(z)  that  both  satisfies  the  boundary  conditions 
imposed  by  the  cell  construction  and  the  applied  voltage,  and  is  a 
minimum  of  the  total  Helmholtz  free  energy  F  where 

2  F  -  K  nCdfun)2*  Kn(n.curln-  2n/P)*  +  K„(nx  cur  In)*  *  D.E  ( 1 ) 

Here  the  A', ,  are  the  elastic  constants  and  F  the  cholesteric  pitch 
of  the  LC  fluid.  The  device  is  assumed  uniform  in  the  plane  of 
the  LC  so  that  n  and  D  are  functions  of  z  alone.  Then 
D(z)  =  e(z)e0F(r)=  constant,  and  c(z)  is  calculated  from 
n(r)  and  the  (uniaxial)  dielectric  tensor  with  elements  e„  and 
e  ( ■  Following  Berreman  [1],  we  adopted  a  shooting  method  which 

is  interactive,  but  automatically  alerts  the  user  to  conditions  where 
the  profile  is  changing  rapidly  and  avoids  metastable 
configurations. 

The  optical  properties  of  these  configurations  are  calculated  using 
the  4x4  matrix  method  developed  to  treat  stratified  anisotropic 
planar  structures  [2],  The  field  amplitudes  at  the  two  surfaces  of 
the  structure  are  related  by  a  propagation  matrix  P  so  that 

vfzWvCO)  (2) 

where  y  =  (Ex,  Hy,Ey,-Hx)T.  P(z)  is  obtained  by 
writing  a  differential  form  of  (2)  i.e. 

V'(z)“ivA  (z)V-£(z)V  (3) 

ineach  stratum  of  the  medium,  within  which  the  optical  properties, 
contained  in  A (z),  are  constant.  Then 


P(z)m  cxp^  J  D(z)dz  j  (-4) 

permits  the  calculation  of  P  from  the  dielectric  tensor  elements 
and  orientation  as  a  function  of  z.  Having  calculated  £  it  is  then 

straightforward  to  obtain  the  transmission  and  reflection 
coefficients. 

This  calculation  must  be  repeated  for  each  wavelength  of  interest 
across  the  visible  spectrum,  380-800  nm,  and  as  a  function  of  the 
angles  of  the  polarisers  and  any  other  layers  in  the  device.  It  must 
therefore  be  done  efficiently.  From  (2),  P(o(  for  the  entire 

structure  is  the  product  of  the  P  ’  s  for  each  component,  with  the 
appropriate  orientational  factors.  For  an  LCD  with  polarisers  set- 
at  (01,02) 

Lo,  ■  (5) 

where  Pf0l  and  P_LC  describe  the  polariser  and  LC  layers 
respectively  and  R  (G)  is  a  rotation  matrix.  Thus  the  problem  of 
optimising  a  display  is  reduced  to  performing  the  matrix 
multiplication  (5)  on  previously  calculated  P  matrices. 

III.  DISPLAY  OPTIMISATION 

The  display  optimisation  process  starts  by  calculating  the  director 
profiles  in  the  OFF-  anti  ON-states  of  the  display.  For  this,  we 
require  the  elastic  constants  and  permittivities  of  the  LC  fluid,  the 
physical  parameters  of  the  cell  (i.e.  thickness,  twist  and  surface 
tilt),  and  the  drive  voltages  and  1'4.  These  voltages  are 
related  by  the  level  of  multiplexing  .V  through 

VS/VHS  -  M  -  uTn*  i  )]I/J. 

and  are  equally  disposed  about  the  central  switching  voltage  I  e 
for  which  the  mid-plane  tilt  =  45°. 

From  these  profiles  and  the  refractive  indices  of  the  LC,  the 
£  matrices  for  the  LC  layer  in  the  two  states  are  calculated  and 
stored  for  40  different  wavelengths  across  tne  visible  spectrum.  It 
is  essential  to  include  the  dispersion  of  the  LC.  The  P  -matrix  of 

the  polariser  is  also  calculated  as  a  function  of  wavelength.  Then 
equation  (5)  is  used  to  calculate  P,Bi  and  hence  the  transmission 
spectra  for  the  range  of  polariser  angles  of  interest.  The 
transmission  spectra,  T(\),  are  combined  with  an  illuminant 
spectrum  to  give  the  CIE  tristimulus  co-ordinates  X,  Y,  Z 

where 

770 

X-k  f  S(\)r(\)x(X)d\  etc.  (6) 

370 

Here  a  (\)  is  the  colour  matching  function  and  A.  is  a  normalising 
factor 

770 

fc- 100/J"s(\)y(X)d\ 

370 

Then  the  tristimulus  Y  value  is  the  luminance  transmission  or 
"brightness"  of  the  display  and  Y off/ You  is  its  contrast  ratio. 
Contour  plots  of  iso-contrast  and  brightness  versus  the  polar 
angles  enable  the  optimum  display  configuration  to  be  selected. 

In  many  cases,  a  trade-off  must  be  made  between  contrast  and 
brightness.  For  the  case  shown  in  Fig.l,  the  polariser  angles  were 
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selected  to  provide- a  contrast  ratio  >20with"reasonable  ON-state 
transmission  when  a  narrow  band  green  illuminant  was  used.  The 
predicted  transmission  spectrum  is  compared  with  that  measured 
for  the  actual  display  in  Fig:l. 


Fig.l  Comparison  of  calculated  (solid  line)  and  measured 
(broken  line)  transmission  spectra  for  an  optimised  SBE 
display. 


IV  BLACK  AND  WHITE  SUPERTWIST  OPTIMISATION 

Supertwist  LCDs  are  inherently  coloured,  which  limits  their 
applicability.  The  colouration  can  be  removed  by  including  a 
birefringent  film  to  compensate  the  optical  properties  of  the  LCD. 
This  compensation  cannot  be  ideal,  so  optimisation  is  necessary. 
The  method  is  an  extension  of  equation  (5).  We  write: 

(7) 

where  03  is  the  orientation  of  the  birefringent  layer  and  Pg  is 

its  P  -matrix.  This  can  be  calculated  analytically  from  its 

retardation  which,  in  turn,  depends  on  the  film  thickness.  Hence 
there  are  how  four  variables  against  which  to  optimise  the  display: 

two  polariser  angles  0|,02,  the  film  axis  angle  03  and  its 
thickness.  The  optimisation  criterion  was  taken  as  the  blackest 
black  state  along  with  the  whitest  white  state,  so  we  numerically 
minimised 

AFJ-  (i'1 2 3  +  u’2*v'2)^rl  +  (al- L'f*  un  +  (8) 


where  L‘,u‘,v'  are  the  display’s  co-ordinates  in  the  CIE  1973 
uniform  colour  space  and  Z*  is  the  brightness  of  a  pair  of  parallel 
polarisers.  The  optimum  values  for  the  parameters  were  used  to 
construct  a  display.  Fig.2  shows  a  comparison  of  the  calculated 
and  measured  spectra. 


V  DISCUSSION 

The  numerical  model  has  proved  extremely  accurate  for  LCD 
design.  Besides  the  examples  quoted  above,  it  has  been  possible 
to  design  displays  with  minimal  colour  shift  between  their 
(reflective)idaylight  operation  and  the  (transmissive)  backlit 
mode  even  though  the  backlight  was  a  blue-green 
electroluminescent  panel.  We  have  also  designed  displays  for 
NVG  compatibility  without  using  extra  filters.  It  should  also  be 
emphasised  that  the  modelling  is  not  confined  to  normal 
incidence:  Fig.3  shows  a  calculated  iso-contrast  plot  for  an  SBE 
display  optimised  for  two  observers  at  ±40°. 
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Fig.3  .Calculated  iso-contrast  plot  for  an  SBE  display  optimised 
for  viewing  at  ±40°  incidence.  The  display  is  mounted  so 
that  the  rear  LC  alignment  direction  ($  =  0)  is  at  45° 

The  modelling  programs  are  sufficiently  accurate  that  realistic 
simulations,  both  static  and  dynamic,  of  LCD  appearance  have 
been  implemented  [3]. 

Besides  designing  displays,  the  modelling  programs  can  be  used 
to  investigate  faults  in  displays.  For  example,  SBE  displays  are 
very  sensitive  to  the  precise  orientation  of  their  polarisers.  It  is 
impossible  to  measure  these  angles  after  cell  assembly,  but  by 
measuring  the  display  performance  (i.e.  its  contrast  ratio  and 
transmission)  the  polariser  orientation  can  be  accurately  deduced 
from  a  comparison  with  the  model  predictions.  Thus  faults  in  the 
display  fabrication  can  be  readily  identified. 

Finally,  it  should  be  noted  that  these  programs  are  an  invaluable 
research  tool.  In  ferroelectric  LCDs,  the  director  profile  is 
generally  unknown.  By  measuring  their  optical  properties  and 
comparing  these  with  the  predicted  characteristics  of  plausible 
models,  a  predictive  capability  for  FLGDs  can  also  be  developed. 
In  conclusion,  the  numerical  modelling  programs  for  LCDs  have 
proved  to  be  very  accurate.  They  have  been  used  to  design  custom 
displays,  diagnose  faults  and  as  a  tool  in  display  research. 
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CONTINUUM  THEORY  OF  SMECTIC  C  LIQUID  CRYSTALS; 

STATIC  CONFIGURATIONS  AND  ELEMENTARY  FREDERIKS  TRANSITIONS 
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ABSTRACT  -  Smectic  C  liquid  crystals  are  shown  to  exhibit  six 
types  of  static  configuration  which  satisfy  the  equilibrium  equations 
of  the  continuum  theory  introduced  in  [I],  A  brief  mathematical 
description  of  the  resulting  families  of  parallel  surfaces  which 
correspond  to  these  static  solutions  is  given.  A  possible 
configuration  is  a  wedge  of  concentric  cylinders,  a  Frederiks 
transition  induced  by  an  appropriate  electric  field  is  discussed  in 
this  case. 


I.  INTRODUCTION 


To  describe  the  layer  structure  of  a  smectic  C  liquid  crystal  wc 
introduce  the  unit  layer  normal  a  which  is  subject  to  the 
constraint  [2] 


V  x  a  -  0  .  (1) 

As  in  [3],  a  unit  vector  c  which  is  perpendicular  to  a  is  used  to 
describe  the  direction  of  tilt  of  the  alignment  with  respect  to  the 
layer  normal.  The  two  directors  a  and  c  satisfy  the  constraints 


3-5  -  £■£  -  1  .  a.£  -  0  .  (2) 

The  energy  integrand  used  in  smectic  C  theory  is 
2W  -  K,(V.a)3  +  K2(V.c)3  +  K3(a.Vxc)3  +  K4(c.Vxc)3 
+  Ks(b.Vxc)  3  +  2K6(V.a)  (b.Vxc)  +  2K?(a.Vxc)  (c.Vxc) 

+  2K8(V.c) (b.Vxc)  +  2K9(V.a)(V.c)  ,  (3) 

where  the  K;  are  elastic  constants  (see  [1],[4],[5]).  The 
corresponding  equilibrium  equations  examined  arc  (see  [1],(6]) 

3W  .  _a. 


,j  •  3^  +  CT+Xai+Pcl+eijk(?k  j  -  0 

$!— I  . 


3ff  c 

3^7  +  Cj+KCj+pa  j  -  0 


(4) 


where  Q,  y  and  k  are  Lagrange  multipliers  arising  from  the 
constraints  (I)  and  (2)  and  e  is  the  usual  alternator.  Solutions  to 
(4)  provide  static  configurations  for  smectic  C  liquid  crystals. 


II.  STATIC  SOLUTIONS 


There  arc  six  types  of  well  behaved  surface  which  readily  provide 
static  solutions  for  a  restricted  six  term  version  (K,-K6)  of  the 
energy  given  in  (3),  namely,  the  Dupin  cyclides,  circular  tori  of 
revolution,  spheres,  parabolic  cyclcides,  infinite  cylinders  and  planes 
(see  [l],[5]-[7]).  Solutions  to  equations  (4)  for  a  and  c,  including 
any  related  Lagrange  multipliers,  can  be  found  and  as  an  example 
we  now  mention  the  parabolic  cylcides  [7]. 

The  Cartesian  equation  of  a  parabolic  cydide  is  [7] 

x(x3+y3+z3)+(x3+y3)(C-p)-z3(2+p)-(x-p+2)(2+p)3  -  0  (5) 

where  the  confocal  parabolae  essential  to  its  construction  are 


y3  -  42(x+fi) 

|  z3  -  -42x 

(6) 

z  -  0 

o 

1 

>> 

— k 

and  2  and  y.  arc 

real  parameters. 

Equation  (5)  may  be 

parameterized  as 

x(l+03+t3)  -  p(03+t3-l)  +  2(t3-03-l) 

y(l+03+t3)  -  2t(2(03+l)+p)  (7) 

z(l+03+t3)  -  20(2l3-p) 

where  -®  <  y,0,i  <  (varying  0  and  t  while  keeping  y  fixed 
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gives  one  particular  parabolic  cyciide  surface).  Transiorming  from 
the  Cartesian  to  the  (/i,0,t)-frame  we  can  show  that 

a  -  (1,0,0)  and  c  -  (0,1,0)  (8) 

salsify  thw  constrains  (1)  and  (2)  and  solve  ihc  transformed  version 
of  (4)  upon  a  suitable  choice  of  Lagrange  multipliers.  The 
consequences  of  varying  £  and  y  are  discussed  in  [7). 

III.  FREDERIKS  TRANSITION  IN  A  WEDGE 


Fig.  1  The  smectic  layers  are  assumed  to  be  parts  of  concentric 
cylinders  with  the  common  axis  coinciding  with  the  centre  of 
the  wedge.  The  layer  normal  a  is  in  the  f  direction  and  the 
angle  between  the  boundary  plates  is  (1. 


Introducing  the  vector 

b  -  a  x  c  (9) 

we  can  rewrite  the  energy  integrand  as  (sec  [4), [8]) 

2W  -  A, j (b.Vxc) 3  +  Aj,(c.Vxb)3  +  2A, , (b.Vxc) (c.Vxb) 

+  B,  (V.b)  3  +  Bj(V.c)  3  +  B3[  j(b.Vxb+c.Vxc)  ]3 

+  2B, 3(V.b) (b.Vxb+c.Vxc)  +  2C, (V.c) (b.Vxc) 

+  2Cj(V.c) (c.Vxb)  (10) 

where  the  A;,  Bj  and  Cj.  are  elastic  constants.  Introducing  the 
cylindrical  coordinate  system  (r,or,z)  we  set 

a  -  r 

b  -  -6  c osip  +  i  slnyt  (11) 

c  -  &  s  i  n/>  +  z  cosy? 

and  assume  that  =  y>(a)  with  y>( 0)  =  >p{p)  =  0  where  [i  is  the 
wedge  angle  (see  Fig.  1).  To  induce  a  Frederiks  transition  we 
apply  an  electric  field  of  the  form 


E-lLa 
-  r/J  - 


(12) 


across  the  bounding  plates  of  the  wedge  of  concentric  cylinders 
where  U  is  the  voltage.  The  corresponding  electrical  energy 
integrand  is 


2We  -  -eae0[|y  sin30  sin3y>  (13) 

where  ea  is  the  dielectric  anisotropy  of  the  liquid  crystal,  e0  is 
the  permittivity  of  free  space  and  0  is  the  usual  fixed  lilt  angle 
associated  with  smectic  C  liquid  crystals.  To  obtain  a  threshold 
for  a  Fredericks  transition  wc  add  the  integrands  (10)  and  (13) 
and  minimize  the  integral  of  this  sum  with  ,cspccl  to  a  over  the 
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region  r,  <  r  <  r2,  0  <  a  <  (3,  z,  <  z  <  z2.  This  is 
achieved  by  solving  the  following  linearized  Euler-Lagrange 
equation  (see  [8]) 

Bj  '•  2(A2|+A,,)y)  +  eae0[^]  y>  “*P  (14) 

where  B2,  A21  and  A,,  are  the  suitably  adjusted  temperature 
independent  parts  of  the  corresponding  original  elastic  constants 
appearing  in  (10).  To  satisfy  =  0  at  a  =  0,(3  we  make  the 
ansatz 

y>(<*)  -  y»m  sin[|  a]  (15) 

where  <pm  is  suitably  small.  Inserting  this  ansatz  into  equation 
(i4)  we  derive  the  Frederiks  theshold  Uc  as 

ea£0Vc  -  »25J"  2(3J(Aj,+An). 

We  therefore  see  that  by  varying  _the  wedge  angle  (3,  we  can 
evaluate  the  constants  B2  and  (A21+A,,)  by  measuring  the 
Fredericks. threshold  for  each  value  of  (3. 
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Abstract.-  Modelling  of  ferroelectric  liquid  crystal 
displays  involves  angular  and  spectral  transmission  of 
real  backlights,  using  commercially  available 
polarisers  and  actual  FLC  mixtures.  Running  times 
for  a  complete  case  may  be  extremely  large. 
Therefore  optimised  procedures  and  simplified 
models  for  precalculations  become  necessary.  A  fairly 
accurate  description  of  the  optical  behavior  of  real 
FLC  displays  in  working  conditions  has  been 
achieved.  Polarizer  angles  optimisation,  spectral  and 
angular  transiriisicn"  «’~ts  and  color  coordinates 
calculations  are  the  most  useful  results. 

I.  INTRODUCTION 

The  use  of  ferroelectric  liquid  crystals  (ELCJ 
for  manufacturing  high  quality  displays  has  drawn 
considerable  attention  since  surface  stabilized 
(SSFLC)  bistable  structures  of  these  materials  were 
reported  by  Clark  and  Lagerwall  [1],  A  simple 
bookshelf  geometry  with  uniform  layers  perpen¬ 
dicular  to  the  glass  plates  was  proposed,  and  a  fast 
electrooptical  switching  was  demonstrated.  Further 
work  by  them  and  other  researchers  [2-4],  however, 
showed  that  the  usual  configurations  found  in  real 
structures  are  far  more  complicated,  tilted 
bookshelf,  splayed  or  chevron. 

Optical  transmission  models  may  greatly  help 
to  develop  these  devices.  Under  the  point  of  view  of 
commercial  displays,  the  most  interesting 
information  that  a  computer  model  may  provide  is 
the  one  related  to  optical  transmission  properties  of 
actual  devices  in  working  conditions. 

n.  PROBLEM  FORMULATION 

Two  models  for  angular  and  spectral 
distribution  of  light  transmitted  through  FLC 
samples  have  been  prepared  and  tested.  The  first 
model  -called  slab  model-  can  compute  light 
transmission  through  FLC  cells  whose  director 
orientations  are  defined  by  a  small  number  of 
homogeneous  slabs.  The  mathematical  description  of 
the  optical  system  (i.e.,  polariser,  glass,  anisotropic 
material,  glass,  and  polariser)  is  based  on 
geometrical  optics  (5j. 


1  This  work  is  supported  in  part  by  ESPRIT  II 
Project  2360  FELIGITA  and  TIC  Program  from 
Spanish  CICyT. 


The  optical  transmission  calculations  are 
performed  for  all  possible  angles  (0-360°,  10°  steps) 
and  oblique  incidences  (0-80°,  5°  steps).  Driven  and 
zero  volts  states  are  computed  by  suitably  orienting 
the  liquid  crystal  slab  directors  within  the  optical 
system.  Data  for  real  polansers  and  backlights  (380- 
770  nm,  every  10  nnij  are  then  included,  and  the 
overall  transmission  for  every  angle  is  computed. 

The  second,  so-called  continuous-varying 
profile  (CVP)  model,  is  based  on  Berreman  4x4 
formulation  [6,7]  and  may  be  used  for  any  arbitraiy 
director  profile.  Input  data  and  output  results  are 
defined  as  above.  The  truncated  series  expansion  of 
Berreman's  method  is  avoided  using  explicit 
expressions  for  4x4  propagation  matrices  of 
homogeneous  slices  of  the  material,  as  proposed  by 
Wohlc*  et  al.  "?].  Results  from  both  methods  are 
similar,  the  former  being  faster  but  restricted  to 
simplest  profiles. 

in.  RESULTS 

In  the  examples  given  below,  the  following 
elements  are  used: 

Backlight:  C.I.E.  D65 

Color  filters.  EMI  RGB/standard  fluorescent  lamp 
Polarizers:  G1220 
Material:  ZLI  3654  (Merck). 


Figure  1.-  Transmission  spectra  for  different 
thicknesses.  Backlight:  D65.  Slab  model. 
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The  nigh  Direfringence  of  the  clear  state  in  FLC 
displays  may  influence  .he  output  of  wide  spectrum 
backlights.  Figure  1  shows  the  spectral  response  of  a 
15°  tilted  bookshelf  with  a  3°  surface  pretilt  angle. 
The  region  of  shorter  wavelengths  is  remarkable 
affected  for  higher  thicknesses.  The  clear  state  is 
behaving  like  an  almost  ideal  retardation  plate,  rhe 
models  predict  little  spectral  changes  for  samples 
below  2pm  for  a  typical  birefringence.  This  should 
be  considered  a  design  parameter,  specially  in 
colour  displays,  where  luminance  of  the  blue  filter 
may  be  considerably  reduced. 

Figure  2  is  a  3D  plot  of  oblique  incidences.  A  15° 
chevron  with  10°  pretilt  at  30  °C  is  represented. 
The  central  region  of  the  plot  corresponds  to  nearly 
normal  incidences;  angles  are  linearly  varying  with 
distance  from  the  centre.  The  outer  regions  are 
grazing  incidences  up  to  80°.  Rotation  of  the  viewing 
angle  is  achieved  by  rotating  the  figure.  While  the 
clear  state  yields  a  fairly  symmetric  hat  shape,  the 
dark  state  shows  small  maxima  at  45°  <or  nearly 
grazing  incidence.  This  is  due  to  residual  light 
passing  through  non-ideal  polarisers.  Contrast 
curves  may  be  directly  derived  from  these  plots. 


Brightness  (clear  state) 


Brightness  (dark  state,  x5) 

Figure  2.  3D  plots  normalised  to  source  luminance 
through  parallel  ideal  polarisers.  CVP  model. 


5  GO 


dashed=normal  incidence 
solid=45°  incidence 


Figure  3.-  Evolution  of  x,  y  C.I.E.  colour  coordinates 
with  sample  thickness  (0-5gm).  D65  and  RGB  filters 
are  represented,  CVP  model. 


Transmission  data  may  De  transformed  into 
C.I.E.  colour  coordinates.  Figure  3  shows  the 
evolution  of  dominant  colours  and  saturation  when 
sample  thickness  is  varied  from  0  to  5  pm.  No  other 
cell  parameter  (tilt  angle,  pretilt,  birefringence,  FLC 
configuration,  oblique  incidence,  chevron/tilted 
bookshelf  angle)  produces  any  relevant  colour 
migration.  However,  sample  thickness  (strictly,  the 
product  An.d)  produces  dramatic  effects  in  colour 
coordinates  as  it  does  in  luminance  (Fig.  1).  Again 
thicknesses  below  2pm  are  advisable.  The  central 
curve  of  figure  3  shows  a  D6f ,  The  outer  curves  are 
red,  green  and  blue  filters  currently  used  for 
commercial  colour  displays. 


°  8-O^'2ol60rr^0^”0,30m0O0Tmc>l0,™0<OTm0j60 
Rotative  transmission  x-axis 

Figure  4.-  Experimental  (*)  and  predicted  (solid) 
45°  oblique  transmission  of  a  2pm  FLC  cell  rotating 
between  fixed  crossed  polarisers.  Slab  model. 

An  experimental  setup  consisting  of  a  He-Ne 
laser,  two  fixed  crossed  polarisers  and  a  FLC 
sandwich  twisted  45°  has  been  prepared  to  test 
oblique  incidences.  The  sample  is  rotated  360° 
while  switching.  The  output  in  polar  coordinates 
(Fig.  4)  is  a  daisy-shaped  curve  where  four  “petals” 
are  maxima  from  one  of  the  states  interlaced  with 
another  four  maxima  from  the  other  state.  Both 
theoretical  and  experimental  data  are  normalised 
using  normal  incidence.  A  fair  match  of  the  results 
is  found,  specially  in  the  angular  values  of  the 
maxima.  These  values  are  related  to  the  projection 
of  the  tilt  angle  on  the  plane  of  incidence  thus  giving 
information  of  the  actual  FLC  configuration. 
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Abstract 

Simulated  annealing  has  turned  out  to  be  a  very  efficient 
method  in  the  search  for  covering  codes.  We  discuss  three 
methods,  all  using  simulated  annealing,  for  finding  such  codes. 

The  direct  approach  and  the  approach  using  matrices  have 
earlier  been  applied  to  some  extent.  The  third  method,  the 
use  of  simulated  annealing  in  finding  acceptable  partitions  for 
seminormal  codes,  is  novel.  All  these  methods  have  led  to  new 
codes,  better  than  any  other  known  in  the  literature. 

I.  INTRODUCTION 

Covering  codes  originated  back  ii.  '018,  when  Taussky  and  Todd 
[10]  discussed  the  problem  group-thcorctically.  During  the  years 
many  contributions  to  the  research  have  appeared  in  different  jour¬ 
nals  within  the  areas  of  coding  theory  and  combinatorics.  The  main 
interest  has  concerned  binary  codes  and  ternary  codes  of  covering 
radius  1  (the  so  called  football  pool  problem,  see  c.g.  [8, 11])-  There 
has  been  considerable  recent  growth  in  the  interest  in  the  area(cf. 

(3])- 

The  problem  of  finding  covering  codes  can  be  formulated  as  a 
combinatorial  optimization  problem.  Simulated  annealing  (SAy  has 
turned  out  to  perform  amazingly  well  in  the  search  for  such  codes. 

If:  COVERING  CODES 

We  consider  the  space  F"  consisting  of  all  words  of  length  n  and 
coordinates  belonging  to  the  set  {0,...,q-  I}.  A  code  C  C  F£ 
covers  with  radius  R  if  every  word  in  F*  is  within  Hamming 
distance  R  from  some  codeword  in  C.  The  Hamming  distance  be¬ 
tween  two  words  is  the  number  of  coordinates  which  they  differ. 
A  q-ary  code  oflcngth  n  that  has  M  codewords  and  covering  radius 
R  is  called  a  ( q,n,M)R  code.  We  denote 

Kq{n,R)  -  min{Jl/  |  there  is  a  ( q,n,M)R  code}. 

Example  1.  F$  =  {000,001,010,011,100,101,110,111}.  The 
code  C  =  {000,  111}  isa(2,3,2)l  code,  since  the  words  within  Ham¬ 
ming  distance  1  from  000  are Cj  =  {000,001,010, 100}  and  from  111 
arc  Ci  =  {111,  110, 101,011},  and  C,  UC2  -  /?.  A'2(3, 1)  -  2,  since 
there  is  no  (2, 3, 1)1  code  as  is  easily  seen. 

Codes  with  different  kinds  of  partitioning  properties  have  turned 
out  to  be  very  useful  In  constructing  new  codes  from  old  ones.  The 
concepts  of  normal  and  scminormal  codes  were  introduced  in  [3] 
and  [4],  respectively,  and  in  (13)  the  notion  of  scminormal  codes 
was  presented.  In  this  paper  we  show  have  simulated  annealing  can 
be  adopted  to  prove  the  scminormality  of  codes.  We  now  define 
/.•-seminormal  and  strongly  /.'  scminormal  codes. 

Definition  1:  (Ostcrgard,  (13,  Definition  2])  A  (q,n,M)R  code 
C  is  said  to  be  h-semtnormal,  if  there  is  a  partition  of  C  into  k 
subsets  Co,.-.Ck-\  such  that,  for  all  x  €  Ff,  with  d{z,C)  =  R, 

max{rff:r,Ca)}  <  R+  1. 


Such  partitions  arc  called  acceptable.  The  definition  of  strongly 
/.-•scminormal  codes  is  obtained  by  removing  “with  d(x,  C)  =  IF 
from  Definition  1.  The  following  theorem  shows  how  scminormal 
codes  can  be  used  in  the  construction  of  new  covering  codes. 


Theorem  /.-  (Ostergard,  [13,  Theorem  3])  Iftherc  is  a  (q,n,M)Il 
seminormal  code  and  q  is  a  prime  power,  then  there  is  a  (q,n  + 
q,qq~iM)R  + 1  code. 

Strongly  seminormal  codes  arc  also  of  importance  in  constructing 
covering  codes.  These  constructions  are  not  presented  here,  but  the 
interested  reader  is  referred  to  [13]. 

III.  SIMULATED  ANNEALING 

The  algorithm  used  in  our  research  is  only  a  slight  modification  of 
the  original  simulated  annealing  algunllim  presented  by  Kitkpatnck 
et  al.  [G,  7]. 

In  the  p.esentatiun  of  the  methods  that  have  been  used  we  focus 
our  attention:  on  the  definition  of  the  neighbouring  configurations 
and  the  energy  function.  Appropriate  cooling  schedules  can  usually 
be  determined  by  some  practical  experiments. 

IV.  THE  METHODS 

Although  we  try  to  minimize  the  number  of  codewords  covering  a 
certain  space  (to  determine  A',(n,  A)),  the  methods  to  be  presented 
here  attempt  to  find  coverings  with  a  certain  number  of  codewords. 
The  minimization  is  attained  by  sequent  attempts  (runs)  to  find 
coverings  with  fewer  and  fewer  codewords  (the  direct  approach). 

A.  The  Direct  Approach 

The  first  results  concerning  the  use  of  simulated  annealing  in 
coding  theory  were  presented  by  El  Gamal  el  al.  in  1387  [2].  In 
that  paper  covering  codes  were  not  considered,  however,  later  the 
same  year  these  were  treated  by  Willc  in  [11]. 

The  implementation  of  the  direct  approach  is  quite  straightfor¬ 
ward.  The  energy  function  is  simply  the  number  of  words  not  cov¬ 
ered  by  the  codewords.  When  we  arc  searching  for  a  code  C  that 
covers  F"  with  radius  R  the  energy  function  is 

E  =  \{xZF?\d(x,C)>R}\. 

In  the  annealing  process  we  go  through  all  codewords.  A  neigh¬ 
bourhood  configuration  is  obtained  by  replacing  a  codeword  c  with  a 
randomly  chosen  word  e  ,  such  that  I  ^  d\c,c')  s  II.  The  codewords 
could  also  be  replaced  with  completely  random  words,  however,  ex¬ 
periments  have  showed  that  this  way  of  defining  the  neighbourhood 
configuration  is  inferior  to  the  previously  mentioned  one. 

It  has  turned  out  that  for  covering  radii  R  —  1,2,3  codes  with  up 
to  about  100,  -10  and  15  codewords,  respectively,  can  be  found  within 
reasonable  time.  Even  an  ordinary  personnel  computer  can  be  used 
for  this  (most  of  our  work  has  been  done  on  a  10  MHz  PC/AT- 
compatiblc  computer).  With  an  increasing  number  of  codewords 
the  processing  time  required  grows  very  fast,  and  the  search  for 
the  (3,7,186)1  code  found  in  [S]  required  many  attempts  and  an 
extremely  slow  cooling  rale.  In  the  binary  case  the  following  theo¬ 
rem  can  be  used  to  overcome  this  problem  in  some  cases. 

Theorem  2:  (Ostorgfird,  (12,  Theorem  2])  Let  C  C  FfF%  bo  a 
code  of  covering  radius  II  that  has  n  codewords.  Then  there  is  a 
(2,&+37,27n)Rcode. 

In  tile  following  subsections  two  other  methods  for  finding  cov¬ 
erings  with  many  codewords  are  discussed. 
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D.  Covering  Using  Matrices 

The  method  to  be  presented  in  this  section  was  first-considered 
by  Kamps  and  van  Lint  [5]  and  later  generalized  by  Blokhuis  and 
Lam  [1],  In  [9]  van  Lint  Jr.  generalized  it  to  arbitrary  covering  radii. 

Let  A  =  (I;M)  =  (ai,...,a„)  be  a  rxn  matrix  where  I  is  the 
r  X  r  identity  matrix  and  M  is  a  r  x(n  -  r)  matrix  with  entries  from 
Fq.  For  s  £  F'  the  R- covering  of  s  using  A,  SAji(s),  U  defined  as 

n 

Sa,r(s)  =  {s+^ajaj  |-o j  €  H.Kojf  £ 0}|  <  R>  1<  j  <  n}. 
i=i 

Consequently,  A  —  I  corresponds  to  covering  in  the  traditional 
sense.  A  subset  S  of  Fq  R-covers  F%  using  A  if 

n  =  u 

Theorem  3:  (van  Lint,  Jr.,  (9,  Theorem  1.4.4])  If  S  R- covers  Pq 
using  a-r  X  n  matrix  A  =  (I;  M),  then  IF  =  {to  €  F£  |  Aw  £  5} 
covers  with  radius  R.  |IF|  =  \S\-qn~T. 

The  optimization  problem  now  consists  of  finding  the  words  in 
S  and  the  M  part  of  the  matrix  A.  The  interconnection  between 
the  codewords  and  the  matrix  causes  problems,  and  it  is  not  im¬ 
mediately  clear  how  to  perform  the  search  efficiently.  Wc  consider 
three  different  ways  to  deal  with  this  problem. 

1.  If  there  is  a  small  number  of  nonequivalcnt  matrices  M  it  is 
possible  to  do  the  annealing  in  trying  to  find  a  set  S  for  all 
these  possibilities.  This  is  the  approach  in  [14].  A  considerable 
speed-up  can  be  achieved  by  performing  the  first-run  with  a 
fast  cooling  rate,  after  which  values  of  M  leading  to  bad  cov¬ 
erings  can  be  removed.  Repeating  this  procedure  with  slower 
and  slower  cooling  rates  and  less  and  less  numbers  of  values 
of  M  possibly  leads  to  a  covering.  This  approach  has  turned 
out  to  perform  very  well,  however,  it  can  not  be  applied  when 
there  is  a  big  number  of  nonequivalcnt  matrices  M. 

2.  In  the  annealing  process  all  words  in  S  are  gone  through  in  one 
round  (like  in  the  direct  approach),  and  after  that  attempts 
arc  made  to  change  the  columns  of  M  with  other  columns. 
This  is  the  approach  in  [8].  The  performance  of  this  approach 
has  not  turned  out  to  be  be  very  satisfactory. 

3.  Wc  now  describe  how  simulated  annealing  can  be  used  on  Itco 
levels  to  attack  the  problem.  We  first  try  to  find  a  good  value 
of  M.  For  a  certain  M  we  try  to  find  a  good  covering  by 
searching  for  a  set  S.  This  is  done  using  simulated  annealing. 
Neighbourhood  configurations  arc  now  obtained  by  replacing 
the  columns  of  M  with  columns  that  differ  in  one  position. 
These  changes  are  accepted  in  the  normal  way  depending  on 
the  number  of  uncovered  words  remaining  after  the  next  cool¬ 
ing.  Having  fixed  M  attempts  arc  made  to  determine  the 
minimal  size  of  S. 

C.  Partitioning  Semi  normal  Codes 

We  consider  a  (7,  n,  M )R  code  C  and  describe  a  procedure  that 
can  be  used  in  trying  to  prove  A-seminormahty  of  the  code.  An 
acceptable  partition  is  found  at  the  same  time. 

Wc  divide  the  M  codewords  (preferably  randomly)  into  k  sots. 
If  k  divides  M,  the  size  of  the  sets  is  Mfk,  otherwise  the  size  of 
some  sets  is  (Af/fcJ  and  of  some  sets  These  sets  arc  named 

Co,  - . . ,  Ct-j. 

The  energy  function  can  now  be  taken  as 

B  =  !{(*,«)  €  (F£,  {0, ...,k- 1})  |  d(x,Ca)  >  R+l,d(x,C)  =  R)\. 

In  the  annealing  process  wc  go  through  alt  the  codewords  of 


all  the  sets  and  the;  random  displacement  consists  of  changing  the 
codeword  in  question  and  a  random  codeword  in  another  set. 

If  wc  want  to  prove  strong  fc-seminormality,  only  a  slight  change 
to  the  energy  function  has  to  be  made. 

V.  CONCLUSIONS 

Simulated  annealing  has  turned  out  to  perform  surprisingly  well 
in  the  search  for  covering  codes,  as  a  matter  of  fact  probably  no  other 
area  of  coding  theory  has  profited  so.much  by  this  method.  This 
can  partly  be  explained  by  the  fact  that  for  example  packing  (error- 
correcting)  codes  are  very  structural  of  their  nature  and  so  for  ins¬ 
tance  algebraic  methods  can  be  applied  in  the  constructions,  llow 
ever,  many  known  record-breaking  coverings  (the  (3,6,73)1  code 
found  in  [8]  to  mention  one)  seem  to  possess  no  pattern  at  all. 

In  spite  of  the  good  results  reported  here,  there  is  still  some  work 
to  be  done  on  this  subject.  This  concerns  especially  the  method  of 
covering  using  matrices,  with  its  special  problems. 
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Abstract:  We  present  a  problem  independent  general  purpose 
parallel  implementation  of  simulated  annealing  on  distributed 
message-passing  multiprocessor  systems.  Wc  give  a  classifi¬ 
cation  of  combinatorial  optimization  problems.  For  typical 
representatives  of  the  different  classes  good  parallel  simulated 
annealing  implementations  are  presented.  A  new  parallel  SA- 
implementation  is  introduced.  It  works  simultaneously  on  sev¬ 
eral  markov  chains  and  decreases  the  number  of  chains  dynam¬ 
ically. 

I.  Introduction 

Simulated  Annealing  (SA)  was  first  presented  by  Kiihpatriek 
et  al.  [5]  for  solving  hard  combinatorial  optimization  problems 
and  has  proven  to  be  a  good  technique  to  a  lot  of  applica¬ 
tions  [3,4,6].  The  disadvantage  of  this  probabilistic  approach 
is  its  large  amount  of  computation  time  needed  for  obtaining 
a  near-optimal  solution.  Some  attempts  at  speeding  up  simu¬ 
lated  annealing  by  using  parallel  computing  systems  have  been 
made. 

Two  parallelization  strategies  are  possible.  In  the  first,  prob¬ 
lem  describing  data  is  distributed  among  several  processors. 
This  kind  of.parallelization  depends  on  the  given  problem  and 
is  not  easy  to  find  for  every  optimization  problem. 

Therefore  we  consider  a  second  strategy  which  is  based  on 
the  parallelization  of  the  actual  simulated  annealing  algorithm. 
Every  processor  gets  the  complete  problem  instance  and  exe¬ 
cutes  the  sequential  steps  of  the  annealing  algorithm  in  paral¬ 
lel.  This  approach  is  problem  independent  and  easy  to  adapt. 
Some  authors  describe  this  technique  using  parallel  systems 
with  shared  memory  [1,3].  For  special  problems  [2]  distributed 
systems  are  used  in  the  same  way. 

Aarts  et  al.  [l]  first  dccribed  a  technique  where  all  pioccssors 
work  in  parallel  on  the  evaluation  of  one  markov  chain.  With 
this  idea  we  obtain  a  speedup  of  23  with  64  processors  when 
using  a  selfadapting  cooling  schedule. 

We  present  an  improved  parallel  SA  algorithm  that  provides 
a  speedup  of  41  on  121  processors  using  a  selfadapting  cool¬ 
ing  schedule.  In  this  approach  all  processors  start  working  on 
a  number  of  distinct  markov  chains.  The  number  of  chains 
is  reduced  dynamically  until  all  processors  evaluate  only  cne 
chain. 

All  algorithms  are  implemented  in  OCCAM-2  on  a  full  rccon- 
figurable  transputer  system. 

II.  Classification 

The  optimization  problems  are  classified  according  to  their 
evaluation  time  for  the  different  steps  of  the  sequential  an¬ 
nealing  algorithm.  The  most  important  two  classes  arc: 

1.  problems  where  the  generation  of  new  configurations  and 
the  cost  evaluation  take  equal  time  (c.g.  TSP). 

2.  problems  where  the  cost  evaluation  is  much  more  expensive 
than  the  generation  of  configurations  (c.g.  placement). 


III.  Parallelization 

We  examined  several  parallelization  approaches  known  from 
literature  concerning  their  suitability  for  problems  of  the  dif¬ 
ferent  classes.  Kirkpatrick’s  ideas  of  locking  parts  of  the  con¬ 
figurations  [3]  were  found  to  be  inefficient  when  implemented 
in  large  distributed  systems  because  no  fast  locking-mechanism 
is  available. 

Baiardi’s  model  of  a  processor  farm  [2]  provides  nearly  optimal 
speedup  when  used  for  problems  of  the  second  clr  s.  In  this 
approach  new  configurations  are  generated  by  one  master  pro¬ 
cess  and  sent  to  a  number  of  slave  processes  for  cost  evaluation 
and  acceptance  decision.  If  this  method  is  applied  to  problems 
of  the  first  class,  the  master  is  a  bottleneck.  He  is  not  able  to 
generate  enough  new  configurations  to  keep  a  large  number  of 
slaves  working. 

IILa  One-Chain 

To  get  rid  of  this  bottleneck  new  configurations  must  be  gen¬ 
erated  by  the  slaves  themselves.  Only  system  updates  are  still 
controlled  by  the  master.  A  version  of  this  idea  was  described 
by  Aarts  et  al.  and  implemented  on  a  small  parallel  machine 
with  shared  memory  [1]. 

In  our  implementation  all  slaves  work  on  the  evaluation  of  one 
markov  chain  If  a  slave  detects  an  acceptable  configuration 
the  master  is  informed.  He  initiates  a  system  update. 

For  convergence  properties  it  is  not  profitable  to  use  the  first 
detected  acceptable  configuration  for  a  global  update.  In  a 
synchronization  phase  the  master  collects  all  accepted  configu¬ 
rations  and  chooses  one  for  a  global  update.  Quickly  calculated 
transitions  are  not  favored. 


Fig.l:  Results  of  One-Chain  with  a  selfadapting  cooling  schedule 

A  ternary  tree  is  used  as  hardware  topology  for  our  implemen¬ 
tation.  It  provides  minimal  path  length  from  the  master-node 
(root  of  the  tree)  to  all  other  nodes  and  has  a  maximal  degree 
of  four  (since  each  processor  has  4  communication  links). 
Using  a  fixed  cooling  schedule  (with  fixed  initial  temperature 
lo,  temperature  decrement  tn  =  Cxtn-l  and  fixed  chain  length 
L )  wc  achieve  nearly  linear  speedup  results. 

A  selfadapting  cooling  schedule  according  to  Huang  et  al.  [4] 
is  implemented.  For  the  evaluation  of  the  standard  deviation 
p  we  use  a  smoothing  technique  similar  to  Otten  [6]. 
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Measurements  of-speedup  and:  efficiency  are  shown  in  fig.  1. 
With  this  technique,  it  is  not  profitable  to  use  more  than  40 
processors.  The  convergence  behavior  is  equal  to  that  ofthc 
sequential  algorithm. 

IH.b  Pai-Chain 

The  behavior  of  the  One-Chain  is  worse  in  the  presence  of  high 
temperatures  when  implemented  in  large  distributed  systems. 
Many  synchronization  phases  appear  because  almost  every  new 
configuration  is  accepted.  For  that  reason  no  linear  speedup  is 
achieved. 

To  overcome  this  disadvantage  several  markov  chains  can  be 
used  and  speedup  is  achieved  by  shortening  the  length  of  the 
individual  chains.  To  guarantee  convergence  the  chain  length 
cannot  be  reduced  arbitrarily.  Since  at  lower  temperatures 
the  behavior  of  the  One-Chain  is  much  better,  the  idea  was  to 
combine  these  two  methods  [1]. 

When  the  algorithm  starts  all  processors  calculate  their  own 
markov  chain  according  to  the  One  Chain  method  (fig.  2).  Af¬ 
ter  a  certain  time  a  global  synchronization  step  is  made.  All 
processors  send  their  configurations  to  the  root  node  which 
controls  the  masters  of  One  Chain.  It  chooses  one  of  the  con¬ 
figurations  for  further  work. 


red.  1  red.  2  red.  K-2  red.  K-l 


phase  1  phase  2  phase  K-I  phase  S 


Fig.2:  Reduction  of  number  of  chains 

In  case  of  low  acccption-ratcs,  processors  arc  clustered  dynam¬ 
ically.  This  is  done  by  building  subtrees  (fig.  3).  Each  duster 
now  calculates  one  chain  according  to  the  One-Chain  imple¬ 
mentation.  While  the  number  of  chains  is  decreased,  the  chain 
length  is  magnified.  The  combination  steps  arc  repealed  until 
all  processors  compute  only  one  markov  chain  (fig.  2). 


Fig.3:  The  phases  of  reduction  (example  with  40  processors). 


The  cooling  schedule  is  controlled  by  the  root-node.  Calcu¬ 
lation  of  initial  temperature  and  temperature  reduction  arc 
done  in  the  same  way  as  in  the  One-Chain  implementation. 
The  equilibrium  detection  cannot  be  donedepending  on  the 
values  of  accepted  configurations  (like  in  One-Chain)  because 


not  all  values  from  all  dusters  are  available  on  the  root-  node. 
Therefore  L  is  calculated  before  the  computation  of-a  chain 
starts  according  to  a  technique  used  by  Otlen:[6). 
Measurements  of  speedup  and  efficiency  can  be  seen  in  fig.  4. 


IV.  Conclusion  and  further  work 
We  presented  a  general  purpose  parallel  implementation  of  SA 
on  distributed  multiprocessor  systems.  This  approach  is  prob¬ 
lem  independent  and  easy  to  adapt.  Hence  it  can  be  used 
as  a  tool  of  universal  application  for  approximation  of  hard 
combinatorial  optimization  problems.  To  our  knowledge  it  is 
the  first  problem  independent  parallelization  of  SA  for  large 
distributed  systems. 

Our  next  step  is  to  combine  methods  from  genetic  algorithms 
[V]  with  the  given  SA  parallelizations.  Better  convergence  be¬ 
havior  is  achieved  by  using  a  pool  of  markov  chains.  In  the 
global  synchronization  phase  of  the  Par-Chain  algorithm  the 
root-node  chooses  a  pool  of  configurations  for  farther  work. 
The  members  of  the  pool  and  their  rate  of  reproduction  are 
selected  concerning  their  ’goodness’.  First  experiments  indi¬ 
cate  also  a  better  behavior  in  speedup. 
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Abstract  We  show  that  local  search  heuristics  for  grid 
and  hypercube  embeddings  based  on  the  successive  swap¬ 
ping  of  pairs  of  vertices,  such  as  simulated  annealing,  are 
P-hard  and  unlikely  to  run  in  polylogarithmic  time.  We 
have  developed  and  implemented  on  the  Connection  Ma¬ 
chine  CM-2  a  new  massively  parallel  heuristic  for  such  em¬ 
beddings,  called  the  Mob  heuristic,  which  gives  excellent 
results  in  practice. 

1  Introduction 

Graph  embedding  is  the  NP-complete  problem  of  mapping 
a  graph  into  another  graph,  ca.led  a  network  for  clarity, 
while  minimizing  a  cost  function  on  the  embedded  edges 
.  2  the  graph.  Graph  embedding  has  application  in  VLSI 
(Very  Large  Scale  Integration)  placement  and  the  mini¬ 
mization  of  data  movement  in  parallel  computers.  An  au¬ 
tomatic  graph-embedding  tool  optimizes  communication 
resources,  permits  fault  tolerance,  and  allows  parallel  pro¬ 
grams  to  be  divorced  to  some  extent  from  the  structure  of 
the  underlying  communication  network. 

In  this  paper,  we  address  grid  and  hypercube  embed¬ 
dings.  The  cost  of  a  grid  embedding  is  the  sum  of  the 
half-perimeters  of  the  boxes  enclosing  each  edge.  The  cost 
of  a  hypercube  embedding  is  the  sum  of  the  Hamming 
distances  between  the  two  vertices  of  each  edge.  Neither 
cost  function  measures  routing  congestion,  but  reduction 
of  edge  lengths  can  reduce  congestion  as  a  secondary  effect. 

Local  search  heuristics,  of  which  steepest  descent, 
Kernighan-Lin  [2],  and  simulated  annealing  [3]  are  well- 
known  examples,  have  been  established  as  the  heuristics  of 
choice  for  general  graph-embedding  problems.  The  recent 
availability  of  general-purpose  parallel  processing  hard¬ 
ware  and  the  need  to  solve  very  large  problem  instances 
have  led  to  increasing  interest  in  parallelizing  local  search 
heuristics. 

In  local  search  algorithms,  an  initial  solution  is  con¬ 
structed,  usually  by  some  random  procedure,  and  the  cost 
function  /  is  computed.  Changes  are  made  to  the  cur¬ 
rent  solution,  and  the  new  solution,  which  we  say  is  in  the 
neighborhood  of  the  current  solution,  replaces  the  current 

‘This  wck  was  supported  in  part  by  the  National  Science  Foun¬ 
dation  under  Grant  CDA  87-22809  and  the  Office  of  Naval  Research 
under  contract  N00014-83-K-0146  and  ARPA  Order  Nos.  4786,  6320. 


solution.  The  SWAP  neighbornood  of  an  embedding  is  the 
set  of  embeddings  obtained  by  swapping  the  embedding  of 
two  vertices. 

2  P-hardness  Results 

We  show  that  local  search  algorithms  for  grid  and  hyper¬ 
cube-embeddings  are  expected  to  be  hard  to  parallelize 
by  reducing  them  to  the  circuit  value  problem  (CVP),  the 
canonical  P-complete  problem. 

Problems  in  NC  can  be  solved  on  a  parallel  machine  with 
polynomially  many  processors  in  polylogarithmic  time.  If 
a  P-complete  problem  is  in  NC,  then  P,  the  class  of  prob¬ 
lems  solvable  in  polynomial  time,  is  contained  in  NC,  a 
highly  unlikely  result.  Since  logspace-reducibility  is  tran¬ 
sitive,  if  a  problem  A  is  P-complete  and  we  can  find  a 
logspace  reduction  of  it  to  another  problem  B  in  P,  then 
B  is  also  P-complete.  The  definition  of  P-hardness  does 
not  require  that  the  decision  problem  be  in  P.  A  P-hard 
problem  is  at  least  as  hard  to  solve  as  a  P-complete  prob¬ 
lem. 

CVP  is  the  problem  of  computing  the  value  of  a  Boolean 
circuit  from  a  description  of  the  circuit  and  values  for  its  in¬ 
puts.  CVP  is  P-complete  [4].  Monotone  CVP,  a  restricted 
version  of  CVP  which  uses  only  the  operations  AND  and 
OR,  is  also  P-complete  [1], 

Graph,  partitioning  is  a  special  case  of  graph  embedding. 
The  graph-partitioning  problem  is  to  partition  the  vertices 
of  an  undirected  graph  G  —  (V,  E)  (]Vj  even)  into  two 
sets  of  equal  size  such  that  the  number  of  edges  between 
them  is  minimized.  We  use  the  following  result  to  give  re¬ 
ductions  to  local  search  algorithms  for  grid  and  hypercube 
embeddings. 

Theorem  1  For  the  graph-partitioning  problem,  local 
search  under  the  Kernighan-Lin  neighborhood  is  P- 
complete.  Local  search  under  the  SWAP  neighborhood  is 
P- complete,  or  P-hard  if  the  local  search  algorithm  is  ran¬ 
domized  [o,7]. 

The  result  that  local  search  under  the  SWAP  neighbor¬ 
hood  for  graph  partitioning  is  P-complete  was  indepen¬ 
dently  obtained  by  Yannakakis  and  Schaffer  [9]. 
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Figure  1:  Graph  partition  to  grid  embedding  reduction. 

The  graph-partitioning  completeness  proof  can  be  sum¬ 
marized  as  follows.  A  graph  <?  is  constructed  from  a  mono¬ 
tone  boolean  circuit  C.  The  graph  G  contains  subgraphs 
corresponding  to  the  AND  and  OR  gates  in  the  circuit 
C  as  well  as  auxiliary  subgraphs.  A  partition  of  G  into 
equal-sized  sets  is  given  as  a  starting  point.  By  apply¬ 
ing  improving  swaps  until  a  local  minimum  is  reached,  the 
value  of.  the  circuit  C  can  be  computed  directly  from  the 
resulting  graph  partition. 

Theorem  2  For  the  graph- embedding  problem  on  the  grid 
and  hypercube,  local  search  under  the  SWAP  neighborhood 
is  P-complete,  or  P-hard  if  the  local  search  algorithm  is 
randomized. 

To  prove  Theorem  2,  we  give  two  logspacc  reductions 
that  map  the  graph  G  used  in  the  g.aph-partitioning  proof 
into  initial  embeddings  i:,  the  grid  and  hypercubc.  The  full 
description  of  the  constructions  arc  given  in  [6].  Wc  give 
a  sketch  here  of  the  grid  embedding  construction,  the  con¬ 
struction  for  the  hypercube  embedding  problem  is  similar. 

For  the  grid  embedding  problem,  the  construction  shown 
in  Figure  1  consists  of  a  grid  with  two  vertical  lines  Xy,  Li 
which  have  unit  horizontal  separation.  The  line  repre¬ 
sents  a  logical  value  of  0  while  the  other  line  represents  a 
logical  value  of  1.  Let  (A'o,l’o)  be  the  initial  partition  of 
G.  Let  K  be  the  maximum  degree  of  G,  (K  —  9)[5j.  The 
vertices  in  the  set  A'o  of  G  arc  placed  on  as  shown  in 
Figure  1  and  above  them  is  an  equal  number  of  solitary 
vertices.  The  .erticcs  in  ih  arc  placed  on  above  an 
equal  number  of  solitary  vertices.  These  vertices  on  the 
vertical  lines  Lq  and  L\  arc  spaced  D  vertical  grid  points 
apart,  where  D  —  K  +  1,  to  leave  enough  room  for  the  rest 
of  the  construction.  With  this  construction  wc  show  that 
the  only  swaps  accepted  by  the  local  starch  heuristic  are 
between  a  vertex  of  G  and  the  opposing  solitary 

I’o  limit  the  movement  of  a  vertex  v  in  G,  wc  place  /, 
(L  —  2 K  \  2)  D  a  D  anchor  cliques  to  t  he  left  and  aiu-t In  r 
L  anchor  cliques  to  I  he  right  of  the  two  mliml  Iin<s.  and 


we  connect  the  closest  vertex  of  every  clique  to  v  with  an 
zpander  edge,  of  which  there  are  2i.  The  solitary  vertices 
are  not  anchored,  and  can  thus  move  freely.  We  shall  show 
that  the  expander  edges  and  cliques  constrain  v  to  move 
only  along  the  E-axis  between  the  two  vertical  lines. 

Both  constructions  have  the  property  that  ail  possible 
positive  gain  swaps  in  thL  problem  correspond  to  positive 
gain  swaps  in  the  ass  riated  graph-partitioning  problem, 
and  thus  mimic  the  computation  of  the  value  of  a  circuit. 
We  find  that  any  local-search  based  algorithm  is  P-hard  if 
every  swap  accepted  by  it  corresponds  to  a  positive  gain 
swap  in  the  graph-partitioning  algorithm. 

Since  local  search  heuristics  based  on  the  SWAP  neigh¬ 
borhood  for  grid  and  hypercube  embeddings  are  P-hard, 
it  is  unlikely  that  a  parallel  algorithm  exists  that  can 
find  even  a  local  minimum  solution  in  polylogarithmic 
time  in  the  worst  case.  This  result  puts  experimental 
results  reported  in  the  literature  into  perspective:  at¬ 
tempts  to  construct  the  exact  parallel  equivalent  of  serial 
simulated-annealing-based  heuristics  for  graph  embedding 
have  yielded  disappointing  parallel  speedups. 

3  The  Mob  Heuristic 

We  have  developed  a  new  massively  parallel  heuristic, 
which  we  call  the  Mob  heuristic.  The  heuristic  is  closely 
related  to  both  Kernighan-Lin  and  simulated  annealing. 
The  algorithm  uses  a  mob-selection  rule  to  swap  large  sets 
of  vertices,  called  mobs,  across  planes  of  a  grid  or  hyper¬ 
cube.  If  the  new  bedding  found  has  a  smaller  cost,  the 
search  is  repealed  on  the  new  embedding  with  the  same 
mob  size.  If  the  cost  increases,  the  neighborhood  of  the 
new  embedding  Is  searched  with  a  smaller  mob  size.  We 
assume  that  Mob  executes  a  number  of  iterations  that  does 
not  exceed  a  polynomial  in  the  number  of  graph  vertices. 
A  “schedule”  determines  the  rate  at  which  the  mob  size 
decreases.  The  P-hardness  result  given  above  applies  also 
to  the  Mob  heuristic  if  the  mob  size  is  fixed-at  one. 

The  mob-selection  rule  searches  for  an  approximation  to 
the  subset  that  causes  the  largest  improvement  in  the  em¬ 
bedding  cost  and  is  designed  to  be  computed  very  quickly 
in  parallel  On  the  hypercubc  a  hyperplane  is  chosen 
at  random  and  vertices  are  swapped  between  hypcrcube 
neighbors  across  the  chosen  hypercubc  axis.  On  the  grid, 
a  distance  dof  A  1,2, 1, 8, 16, . . .  on  cither  the  X  or  Y  axis  is 
chosen  at  random,  and  vertices  are  swapped  between  grid 
neighbors  that  are  a  distance  d  apart.  In  both  cases  a  gain 
is  computed  for  every  vertex  to  find  the  vertex  pairs  whose 
exchange  would  cause  the  largest  individual  change  in  the 
embedding  cost.  A  group  of  high-gain  vertices  of  size  mob 
is  selected  to  move.  To  avoid  sorting  by  gain,  an  expensive 
operation  on  a  massively  parallel  machine,  wc  use  adaptive 
binary  search  to  identify  a  set  of  vertices  with  gain  g  or 
larger  in  each  set  where  g  is  the  smallest  gain  such  that  at 
iiasL  rnoii  vertices  have  a  gain  greater  than  or  equal  to  g. 
Wc  select  muh  vertices  at  random  from  this  set. 

Wc  evaluated  the  performance  of  the  Mob  hypercubc 
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Figure  2:  Convergence  of  Mob 


percentage  decreases  as  the -degree  increases.  The  empir¬ 
ical  parallel  complexity  oLthe  AfoiTheuristic  on  the  CM-2 
(on  random  graphs)  is  time  0(log|E|)  with  2\E\  proces¬ 
sors. 

The  absolute  speed  at  which  an  embedding  is  produced 
shows  that  Mob  can  be  implemented*very  efficiently  on  a 
SIMD-style  machine.  It  takes  approximately  36  minutes 
to  find  an  embedding  of  a  500K-vertex,  lM-edge  graph, 
the  largest  graph  that  would  fit  into  the  CM-2,  into  a 
1024  x  512  grid.  Due  to  excessive  run  times,  previous 
heuristics  reported  in  the  literature  were  able  to  construct 
graph  embeddings  only  for  graphs  that  were  100  to  1000 
times  smaller  than  those  used  in  our  experiments.  On 
small  graphs,  where  simulated  annealing  and  other  heuris¬ 
tics  have  been  extensively  tested,  our  heuristic  was  able 
to  find  solutions  whose  quality  was  at  least  as  good  as 
simulated  annealing. 


and  grid  embedding  algorithms  by  conducting  an  extensive 
series  of  experiments  on  the  Connection  Machine  CM-2. 

The  CM-2  is  a  massively  parallel  SIMD  (Single- 
Instruction-Multiple-Data)  machine:  each  /processor  exe¬ 
cutes  the  same  instruction  at  the  same  time  unless  it  has 
been  disabled.  The  SIMD  approach  simplifies  debugging, 
permits  an  elegant  programming  style,  and  does  not  limit 
the  expressiveness  of  algorithms.  The  up  to  64K  moder¬ 
ately  slow  one-bit  processors  of  the  CM-2  are  organized 
as  a  12-dimensional  hypercube  with /sixteen  nodes  at  each 
corner  of  the  hypercube.  The  CM-2  supports  virtual  pro¬ 
cessors  which  are  simulated  very  efficiently  in-microcode. 
Each  processor  has  an  associated  memory  ofup  to  8K  bits. 
The  memory  is  shared  by  passing  messages  among  proces¬ 
sors.  The  CM-2  also  permits  communication  along  hyper¬ 
cube  and  multidimensional  grid  axes,  which  is  substan¬ 
tially  faster  than  the  general  router. 

Our  experimental  data  is  summarized  here  but  reported 
elsewhere  [8].  In  our  experiments,  1-to-l  mappings  of 
graph  vertices  to  network  nodes  were  used  to  model  VLSI 
placement  problems  and  standard  embedding  problems. 
We  also  wanted  to  model  bulk-parallelism,  as  described 
by  Valiant  [10],  where  n  virtual  processors  are  embedded 
into  a  computing  network  of  size  n/  log  n,  and  chose  16-to- 
1  mappings  as  a  rough  approximation  of  log  n-to-1  map¬ 
pings. 

We  conducted  experiments  on  randomly  generated 
graphs  of  small  ( d  —  3 ...  16)  degrees  with  up  to  500K 
vertices  and  1M  edges!  The  number  ofaterations  needed 
by  the  Mob  heuristic  to  reach  a  fixed  percentage  above 
me  best-ever  embedding  cost  appears  to  be  approximately 
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Abstract 

In  parallel  computation,  a  common  requirement  is  the 
mapping  of  a  problem  graph  ofrcommumcating  tasks  ontu 
a  network  graph  of  processing  elements  such  that.  (1)  the 
communication-distance  is  minimized,  and  (2)  the  prob¬ 
lem  graph  is  evenly  distributed  over  the  network.  When 
using  simulated  annealing  on  this  problem,  how  does  the 
relative  structure  of  the  two  graphs  affect  performance? 
To  investigate  this  question,  we  used  simulated  anneal¬ 
ing  to  map  four  graph  types  of  varying  “structure” ,  rep¬ 
resenting  possible  problem  graphs,  onto  a  graph  with  a 
very  regular  structure,  representing  a  network  of  process¬ 
ing  elements.  These  results  show  that  higher  regularity 
produces  (1)  a  higher  but  narrower  range  of  final  energy 
values, ;(2)  a  higher  distance-energy  correlation  and  (3)  a 
higher  degree  of  ultrametricity. 

1  Introduction 

Simulated  Annealing  is  a  computational  technique  of  find¬ 
ing  a  near-optimal  “solution”  to  an  optimization  problem 
by  making  random  changes  in  the  solution  and  proba¬ 
bilistically  accepting  the  change  depending  on  whether  it 
improves  or  degrades  the  solution  [3,  I].  How  well  simu¬ 
lated  annealing  performs  is  dependent  on  the  energy  land¬ 
scape  of  the  configuration  space.  How  can  we  determine 
the  character  of  the  landscape  for  a  given  configuration 
space?  Solla  et  al.  hypothesize  that  configuration  spaces 
exhibiting  a  high  degree  of  ullrameincity  are  more  suit¬ 
able  for  annealing  [7].  Can  we  use  ultrametricity  and  the 
correlation  between  energy  and  distance  to  determine  if 
annealing  will  perform  well  on  a  given  class  of  optimiza¬ 
tion  problems?  Concomitantly,  how  does  the  “structure” 
of  a  class  of  problems  afTect  the  degree  of  ultrametricity 
and  performance?  We  will  investigate  these  questions  by 
mapping  four  different  graph  types  that  represent  prob¬ 
lem  graphs  with  a  range  of  structure  onto  a  regular  net¬ 
work  graph. 

*A  full-length  version  of  this  paper  is  available  from  the  first 
author  at  lee®acrospaco.aero.org. 


2  Four  Graph  Types 

The  energy  metric  we  use  here  for  annealing  is  the 
distance-variance  function  as  defined  in  [1].  This  attempts 
to  spread  a  problem  graph  evenly  over  the  network  graph 
while  minimizing  communication  distance  by  weighting 
the  two  metrics  of  communication  distance  and  the  vari¬ 
ance  of  the  number  of  problem  graph  edges  that  can  be 
said  to  be  incident  on  a  network  graph  vertex  as  a  result 
of  mapping.  Ultrametric  correlation  coefficients  are  com¬ 
puted  as  described  in  [7].  We  now  investigat:  the  effect 
of  problem  structure  on  the  behavior  of  simulated  anneal¬ 
ing  and  quenching  by  mapping  members  of  four  different 
graph  types,  (1)  random,  (2)  geometric,  (3)  torus,  and 

(1)  n  cube,  onto  a  torus.  These  graph  types  were  chosen 
to  represent  a  range  of  “structure".  The  random  graph 
can  be  said  to  have  no  structure.  The  geometric  graph, 
as  defined  below,  has  more  structure  with  similarities  to 
a  torus.  The  torus  and  n-cube  are  very  regular  in  their 
structure  but  are  similar  and  dissimilar,  respectively,  to 
the  network  graph. 

These  graphs  are  defined  in  the  following  way.  All  prob¬ 
lem  graphs  have  32  vertices  and  an  average  vertex  degree 
of  5.  This  ensures  that  any  difference  in  numerical  energy 
results  from  differences  in  graph  structure,  i.e,  how  well 
the  graph  can  be  mapped,  rather  than  just  the  number  of 
vertices  and  edges  involved.  A  random  graph  is  generated 
by  defining  n  vertices  and  connecting  any  two  with  prob¬ 
ability  p  which  results  in  an  average  degree  of  (n  —  l)p 

[2] .  Given  the  desired  degree  of  5,  it  is  easy  to  compute 
the  required  p.  A  geometric  graph  is  generated  by  ran¬ 
domly  distributing  n  vertices  over  the  unit  square  and 
connecting  any  two  vertices  that  are  contained  within  a 
square  with  side  0  <  k  <  1  where  this  smaller  square  can 
wrap-around  to  the  other  sides  of  the  unit  square.  This 
definition  is  intended  to  produce  a  topology  similar  to  a 
torus.  (If  wrap-around  was  not  allowed,  the  generated 
graph  would  be  more  similar  to  the  layout  of  a  printed 
circuit  board  as  defined  in  [2].)  Here  the  average  degree 
is  ink2.  Given  the  desired  degree  of  5,  it  is  easy  to  com¬ 
pute  the  required  k.  The  problem  torus  will  be  a  4  x  8 
grid  but  with  extra  edges  added  in  a  symmetric  manner 
such  that  each  vertex  has  a  degree  of  5.  Finally,  the  n- 
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32  0.66 


Figure  1:  Distance-Energy  Surface;  Random 


32  0.68 

Figure  2:  Distance-Energy  Surface;  Geometric 


32  1.78 


Figure  4:  Distance- Energy  Surface;  n-Cubc 


cube  with  32  vertices  naturally  has  a  degree  of  5.  Finally, 
the -network  graph  will  be  a  3  a  3  torus,  each  vertex  will 
have  a  degree  of  -1  in  the  typical  grid  fashion.  This  net¬ 
work  graph  may  seem  small  but  it  is  not  a  degenerate 
torus  and  it  was  deemed  necessary  to  hold  down  the  cost 
of  checking  permutations.  All  of  these  graphs  may  seem 
small  but  each  configuration  space  has  a  size  of  93-. 

For  each  problem  graph,  we  will  do  i.00  slower  anneal¬ 
ings  and  100  faster  annealings  (called  quenchings^  onto 
the  network  graph.  In  all  cases,  the  same  initial  map¬ 
ping  will  be  used  but  with  a  different  seed  for  the  random 
number  generator.  In  all  cases,  an  even  0. 5/0.5  weight¬ 
ing  will  be  used  in  the  distance-variance  energy  function. 
The  temperature  control  parameter  has  an  initial  value  of 
100  (&  50  x  the  initial  energy  value)  and  an  exponential 
decay  factor  of  0.9.  At  each  temperature,  thermal  equi¬ 
librium  will  be  determined  as  in  [3].  for  a  problem  of  size 
n,  equilibrium  is  reached  after  an  changes  have  been  ac¬ 
cepted  or  bn  changes  have  been  attempted  (accepted  or 
not),  whichever  comes  first.  The  user  is  free  to  choose  a 
and  b  under  the  constraint  that  0  <u  a  <  b.  For  quench¬ 
ing,  a/b  —  1/2.  For  annealing,  a/6  —  128/25G.  The  algo¬ 
rithm  terminates  when  the  configurations  at  the  last  three 
consecutive  temperatures  show  no  improvement,  i.e.,  the 
configuration  is  “frozen”  [5J. 

For  each  quenched  solution  within  each  graph  type,  the 
map  permutation  with  the  minimum  distance  to  any  an¬ 
nealing  solution  is  found.  We  then  plot  the  distance  versus 
the  energy  as  a  histogram  surface  as  shown  in  Figures  1 


to  4.  All  annealed  solutions  are  set  at  distance  zero  and 
the  distance  axis  shows  how  far  away  the  closest  quenched 
solution  permutations  are.  Since  the  problem  graphs  all 
have  32  vertices,  all  distances  arc  in  the  range  (0, 32).  The 
energy  axis,  however,  is  scaled  to  the  minimum  and  max¬ 
imum  values  of  all  annealings  and  quenchings  and  then 
quantized  into  32  bins.  The  vertical  axis  then  shows  the 
number  of  solutions  in  a  particular  bin.  The  vertical  scale 
is  arbitrary  but  uniform  across  all  graphs.  This  graphical 
display  shovvo  at  a  glance  the  distribution  of  the  annealed 
and  quenched  solutions  relative  to  one  another.  For  com¬ 
parison,  the  general  distance  distribution  of  all  possible 
configurations  from  any  one  configuration  is  shown  as  a 
dotted  curve. 

Figures  1  to  1  show  the  following.  The  random  and 
geometric  graphs  have  very  similar  results,  there  is  a  sig¬ 
nificant  range  of  annealed  energies  and  an  even  broader 
range  of  energies  for  the  quenched  solutions.  The  addi¬ 
tional  "structure"  in  the  geometric  graph  did  not  signif¬ 
icantly  change  the  distribution  of  solutions  found.  All  of 
the  quenched  solutions  are  in  a  narrow  range  of  distances 
from  their  closest  annealed  solutions.  There  is  no  appar¬ 
ent  correlation  between  the  distance  between  solutions 
and  their  difference  in  energy.  In  fact,  the  distribution  of 
quenched  solutions  seems  strongly  influenced  by  the  prob¬ 
ability  uf  finding  a  close  configuration  within  the  general 
distribution  of  configurations. 

The  torus  and  n-cube  graphs,  however,  tell  a  different 
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Graph  Type 

Quenching 

Annealing 

random 

0.028 

0.036 

geometric 

0.033 

0.035 

torus 

0.238 

0.401 

n-cube 

0.167 

0.222 

Table  1:  Ultrametric  Correlation  Coefficients 


story.  The  annealed>solutions  have  a  tightly- clustered  en¬ 
ergy  range.  (For  the  sake  of  typesetting,  the  peaks  in 
these  surfaces  have  been  truncated.)  The  quenched  solu¬ 
tions  show  a  definite  correlation  between  distance  and  en¬ 
ergy  aside  from  a  few  solutions  trapped  in  high  local  min¬ 
ima.  The  ultrametric  correlation  coefficients  were  com¬ 
puted  as  discussed  in  the  previous  section  and  are  shown 
in  Table  1.  This  clearly  supports  the  notion  that  simu¬ 
lated  annealing  performs  better  in  a  configuration  space 
that  exhibits  ultrametricity  which  is,  in  turn,  related  to 
the  correlation  between  distance  and  energy  difference. 
What  the  graph  types  tell  us  is  that  this  correlation  is  de¬ 
pendent  on  the  regular  and  self-similar  structure  present 
in  the  problem. 

The  differences  discussed  so  far,  however,  are  relative 
differences.  Figure  5  shows  the  absolute  energy  range 
for  quenching  and  annealing  for  the  four  different  graph 
types  including  the  initial  map  energy.  This  shows  that 
while  the  random  and  geometric  graphs  start  at  a  equal  or 
much  higher  energy,  they  finish  in  an  energy  range  that 
is  broader  and  much  lower  than  the  torus  and  n-cube. 
(Note  that  these  bars  exclude  solutions  trapped  in  high 
local  minima.)  What  this  tells  us  is  that  graph  structure 
affects  the  size  and  distribution  of  local  minima  that  trap 
annealing  and  quenching. 

3  Summary  and  Conclusions 

These  experiments  have  shown  that  higher  regularity  in 
the  problem  graph  produces  (1)  a  narrower  but  higher 
range  of  final  energy  values,  (2)  a  correlation  between 
move  distance  and  energy,  and  (3)  a  higher  uitramel- 
ric  correlation.  The  fact  that  quenched  solutions  with  a 


higher  energy  can’t  find  a  closer  annealed  solution  implies 
that  the  configuration  space  itself  has  a  regular  shape, 
that  “valleys”  with  the  same  shape  have  multiple  occu- 
rances  such  that  a  quenching  thatlands  with  energy  E  in 
one  valley  may  be  distant  from  an  annealing  with  energy 
E—e  in  another  valley  but  has  a-closer  isomorphic  permu¬ 
tation  in  that  same  valley.  Such  an  interpretation's  con¬ 
sistent  with  the  argument  given  by  Sollaet  al.  in  support 
of  the  correlation  between  move  distance  and  ultrametric¬ 
ity.  However,  it  is  an  open  question  whether  these  configu¬ 
ration  spaces  have  ‘self-similar’  or  ‘fractal-like’  valleys,  as 
described  in  [6],  such  that  similarly-shaped  valleys  occur 
with  a  recursively  decreasing  size.  The  observations  dis¬ 
cussed  so  far  lead  us  to  conjecture  that  regularity  in  any 
optimization  problem  produces  a  configuration  space  that 
reflects  the  same  structure  in  which  low-lying  minima  are 
ultrametrically  distibuted.  This  implies  that  when  higher 
regularity  exists,  ashorter  annealing  schedule  can  be  used 
with  a  higher  probability  that  the  resulting  maps  will  not 
be  far  apart  in  energy. 
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PROPERTIES  OF  SIMULATED  ANNEALING 
WITH  INACCURATE  COST  FUNCTIONS 

Daniel  R.  Greening* 


ABSTRACT 

Inaccurate  cost  or  energy  functions  appear  in  many  paral¬ 
lel  simulated  annealing  implementations.  Such  errors  alter  the 
■  equilibrium  cost,  change  the  speed  to  approach  equilibrium,  and 
affect  the  quality  of  the  final  result. 

We  show  that  identically  distributed  Gaussian  errors  do  not 
affect  equilibrium.  Non-id  Gaussian  errors  and  bounded  errors 
can  alter  equilibrium;  such  changes  vary  with  temperature  and 
error  magnitude.  The  convergence  speed  under  bounded  errors 
also  depends  on  temperature  and  error  magnitude. 

Finally,  we  show  that  constraining  errors  to  a  constant  factor 
of  the  temperature  guarantees  convergence  in  a  restricted  case. 


1  INTRODUCTION 

Simulated  annealing  is  an  algorithm  to  find  nearly-optimal  solu¬ 
tions  to  f/P-hard  problems  [1].  Figure  1  outlines  the  approach:  sQ  is 
theinitial  state,  G,y  is  the  generation  probability,  random  returns  an 
uniformly  distributed  random  number  from  [0,1],  C  is  the  cost  func¬ 
tion,  and  T  is  the  temperature.  The  sequence  of  temperatures  T;  is 
the  temperature  schedule.  It  is  generally  presumed  that  an  optimum 
schedule  keeps  the  average  observed  cost  close  to  its  equilibrium  value 
(not  necessarily  true,  see  [2]). 

1.  T «-  T0; 

2.  s «-  So; 

3.  while  not  done 

4.  s' «-  generate(s)  with  probability  G,y, 

5.  A  <-  C(s)  -  C(s'); 

6.  if  (A  <  0)  V  (random()  <  then  s  <—  s'; 

7.  T  *-reduce-tomperature(T); 

8.  end  while; 

Figure  1.  Simulated  Annealing  Algorithm 

Many  parallel  implementations  involve  approximate  cost  functions 
[3].  Some  sequential  implementations  also  use  approximate  functions; 
examples  include  congestion  and  wire-length  estimates  in  circuit  place¬ 
ment  [I]. 


l.T  Annealing  Properties 

Define  acceptance  matrix  at  time  t,  AW,  A^J,  =  e*n,nP>(cW-c(*'))/7»). 
Dcfie"  inhomogeneous  Markov  chain  P  for  simulated  annealing, 


f 

l  i-£xV*'fW- 


if  s  s' 
otherwise 


If-wc  fix  the  temperature,  A^  =  A,  P^’  =  P,  and  the  chain  is  homoge¬ 
neous.  If  it  is  also  crgodic,  each  state  s  has  an  equilibrium  probability 
p(s)  independent  of  the  initial  state. 

‘University  of  California,  Los  Angeles.  dgrcenQcs.iicla.edu. 


Existing  programs  attempt  to  bring  state  probabilities  close  to 
equilibrium  at  each  femperature:[l].  Thus,  we  can  gain  information 
about  annealing  behavior  by  looking  at  the  homogeneous  chain. 

We  can  guarantee  ergodicity: if  these  properties  hold. 


probability 

Vses,£G,,..  =  i 

*'65 

(1) 

coverage 

Vs,s'  £S,  3k  >l,[(Gk),y?0] 

(2) 

aperiodicity 

3s  e  S,[P,.,  £  0] 

(3) 

finiteness 

|S|  e  z+ 

« 

symmetry 

V(s,s')  €  5  x  5,[Gm<  =  (?,.,,] 

(5) 

(1)  states  that  G,  is  a  probability  vector.  (2)  guarantees  that  the 
annealing  chain  is  irreducible.  .(3)  and  (4)  make  the  chain  is  aperiodic 
and  finite.  Irreducible,  aperiodic,  finite  Markov  chains  are  ergodic. 

1.2  Inaccurate  Cost  Functions 

Parallel  algorithms  can  reduce  communication  costs  by  using  some 
stale  information,  instead  of  maintaining  elaborate  synchronization  to 
keep  local  information  up-to-date.  Stale  data  cause  inaccuracies  in  the 
cost.  Experiments  show  that  allowing  inaccuracies  can  improve  speed, 
but  can  degrade  results  [4,  5]. 

Two  questions  arise:  How  does  the  result  quality  of  asynchronous 
simulated  annealing  compare  to  that  of  sequential  simulated  anneal¬ 
ing?  How  fast  does  asynchronous  simulated  annealing  converge  to  a 
solution,  compared  to  sequential  simulated  annealing? 

Using  a  thermodynamic  analogy,  Grover  showed  the  effect  of  bound 
ed  errors  on  the  partition  function  [6].  Durand  and  White  analyzed 
equilibrium  properties  for  bounded'errors  on  a  restricted  algorithmic 
class  [7].  Gelfand  and  Mitter  showed  that  state-independent  noise, 
under  some  conditions, -.will  not  affect  asymptotic  convergence  [8]. 

We  do  not  assume  state-independence;  most  applications  appear  to 
exhibit  strongly  state-dependent  errors.  We  expand  the  scope  further 
by  considering  both  fixed  error  bounds  and  Gaussian  errors  in  the 
general  case,  and  by  examining  the  effect  of  bounded  errors  on  speed. 

Experiments  have  hinted  that  when  errors  arc  proportionally  con¬ 
strained  to  temperature,  results  improve.  Invoking  these  observations, 
researchers  have  modified  asynchronous  algorithms  to  obtain  better 
final  states  [9, 10].  Our  last  result  validates  their  assumptions. 

Proofs  for  equilibrium  properties  and  convergence  speed  are  omit¬ 
ted  (sec  [ll]).  Proof  of  the  final  result,  on  convergence  to  global  op¬ 
tima,  is  retained. 

2  EQUILIBRIUM  PROPERTIES 

We  refer  to  the  true  cost,  C(s),  of  state  s,  and  the  erroneous  cost 
C{(s)  =  C(s)  +  <(s),  of  state  s.  c  is  a  random  variable  dependent  on 
s,  thus  Cc(s)  is  a  random  function. 

2.1  Bounded  Errors 

If  cost-function  errors  arc  bounded,  then  we  have  i  <  e  <  t. 
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Theorem  1  Let  p((s,T)  and  p(s,T)  be  the  equilibrium  probabilities 
of  state  s  at temperature  T,  with  ooundcd  errors  and  without  errors, 
respectively.  Then, 

c^lrp{s,T)  <  pc(s,T)  <  e<?-^Tp(S,T)  (6) 

Equilibrium  behavior  is  often  characterized  by  its  “macroscopic 
properties.”  Any  macroscopic  property,  F(T),  is  the  expected  value 
of  some  function,  f(s),  over  the  state  space, 

F(T)  =  ^f(s)p(SlT)  (7) 

$es 

Theorem  2  Let  F((T)  and  F(T)  be  equivalent  macroscopic  proper¬ 
ties,  for  function  f,  at  temperature  T,  with  cost  functions  Ct  and  C, 
respectively.  Then 

ek -?)/tf(T)  <  Fe(T)  <  e^/TF(T)  (8) 

A  commonly  measured  macroscopic  property,  the  average  cost,  is 
constrained  by  Theorems. 


2.2  Gaussian  Errors 

Simulated  annealing  typically  operates  on  structures  with  discrete  cost 
functions:  thus  the  errors  appear  as  discrete  values.  However,  as  we 
add  state  variables  and  as  the  maximum  number  of  uncorrected  in¬ 
terdependent  moves  increases  (through  increased  parallelism  or  slower 
update  times),  the  errors  can  approach  a  Gaussian  distribution. 

In  many  instances,  particularly  in  parallel  applications,  the  proba¬ 
bility  distribution  of  the  observed  cost  function  Ct(s)  is  reflected  about 
the  true  cost  C(s).  Cost-Junctions  exhibiting  this  behavior  appear  m 
work  by  Durand  and  White  [7). 

Thus,  it  is  reasonable  to  investigate  the  effect  of  Gaussian  random 
cost  function  C^,  with  mean  2S[C<s(s)]  =  C(s).  We  will  show  that 
when  the  variances  of  the  state  costs  do  not  differ  greatly,  simulated 
annealing  with  inaccurate  costs  converges  to  a  good  solution. 

Lemma  1  Let  the  cost  of  each  state  s  be  C${s)  =  C(s)+X„  where  X, 
is  an  independent  random  variable.  Execute  the  simulated  annealing 
algorithm  in  Figure  1  with  lines  3  and  6  sampling  random  variables 
Co(s)  and  Cj(s')  instead  of  bounded  random  variables,  and  with  T 
fixed.  If  (1  J-(3)  are  satisfied  and  T  >  0,  the  resulting  homogeneous 
Markov  chain  P$  is  ergodic,  and  the  equilibrium  probabilities  are  given 

_ e-oWEje-W ) 


MO  = 


£/ese-cw/r£[e- 


Corollary  1  If  all  X,  are  identically  distributed,  and  the  resulting 
Markov  chain  is  ergodic,  then  p#  =  p  and  F$  =  F. 

Theorem  3  Let  C:S  -*  R  be  a  cost-function,  and  let  its  station¬ 
ary  Boltzmann  distribution  be  p-.S  -»  [0,1).  Consider  a- random  cost 
function  <f>:  S  — »  R,  where  each  random  variable  f(s)  is  an  indepen¬ 
dent  Gaussian  distribution  with  mean  C(s)  and  variance  a2(s).  Let 
p$\  S  -i  (0, 1]  give  its  stationary  Boltzmann  distribution.  Then  pt(s) 
can  be  bounded  by 

e&-*)W1p{a)  <  pi{s)  <  ^-2?)/^^)  (10) 

Corollary  2  Macroscopic  property  F&  is  bounded  by 

’F(T)  <  F*(T)  <  e^-^/1T7F(T)  (11) 


3  EQUILIBRIUM  MIXING  SPEED 


If  P  is  a  Markov  chain  and  p(i)  is  the  stationary  probability  of 
state  i,  define  the  conductance  of  a  subset,  fv,  V  g  S  as 


p(QP<j 
Eiev  MO 


(12) 


In  words,  the  conductance  of  a  subset  V  is  the  conditional  probability 
that  a  transition  will  leave  V,  given  that  we  start  in  V. 


Let  p(V)  =  EvevPW,  and  let  si/2.=  iv  C  %(V)  <  1/2}. 

Define  the  global- conductance  as  the  minimum  conductance- over  all 
subsets  with  stationary  probability  below  1/2,  thus, 

$  =  min  d>v  (13) 

This  global  conductance  provides  a  good  measure  for  annealing  speed 
It  is  related  to  another  speed  measure,  the  dominant  eigenvalue  [12]. 

Others  have  examined  the  effect  of  adjusting  the  move  spaces  to 
obtain  better  annealing  speed,  using  conductance  and  eigenvalues  [13, 
14).  Here,  we  show  how  the  size  of  the  errors  constrain  the  global 
conductance. 

Theorem  4  Consider  two  different  annealing  chains  P  and  P,_,  with 
stale  space  S  and  generation  probability  G  identical.  Annealing  chain 
P  has  cost  function  C,  and  Pe  has  cost  function  Ce.  They  are  related 
by  C{s)  +  e<  Cc  <  C(s)  +  ?.  Let  $  and  be  the  corresponding  global 
conductances.  Then, 

e3(<-r)/r$t  <  $  <  e3(f-£)/r$e  (14) 

4  CONVERGENCE  TO  GLOBAL  MINIMA 

Simulated  annealing  can  be  made  to  converge  monotonically  to  the 
optimum  result,  using  an  appropriate  temperature  schedule  Define 
global  optima  set  S0  such  that  s  e  Su  C(s0)  =  min{C(s')|s'  6  5} 
The  most  general  results  presume  no  particular  structure  to  the 
state  space,  other  than  those  specified  by  (l)  (5).  We  pay  a  penalty 
in  time  for  generality.  Under  these  prepositions,  a  simulated  annealing 
temperature  schedule  with  T(t)  -  c/logt  will  converge  to  the  mini¬ 
mum  energy  states  [15, 16). 

Proofs  of  convergence  for  these  general  spaces  consider  sets  of  local 
minima  Rk,  and  presume  the  cost  function  returns  an  integer.  Let  R° 
be  the  set  of  all  local  minima.  Roughly,  (Rk  \  R14-1)  is  the  set  of  local 
minima  which  can  be  escaped  to  a  lower  cost  by  ascending  a  change 
in  cost  of  k  (i.e.,  the  height  of  the  cup  containing  the  local  minimum). 
Thus,- if  the  state  set  is  finite  and  fully  connected,  there  is  some  d  such 
that  Rd  C  So  (sec  [16]  for  a  rigorous  definition). 

Theorem  5  Suppose  an  annealing  chain  satisfies  (1)  (5)  and  has  cost 
function  C,(s,  t)  with  time  and  state  dependent  errors  e(<),  such  that 

Cc(s)  +  c(t)  <  Cc(s,  t )  <  Ct(«)  +  Z(t).  (15) 

Let  b\T(t)  <  <(t)  <  c(t)  <  hT(t),  where  bt  and  b?  are  constants.  Let 
the  temperature  schedule  be  of  the  form  T(t)  =  d/logt,  where  d  e  Z0+. 
Then  the  algorithm  converges  in  probability  to  the  set  of  global  minima 
if  Rd  C  So. 

Proof.  Suppose  the  transition  matrix  P‘  for  some  Markovian  system 


at  time  t  is  constrained  by  (16). 

c1c-W)<p«.<C2C-o?>/T(0)  (16) 

where  ci  and  cj  are  positive  constants.  Assume  for  some  integer  d  >  0 
that  (17)  and  (18)  hold. 

fy^o^oo  (i7) 

(=0 

ge-*-i/r«)<00  (18) 

<=o 

We  can  then  conclude  that  (19)  and  (20)  arc  true  [16). 

HieS,  KmP(X(t)eRd\X{0)  =  i)  =  l  (19) 

Vi  6  RJ,  lim  sup  P{X(t)  =  i|A'(0)  =  i)  >  0  (20) 

t-*oo 


Let  Ci  =  e~l‘  and  cj  =  c-i>.  These  values  satisfy  (15)  and  (16). 

Choose  d  so  that  Rd  C  So-  Such  a  d  must  exist,  since  (l)-(5)  arc 
satisfied.  Let  T(t)  =  d/logt.  This  satisfies  (17)  and  (18).  By  (19) 
the  erroneous  simulated  annealing  algorithm  converges  in  probability 
to  the  set  of  global  minima.  ■ 
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5  CONCLUSION 

Calculation  errors  in  simulated  annealing  affect  the  equilibrium 
cost  and  the  speed  at -which  equilibrium isrreachcd.  Analytic  results 
presented  in  this  manuscript  constrain  equilibrium  properties  with  a 
bounded  or  Gaussian  random  cost  function.  In  addition,  we  constrain 
annealing,speed  with  a  bounded  cost  function. 

For  bounded  errors,  as  the  range  of: the  observed  cost  increases 
relative  to  the  true  cost,  equilibrium  properties  and  annealing  speed 
diverge  exponentially  from  true  equilibrium  and  sequential  anneal¬ 
ing  speed.  For  Gaussian  errors,  as  the  difference  between  the  lowest 
and  highest  variances  increases,  equilibrium  properties  diverge  expo¬ 
nentially.  Finally,  all  these  quantities  diverge  exponentially  with  the 
inverse-temperature. 

Researchers  have  speculated  that  tuning  errors  to  a  constant  fac¬ 
tor  of  temperature  helps  the  system  converge.  Our  final  result  shows 
that  guess  to  be  correct,  at  least  in  the  case  of  inverse  logarithmic 
temperature  schedules. 

This  work  was  supported  by  the  IBM  T.J.  Watson  Research  Center.  I 
gratefully  acknowledge  the  comments  of  Frederica  Darema,  John  Tsit- 
siklis,  Albert  Boulanger,  and  Griff  Bilbro. 

REFERENCES 

[1]  S.  Kirkpatrick,  Jr.  C.  D.  Gelatt,  and  M.  P.  Vecchi.  Optimization 
by  simulated  annealing.  Science,  220(4598):671-G80, 1983. 

[2]  Philip  N.  Strenski  and  Scott  Kirkpatrick.  Analysis  of  finite  length 
annealing  schedules.  Research  Report  RC  14672,  IBM,  June  1989. 

[3]  Daniel  R.  Greening.  Parallel  simulated  annealing  techniques. 
Physica  D:  Nonlinear  Phenomena,  42:293-306, 1990. 

[4]  Daniel  R.  Greening  and  Frederica  Darema.  Rectangular  spa¬ 
tial  decomposition  methods  for  parallel  simulated  annealing.  In 
Proceedings  of  the  International  Conference  on  Supercomputing, 
pages  295-302,  Crete,  Greece,  June  1989. 

[5]  Frederica  Darema,  Scott  Kirkpatrick,  and  Alan  V.  Norton.  Par¬ 
allel  algorithms  for  chip  placement  by  simulated  annealing.  IBM 
Journal  of  Research  and  Development,  31(3):391-402,  May  1987. 

[6]  Lov  K.  Grover.  Simulated  annealing  using  approximate  calcu¬ 
lation.  In  Progress  in  Computer  Aided  VLSI  Design,  volume  6. 
Ablex  Publishing  Corp.,  1989. 

[7]  M.D.  Durand  and  Steve  R.  White.  Permissible  error  in  parallel 
simulated  annealing.  Research  Report  RC  15487,  IBM,  1990. 

[8]  Saul  B.  Gelfand  and  Sanjoy  K.  Mittcr.  Simulated  annealing  with 
noisy  or  imprecise  energy  measurements.  Journal  of  Optimization 
Theory  and  Applications,  62(1):49-G2,  July  1989. 

[9]  Prithviraj  Bancrjec,  Mark  Howard  Jones,  and  Jeff  S.  Sargent. 
Parallel  simulated  annealing  algorithms  for  cell  placement  on  hy- 
pcrcubc  multiprocessors.  IEEE  Transactions  on  Parallel  and  Dis¬ 
tributed  Systems,  l(l):91-106,  January  1990. 

[10]  Andrea  Casotto,  Fabio  Romeo,  and  Alberto  Sangiovanni- 
Vincentclli.  A  parallel  simulated  annealing  algorithm  for  the 
placement  of  macro-cells.  IEEE  Transactions  on  Computer-Aided 
Design,  CAD-6(5):838-847,  September  1987. 

[11]  Daniel  R.  Greening.  Simulated  annealing  with  inaccurate  cost 
functions.  Technical  report,  UCLA  Computer  Science  Dept.,  Los 
Angeles,  1991. 

[12]  Andrei  Brodcr  and  Eli  Shamir.  On  the  second  eigenvalue  of  ran¬ 
dom  regular  graphs.  In  Proceedings  of  the  28th  IEEE  Symposium 
on  the  Foundations  of  Computer  Science,  pages  2SG-294,  1937. 


[13]  Gregory  B.  Sorkin.  Simulated  annealing  on  fractals:  Theoret¬ 
ical  analysis  and  relevance  for  combinatorial  optimization.  In 
William  J.  Dally,  editor,  Advanced  Research  in  VLSI,  pages  331- 
351.  MIT  Press,  Cambridge,  Massachusetts,  1990. 

[14]  R.H.J.M.  Otteh  and  L.P.P.P.  van  Ginncken.  The  Annealing  Al¬ 
gorithm.  Kluwer  Academic  Publishers,  Boston,  1989. 

[15]  Bruce  Hajek.  Cooling  schedules  for  optimal  annealing.  Mathe - 
matics  of  Operations  Research,  13(2). 311  329,  May  1988. 

[16]  _  John  N.  Tsitsiklis.  Markov  chains  with  rare  transitions  and  sim¬ 
ulated  annealing.  Mathematics  of  Operations  Research,  14(l):70- 
90,  February  1989. 


826 


Time-homogeneous  Parallel  Annealing  Algorithm 


KouicKi  Kimura  Kazuo  Taki 

Institute  for  New  Generation  Computer  Technology 
1-4-28  Mita,  Minato-ku,  Tokyo  108,  Japan 


Abstract 

We  propose  a  new  parallel  simulated  annealing  algorithm.  Each  pro 
cessor  maintains  one  solution  and  performs  the  annealing  process  con 
currently  at  a  constant  temperature  that  differs  from  processor  to  pro 
cessor,  and  the  solutions  obtained  by  the  processors  arc:exchanged 
occasionally  in  some  probabilistic  way.  An  appropriate  cooling  ached 
ule  is  automatically  constructed  from  the  set  of  temperatures  that  are 
assigned  to  the  processors.  Thus  we  can  avoid  the  task  of  carefully 
reducing  the  temperature  according  to  the  time,  which  is  essential  for 
the  performance  of  the  conventional  sequential  algorithm. 

In  this  paper  we  propose  a  scheme  of  the  probabilistic  exchange  of 
solutions  and  justify  it  from  the  viewpoint  of  probability-theory.  We 
have  applied  our  algorithm  to  a  graph-partitioning  problem.  Results 
of  experiments,  and  comparison  with  those  of  the  sequential  annealing 
algorithm  and  the  Kernighan-Lin  algorithm,  are  discussed. 


1  Introduction 

Simulated  annealing  is  a  general  and  powerful  technique  to  solve  dif 
ficult  -  combinatorial  optimization  problems  [1],  It  consists  off  many 
iterative  steps,  each  modifies  the  current  solution  randomly  and  ac 
cepts  it  with  probability  min{l,exp(- AE/T)).  Here  -A£  represents 
the  gain  obtained  by  the  proposed  modification  in  terms  of  the  en¬ 
ergy  (objective  function)  E,  and  T  >  0  is  the  temperature  which  is 
gradually  reduced  according  to  a  cooling  schedule. 

Unfortunately,  the  theoretically  optimal  cooling  schedule,  which 
guarantees  the  convergence  to  the  optimal  solution,  proves  to  be  too 
slow  for  practical  use  [2].  Cooling  schedules  vvith  geometrically  de 
creasing  temperatures  are  often  used  in  applications.  To  obtain  more 
elaborate  cooling  schedules  is  an  active  area  of  research  [3]. 

In  this  paper  we  propose. a  new  parallel  simulated  annealing  algo¬ 
rithm.  It  automatically  constructs  an  appropriate  cooling  schedule 
from  a  given  set  of  temperatures. 

2  An  Annealing  Algorithm  Parallelized  in 
Temperature 

2.1  Outline  of  the  Algorithm 

The  basic  idea  is  to  use  parallelism  for  various  temperatures,  to  per¬ 
form  annealing  processes  concurrently  at  various  temperatures  instead 
of  sequentially  reducing  the  temperature  according  to  the  time. 

The  outline  of  the  algorithm  is  as  follows.  Each  processor  maintains 
one  solution  and  performs  the  annealing  process  concurrently  at  a 
constant  temperature  that  differs  from  processor  to  processor.  After 
every  k  annealing  steps,  every  pair  of  the  solutions  from  the  processors 
with  adjacent  temperatures  are  exchanged  with  some  probability  p, 
which  is  distinct  for  each  pair.  The  algorithm  can  be  stopped  after 
any  large  number  of  steps  and  we  will  find  a  well-optimized  solution 
on  the  processor  that  has  the  lowest  temperature.  We  refer  to  /  =  1/k 
as  the  frequency  of  ( probabilistic )  exchanges  and  p  as  the  probability  of 
exchange. 

Since  exchanging  the  solutions  between  processors  with  different 
temperatures  is  nothing  but  changing  the  temperature  for  each  partic¬ 
ipant  solution,  each  solution  will  select  its  appropriate  cooling  sched 
ule  dynamically  through  successive  competitions  with  others  for  lower 


temperature.  However,  since  the  temperature  on  each  processor  re¬ 
mains  constant,  the  algorithm  itself  is  time-homogeneous.  Thus  we 
can  avoid  the  task  of  carefully  reduung  the  temperature  according  to 
the  lime,  which  is  essential  for  the  performance  of  the  conventional 
sequential  annealing  algorithm.  In  other  words,  this  algorithm  auto¬ 
matically  decides  how  many  steps  should  be  taken  at  each  temperature, 
the  majonly  of  steps  should  be  devoted  to  some  critical  temperatures. 

However,  it  is  necessary  to  allocate  an  appropriate  temperature  to 
each  processor  beforehand.  Namely,  we  have  to  specify  a  set  of  tem¬ 
peratures,  from  which  the  algorithm will  construct  a  cooling  schedule. 
This  set  should1  be  chosen  wisely  according  to  the  estimation  of  the 
equilibrium  ^static)  relation  between  the  temperature  and  the  energy. 
It  must  cover  the  region  of  temperature,  only  in  which  the  equilibrium 
energy  varies  virtually.  Here  the  concepts  of  the  scales  by  S.  White 
will  be  useful  [4]  . 


2.2  Probability  of  Exchange 


Investigating  the  necessary  condition  which  the  probabilistic  exchange 
must  satisfy,  we  determine  the  probability  ofexchange. 

Imagine  that  the  annealing  process  is  performed  independently  at 
each  processor  at  a  distinct  constant  temperature.  Then  the  distribu¬ 
tion  of  the  solution  in  each  processor  approaches  Boltzmann  distribu¬ 
tion  of  the  respective  temperature  [3].  The  lower  the  temperature  is, 
the  better  the  solution  that  will.be  found,  but  after  a  longer  time. 

Now  we  introduce  probabilistic  exchanges  of  the  solutions  between 
the  processors  and  intend  to  accelerate  the  convergence  of  the  solutions 
so  that  we  can  find  a  better  solution  at  the  lowest  temperature  more 
quickly. 

Let  p\T,E,T’,E’)  denote  the  probability  of  the  exchange  between 
two  solutions  with  energy  E  and  E',  at  temperatures  T  and  T'. 
Since  we  expect  a  better  solution  at  a  lower  temperature,  we  define 
p(T,E,  T',E ')  =  1  if  (T  -  T'){E  -  E’)  <  0. 

On  the  other  hand,  if  {T-T'){E-E')  >  0,p(I, E,T',E')  is  uniquely 
determined  as  follows.  In  order  to  accelerate  the  convergence,  a  prob¬ 
abilistic  exchange  of  the  solutions  must  not  disturb  the  equilibrium 
distribution.  Hence  the  detailed  balance  equation  must  hold  between 
the  distributions  before  and  after  the  exchange: 


^ycxp(- |)  •  — cxp(-|^)  -  p{T,E,r,E') 


~  Z(T) CXp('  P 


1  ,  E.  , 

Z{T‘)  CXp(  T'  " 1 


where  Z(T)  denotes  the  partition  function.  Therefore  we  obtain 

AT-AE  <  0 
otherwise 


p(T,E,r,E')  -  |  cxp(_AjQA£)  ot, 


where  AT  =  T-F ,  AE  =  E-E' 


Note  that  p{fT,E,T',E’)  >  0  for  VT  V£  VT'  V£'.  This  means  that  a 
solution  can  go  through  a  non-monotonic  cooling  schedule. 

This  probability  is  quite  different  from  that  of  choosing  a  solution- 
temperature  pair  in  the  systolic  statistical  cooling  algorithm  by 
E.  Aarts  cl  al.  (5).  The  advantage  of  the  former  is  that  it  does  not 
contain  the  partition  function  and  hence  can  be  computed  easily. 


2.3  Monotonic  Convergence  Property 

We  verify  that  each  probabilistic  exchange  of  solutions  in  fact  acceler¬ 
ates  the  convergence  of  the  algorithm. 
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Let  p  denote  the  distribution  of  the  solutions  at  an  arbitrary  time. 

It  will  change  into  pA  after  one  annealing  step  at  each  processor,  or 
into  pC  after  one  probabilistic  exchange  for  each  pair  of  solutions, 
where  A  and  C  are  the  respective  transition  probability  matrices  [6]. 
Let  7r  denote  the  equilibrium  distribution.  It  can  be  shown  [6]  that 

D(tt\\p)  >  D(~\\pA)  and  jD(-||p)  >  D(rr\\pC) 

where  D(7r||p)  denotes  Kullback-Leibler  divergence  of  rt  and  p,  which 
represents  the  discrepancy  between  them  [7).  Here  strict  inequalities 
hold  unless  p  =  rr.  Moreover  D(tt\\p)  —>  0  follows  from  the  observation 
in  the  subsequent  subsection. 

Hence  the  distribution  of  the  solutions  monotomcally  approaches  the 
equilibrium  distribution  during  the  execution. 

2.4  Time-homogeneity 

The  above  algorithm  is  time-homogeneous:  it  has  no  control  parameter 
to  change  over  time.  This  has  two  implications. 

Firstly,  the  behavior  of  the  algorithm  is  described  in  terms  of  a  time- 
homogeneous  Markov  chain.  In  general  it  is  an  irreducible  and  acyclic 
Markov  chain  over  a  finite  state  space.  Hence  we  can  easily  establish 
its  convergence  property  [6]. 

Secondly,  in  executing  the  algorithm,  we  can  stop  it  at  any  time  and 
examine  whether  a  satisfiable  solution  has  already  been  obtained.  If 
one  has  not,  we  can  resume  it  again  for  a  better  solution,  and  can  just 
continue  it  as  long  as  we  like.  In  contrast,  in  the  conventional  sim¬ 
ulated  annealing  it  is  necessary  to  re-schedule  the  temperature  when 
we  resume  it,  once  it  has  entered  the  lowest  temperature. 

3  Experimental  Results 

We  have  implemented  our  algorithm  for  a  graph-partitioning  problem 
on  the  Multi-PSI/V2  [9],  an  MIMD  parallel  machine  with  64  PEs. 
(graph-partitioning  problem)  Given  a  graph  G  -  (V,£),  define  a 
label  on  the  vertices  A  :  V  -*  {±1}  so  as  to  minimize  E,  where 

E  =  -  ^2  A(u)A(v)  +  c  •  A(u))2,  (c  >  0:  constant) 

(<i,v)6£  v£V 

This  is  an  NP-hard  problem.  Kcmighan-Lin  algorithm  efficiently 
gives  its  approximate  solutions  (8]. 

For  a  random  graph  G  with  400  vertices  and  2004  edges,  we  compare 
the  results  given  by  our  algorithm  with  those  by  other  methods  [Fig.l]. 

(a)  Time-homogeneous  parallel  annealing:  All  63  processors  per¬ 
formed  20,000  annealing  steps  each  at  distinct  constant  temperatures. 
The  highest  and  lowest  temperatures  are  determined  empirically,  and 
the  other  temperatures  arc  determined  so  that  adjacent  ones  have  the 
same  ratio.  As  for  frequency  of  exchanges  /,  we  examined  various  val¬ 
ues  ranging  from  1/20,000  to  1/2.  Each  point  represents  the  average 
over  30  runs  with  different  sequences  of  random  numbers. 

(b)  Sequential  annealing:  The  cooling  schedule  consists  of  exactly  the 
same  sequence  of  63  temperatures  as  above.  20,000  annealing  steps  are 
performed,  which  are  divided  equally  between  the  63  temperatures. 

(c)  Simple  parallel  annealing.  Each  of  63  processors  executes  the  se¬ 
quential  annealing  algorithm  described  in  (b)  using  a  distinct  sequence 
of  random  numbers.  The  result  is  the  best  solution  obtained  by  them. 

(d)  Kcrnighan-Lin:  Kernighan-Lin  algorithm  is  repeatedly  applied 
several  times  until  convergence. 

We  made  the  following  observations  from  (Fig.l]. 

1)  (a)  gives  the  best  solutions  for  a  wide  range  of  the  frequency  of 
exchanges:  1/1000  <  /  <  1/2.  Hence  this  algorithm  is  not  sensitive 
to  the  value  of  /  except  for  values  that  are  too  small.  However  a  too 
large  value  of  /  incurs  a  high  cost  in  exchanging  the  solutions  between 
the  processors.  The  execution  time  for  /  =  1/100  was  less  than  8% 
greater  than  that  for  /  s=  1/1000  (6]. 

2)  Since  20,000  annealing  steps  arc  relatively  small,  (b)  gives  a  worse 
solution  than  (d).  However,  in  (a),  the  algorithm  probabilistically 
selects  an  appropriate  cooling  schedule  with  20,000  steps  and  gives  a 
better  solution. 


3)  Note  that  the  total  number  of  annealing  steps  in  (a)  and  that  in 
(c)  are  the  same,  (a)  outperforms  (c)  unless  /  is  too  small. 

4  Conclusion  and  Future  Works 

We  have  proposed  the  time-homogeneous  parallel  annealing  algorithm, 
in  which  an  appropriate  cooling  schedule  io  automatically  and  proba¬ 
bilistically  constructed  from  a  given  set  of  temperatures. 

Tiie  behavior  of  this  algorithm  is  theoretically  tractable,  since  it  is 
described  in  terms  of  a  time-homogeneous  Markov  chain.  In  particular 
we  have  proved  its  monotonic  convergence  property. 

We  have  experimentally  observed  that  this  algorithm  automatically 
constructed  a  better  cooling  schedule  than  that  which  assigned  the 
same  number  of  annealing  steps  at  each  temperature.  We  also  ob¬ 
served  that  this  algorithm  is  robust  for  the  choice  of  the  frequency  of 
exchanges. 

The  following  require  further  investigation. 

(i)  How  many  processors  should  we  use? 

(ii)  How  should  we  assign  temperatures  to  the  processors? 

(iii)  How  do  we  find  the  optimal  frequency  of  exchanges? 

(iv)  Does  this  algorithm  probabilistically  select  the  theoretically  best 
cooling  schedule,  the  best  assignment  of  the  annealing  steps  to  each 
temperature? 
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Abstract:  We  presenta  method  of  parallelization  of  the 
simulated  annealing, algorithm,  applied  to  an  instance  of  the 
chip  placement  problem.  We  give  a  mathematical  evaluation 
for  the  synchronization  cost  and  for  the  speedup  of  the  method. 
We  show  that,  for  each  stage  of  the  algorithm,  there  exists  an 
optimal  number  of  processes,  which  depends  only  on  a  small 
number  of  measurable  parameters.  So,  in  order  to  obtain  the 
best  speedup,  our  method  makes  the  number  of  employed  pro¬ 
cesses  vary  dynamically  during  the  execution  of  the  algorithm. 

An  implementation  of  the  method  on  a  shared  memory  ar¬ 
chitecture  is  described,  as  well  as  its  application  to  a  real  size 
problem:  the  placement  of  a  graphic  card  made  up  of  272  chips 
and  638  equipotentials. 

1.  The  Metropolis  algorithm 

Let  us  recall  briefly  the  classical  optimization  method  based 
on-the  Metropolis  algorithm  [l].  Let  E  be  the  energy  function 
to  minimize,  defined  on  the  state  space  0  of  a  system  .  For 
each  state  in  0,  we  define  a  set  of  neighboring  states,  and  we 
call  elementary  move  each  transformation  bringing  a  state  x  to 
a  neighboring  state  y.  We  give  a  transition  matrix  Q  =  (qXy) 
on  0  x  0,  markovian,  symmetric  and  irreducible,  such  that 
qXy  >  0  if  and  only  if  a:  is  a  neighbor  of  y  and  xf-y. 

We  model  the  dynamic  system  by  a  Markov  chain  (Xn)  over 
0,  controlled  by  a  parameter  T  called  temperature,  and  defined 
in  the  following  way  [2].  Suppose  X0, . . . ,  X„  have  already  been 
built.  We  choose  at  random  an  elementary  move  bringing  to  a 
state  Yn,  according  to  the  probability  law 

Proba[Yn  =  y|X0, . . . ,  Xa)  =  qXny 
We  impose,  with  probability  1, 

(-^n+I  =  Yn  or  Xn4-i  =  Xn), 
the  choice  being  random  according  to  the  law 

Proba(X„+1  =  Yn\Xo . Xn  ,Y„)  =  mm(l,exp(-^)J  . 

Here  A E  denotes  the  energy  variation  corresponding  to  the  ele¬ 
mentary  move  bringing  from  Xn  to  Yn.  This  move  will  be  called 
a  trial  move.  If  =  Yn,  then  we  say  it  is  an  acceptable 
move.  Otherwise  =  Xn),  it  is  a  rejected  move. 

Now,  if  wc  take  for  T  a  decreasing  function  of  n  tending  to 
0  sufficiently  slowly,  ( T  =  Tn>  where  C  is  a  suitably  cho¬ 
sen  constant),  then  wc  can  prove  that  the  law  of  Xn  converges 
to  a  measure  supported  by  the  set  of  the  absolute  minima  of 
the  energy  function  E  (cf.  (2j)  . 

2.  Parallelization  of  the  placement  problem 

In  the  sequel  wc  study  the  parallelization  of  the  Metropo¬ 
lis  algorithm,  applied  to  a  specific  type  of  problem,  namely  the 
chip  placement  problem.  One  can  think  of  two  dual  paralleliza¬ 
tion  methods: 


•Data  partitioning:  One  distributes  the  data  (chip  posi 
tions)  among  the  processes. 

•Tasks  partitioning:  One  distributes  the  tasks  among  the 
processes,  the  data  being  shared. 

With  the  data  partitioning  method  a  process  can  move  only 
its  own  chips.  In  order  to  accept  or  reject  a  chip  move,  accord¬ 
ing  to  the  Metropolis  algorithm,  one  has  to  know  the  current 
length  of  all  the  equipotentials  connected  to  that  chip.  But 
two  chips  belonging  to  two  different  processes  can  belong  to 
the  same  cquipotential.  So,  if  erroneous  computations  of  the 
energy  variation  are  not  admitted,  then  one  must  forbid  si¬ 
multaneous  moves  of  such  chips.  Even  for  a  small  number  of 
processes  the  synchronization  time  becomes  prohibitive.  For 
example,  suppose  that  each  cquipotential  connects  4  chips  on 
the  average,  and  each  chip  belongs  to  10  equipotentials.  Then, 
for  every  trial  move  of  a  chip,  a  process  must  lock  those  of  the 
4  X  10  =  40  chips  which  belong  to  other  processes,  i.  e.  15  %  of 
the  total  number  in  our  case.  If  more  than  seven  processes  run 
simultaneously,  then  there  exists  an  undesirable  waiting  time 
due  to  the  lack  of  available  chips.  Let  us  point  out  that  this 
method  leads  to  a  dynamic  partitioning  problem  which  can,  in 
turn,  be  solved  by  simulated  annealing  (3). 

With  the  tasks  partitioning  method  the  chip  positions  are 
shared  data.  One  has  to  decide  what  exactly  we  mean  by  a  task 
It  may  mean  completing  a  move  (coarse  grain  decomposition), 
or  finding  out  an  acceptable  move  (medium  grain  decomposi¬ 
tion).  One  can  even  think  of  a  fine  grain  decomposition  where 
two  or  more  processes  cooperate  for  the  computation  of  the  en¬ 
ergy  variation  involved  by  a  single  trial-move  J4).  The  coarse 
grain  decomposition  clearly  requires  a  mutual  exclusion  proto¬ 
col  in  order  to  avoid  contradictory  decisions.  Moreover,  while 
a  chip  is  moved,  all  the  chips  belonging  to  the  same  equipoten- 
tials  must  be  locked.  The  fine  grain  decomposition  is  “processor 
consuming”  since  each  trial  move  involves  the  cooperation  of 
several  processes.  It  is  suitable  for  a  massively  parallel  architec 
turc,  where  a  processor  can  be  efficient  only  for  simple  actions. 
The  medium  grain  decomposition  involves  no  lock  at  all,  and 
only  minimal  synchronization.  The  parallelization  method  we 
studied  corresponds  to  this  choice.  In  the  sequel,  wc  will  call  it 
the  parallel  trials  method. 


3.  The  parallel  trials  method 

The  method  was  previously  used  by  S.  A.  Kravitz,  R.  A. 
Rutenbar  [5j,  ar.d  also  by  E.  Aarts  and  J.  Korst.  Starting  from 
a  common  initial  state,  the  processes  build  independent  Markov 
chains,  until  one  of  them  (at  least)  obtains  a  number  S,  fixed 
in  aovance,  of  successive  acceptable  moves  according  to  the 
Metropolis  algorithm.  Such  a  process  will  be  called  a  winner. 
Then,  all  the  processes  synchronize.  One  chooses  at  random 
exactly  one  of  the  winners  and  lets  Its  current  configuration 
(resulting  from  its  S  acceptable  moves)  be  communicated  to  the 
others  processes.  Then,  one  starts  again  from  the  new  common 
state.  Thus,  each  process  executes  the  following  algorithm. 
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while  not  Ternination_test  do 

found  :=  false;  ny_count  :=  0; 
while  (not  found)  do 

choose  at  random  a  move  n; 
if  Test(n)  then 

ny .count  ;=  ay .count  +  1; 
it  (ny^count  >=  S)  then 
found  =  :TRUE; 
fi 
fi 

done 

Synchronize ; 
done 

The  variable  my.count  is  private,  whereas  found  is  shared. 
Ternination.test  is  the  test  defining  the  termination  of  the 
algorithm.  In  order  to  avoid  deadlock,  it  must  have  the  same 
value  in  all  the  processes.  Test(n)  is  a  function  returning  TRUE 
if  the  move  m  is  acceptable  and  FALSE  otherwise.  In  the  pro¬ 
cedure  Synchronize  the  processes  synchronize  and  agree  on 
the  starting  configuration  that  they  will  use  in  the  next  step. 

The  role  of  the  parameter  5  is  crucial,  because  there  are 
different  phases  in  the  execution  of  the  algorithm.  At  low  tem¬ 
perature,  few  of  the  trial  moves  arc  acceptable.  So,  synchro- 
nizing-the  processes  for  each  acceptable  move  (5  =  1)  involves 
only  a  small  waste  of  time,  with  respect  to  the  synchroniza¬ 
tion:  time  involved  by  a  greater  value  of  5.  Moreover,  choosing 
5  =  1  maximizes  the  speedup  produced  by  independent  parallel 
searches  of  an  acceptable  move. 

At  high  temperature  the  situation  is  quite  different.  Most 
of  the  moves  are  acceptable.  So,  the  speedup  produced  by  the 
parallel  searches  of  an  acceptable  move  is  not  very  significant. 
If  we  synchronize  the  processes  as  soon  as  an  acceptable  move  is 
found,  then  the  synchronization  time  can  become  prohibitive. 
This  will  moreover  favor  the  moves  for  which  the  decision  is 
the  fastest  (for  example,  the  translation  of  a  chip  with  a  small 
number  of  connections).  In  the  opposite,  if  we  choose  S  suf¬ 
ficiently  large,  then  we  obtain  Markov  chains  long  enough  so 
that  the  total  computation  time  of  a  chain  can  be  considered 
independent  of  the  choice  of  the  trial  moves.  To  sum  up,  at 
high  temperature,  the  parameter  5  plays  the  following  roles: 

•  reduce  the  synchronization  overhead:  th  :  greater 
is  5,  the  smaller  the  number  of  process  synchronization; 

•  make  the  acceptation  probability  independent  of 
the  types  of  the  moves:  for  5  sufficiently  large,  the 
computation  time  to  find  out  a  number  5  of  acceptable 
moves  can  be  considered  independent  of  the  complexities 
of  the  tried  moves. 


4-  A  small  model 

4.1  Local  analysis  (constant  temperature) 

In  this  section,  we  fix  a  low  temperature  T  and  wc  take 
5  =  1.  Wc  denote  by  a  the  mean  acceptation  rate,  that  is 
the  probability  that  a  trial  move  be  acceptable,  following  the 
Metropolis  algorithm.  If  T  is  given,  then  a  is  constant.  Let 
us  call  tjY  the  mean  waiting  lime  for  the  first  acceptable  move, 
when  N  processes  make  parallel  independent  trials.  If  a  is 
sufficiently  small,  then  we  may  estimate  that 


r  1  -*1 

Let  us  denote  by  s/y  the  mean  time  needed  by  N  processes  to 
synchronize  and  to  agree  on  a  new  starting  configuration.  Wc 
denote  by 

rAr  «  f A  +  -,A 

the  total  mean  time  needed:  to; achieve  a  move. 

Wc  assume  s/y  is  proportional  to  the  number  of  processes: 
sjf  s»  aN  (we  postpone  the  discussion  of  the  validity  of  the 
hypothesis  sp/  &  a N  untii  tlie-cnd  of  the  section  4),  whence 
the  formula 

rAT«W+aiV  (!) 

Note  that,  since  is  the  mean  waiting  time  fox  an  accept¬ 
able  move  with  exactly- one  process,  we  have 

il  =  -  (2) 

a 

where  e  is  a  constant,  which  can  be  viewed  as  the  sum  of  the 
times  to  choose  at  random  a  move,  to  compute  the  correspond¬ 
ing  variation  of  energy,  and  to  take  the  decision  of  acceptation 
or  rejection.  The  parameter  c  depends  on  the  implementation 
of  the  algorithm,  on  the  architecture,  and  on  the  instance  of 
the  placement  problem. 

An  elementary  computation  shows  that  r/y,  considered  as 
a  function  of  N,  reaches  its  minimum  r^wt  for 

and  that  we  have 

rAf„pt  *  2^  M 

Therefore,  for  a  fixed  temperature  T,  there  exists 
on  optimal  number  of  processes  N  -  Nopt.  Moreover, 

Nopl  is  approximately  proportional  to  a  *. 

For  this  optimal  value  of  the  number  of  processes,  the  speed¬ 
up  G  we  obtain  can  oe  defined  and  computed  in  the  following 
way: 


When  the  temperature  is  sufficiently  low,  the  acceptance 
rate  a  is  small  and,  therefore,  t\  is  large.  Thus,  wc  may  write 

H/H'''”"  (G) 

Equation  (3)  above  shows  that  G  is  then  proportional  to  a  3 


•1.2  Global  analysis  (variable  temperature) 

Wc  have  chosen  to  decrease  the  temperature  by  steps,  fol 
lowing  the  exponential  law  Tk  -  (0, 00) Tq  where  Tk  denotes 
the  kth  step’s  temperature. 

In  order  to  determine  the  length  of  the  klh  step,  one  may 
consider  two  types  or  rules.  Let  L$  denote  the  length  of  the 
Markov  chain  and  L\  the  number  of  accepted  moves,  both 
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counted  from  the  beginning  or  the  current  step,  and  let  Cq  and 
C\  be  suitably  chosen  constahls  (initially,  Lo  =  Li  =  0,  and 
we  always  have  Lg  >  Lj). 

rule 1:  The  step  ends  when  Lq  >  Co  or  L\  >  Ci; 
rule  2:  The  k1*1  step  ends  when  Li  >  £7j; 


Let  us  remark1  that,  in  order- to  compute  Lq,  one  has  to  decide 
how  to. take  into  account  the  moves  rejected  by  the  parallel 
processes.  An  extensive  discussion  of  this  problem  can  be  found 
in  |6). 

At  low  temperature,  under  the  first  rule,  the  steps  arc  cut 
down  into  a  constant'length  determined  by  Cq,  leading  to  an 
exponential  decrease  of  the  temperature.  For  our  instance  of 
the  placement  problem  the  experiments  done  with  this  rule 
highlighted  the  trap  of  the  annealing  in  a  local  minimum.  The 
second  rule  makes  the  steps  longer,  proportional  lo  a-1,  where 
a  denotes  the  curteht  Acceptance,  rale,  slowing  down  the  tem¬ 
perature  decrease.  OUr  experiments  done  with  this  second  rule 
led  to  a  mean  energy  20  %  smaller  than  with  the  first  rule. 
In  the  sequel  we  therefore  consider  only  the  second  rule.  The 
need  for  a  very  slow  temperature  decrease  seems  mainly  due 
to  the  constraints  involved  in  our  problem.  We  postpone  the 
discussion  of  this  point  until  section  5. 

Let  us  denote  by  af.  the  mean  acceptance  rale  in  step  k,  by 
tflf.  the  corresponding  mean  Waiting  time  for  the  first  accept¬ 
able  move  with  N  processes  in  parallel,  and  by  j.  the  mean 
time  needed  to  achieve  a  move.  Equation  (5)  above  shows  that 
the  optimal  speedup  Gjt  for  the  kth  step  is  then  given  by  the 
relation 


c 

or,  since  li  Jfc  =  —  , 

’  <*k 


Therefore,  if  we  choose  dynamically,  for  every  step,  the 
optimal  number  Ncpi  of  processes  given  by  equation  (3),  then 
we  have 


^>  =  ^rU  =  i-(-C-  +  a), 


whence,  finally  the  formula 


TN,k  «  2 


(7) 


4.3  Disetissioh 

In  this  section  we  discusS  the  relations  of  our  method  with 
the  architecture  and  the  implementation. 

The  algorithm  contains- a  random  choice  among  the  win¬ 
ners,  after  every  S  accepted  moves.  On  a  shared  memory  archi¬ 
tecture  this  choice  can  be  made  simply  by  a  specialized  process 
(master).  On  a  distributed  architecture  it  would  probably  be 
better  to  Use  a  more  symmetric  algorithm,  the  winners  electing 
one  of  them  by  mcans  of  an  election  algorithm. 

We  made  the  assumption  that  the  synchronization  and  up¬ 
dating  mean  time  Sfj  is  proportional  to  the  number  of  pro¬ 
cesses.  Let  us  remark That  s//  depends  on  the  implementation 
of  the  algorithm  and  on  the  architecture,  but  it  docs  not  depend 
on  the  instance  of  the  placement  problem.  On  a  shared  mem¬ 
ory  architecture,  if  the  synchronization  protocol  uses  a  critical 
section,  then  a#  is  bounded  below  by  a  constant  multiplied  by 
the  number  fi  of  processes.  So,  oUr  hypothesis  corresponds  to 
a  good  implementation  of  a  protocol  belonging  to  this  class.  On 
a  distributed  architecture  the  situation  can  be  quite  different. 
For  example,  on  a  grid  of  N  processors,  the  time  to  broadcast 
a  value,  and  thus  to  update  the  data  structures,  is  proportional 
to  t/77,  and  no  critical  section  is  needed.  However,  the  corre¬ 
sponding  proportionality  constant  is  likely  to  be  much  greater 
than  that  of  the  shared  memory  case. 


5.  Tlic-placcrrfclifc  problem 

The  previous  algorithm  is  implemented  on  a  Sequent  ma¬ 
chine  (Balance  SOOO).  It  is  a  32  bits  shared  memory  multi¬ 
processor  architecture,  with  a  single  bus  and  a  cache  memory. 
The  machine  we  used  had  eight  processors.  We  studied  one  in¬ 
stance  of  the  chip  placement  problem,  namely  the  placement  of 
a  graphic  card  made  or  272  chips  and  638  cquipolcntials.  The 
energy  function  we  had  lo  minimize  has  the  following  form 

£  =  £/  I  pEr  -1-  qEj 

where  we  denote  by 

Ej  the  total  length  of  the  wires, 

Er  the  sum  of  the  overlapping  areas  of  the  chips  taken  two 
by  two, 

Ei  the  sum  of  the  areas  of  the  chips  parts  extending  beyond 
the  limits  of  the  board, 


Since  all  the  steps  contain  the  same  number  of  accepted 
moves  we  may  define  the  global  speedup  <7?[0j  for  K  successive 
steps  by  the  relation 


e£=i  ri.fe 

r<v.fc 


Using  the  equation  (7)  above,  we  can  write  Gf;0j  as  a  function 
of  the  sequence  of  acceptation  rates  a*,  1  <  k  <  K. 


Equation  (8)  allows  the  effective  computation  of  since  a, 
c  and  crjt  arc  easily  measurable. 


p  and  q  two  adjustable  weights. 

We  have  chosen  the  following  elementary  moves:  the  exchange 
of  two  chips,  the  rotations  of  angle  k|,  the  translations  small 
enough  lo  ensure  that  a  chip  is  never  entirely  outside  the  board. 
One  imposes  several  constraints: 

•  Some  chips,  such  as  the  connectors,  must  remain  fixed. 

•  There  arc  forbidden  areas,  that  no  chip  may  intersect 

•  When  the  annealing  ends,  we  want  to  gel  Er  ~  Ej  -  0: 
all  the  chips  must  fit  in  the  rectangle  formed  by  the 
board,  without  any  overlap. 

In  ordci  to  satisfy  (asymptotically)  the  latest  constraint  p 
and  q  must  lend  to  too  with  the  length  n  of  the  Markov  chain, 
from  the  beginning  of  the  simulated  annealing.  Let  us  denote 
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by  pn ,  qn  and  Tn  the  current  values  of  the  weights  p,  g,  and  of 
the  temperature  T.  D.  Geman  and  S.  Gcman  (7)  showed  that 

On 

the  ratios  and  —  must  tend  to  +oo  very  slowly,  namely 
-hi  Tn 

<  Clog  h  and  p-<Clogn, 

■in  -in 

where  C  is  a  suitable  constant. -In  particular,  both  the  decrease 
of  Tn  and  the  growth  of  tlie  weights  pn  and  qn  must  be  very 
C  v 

slow.  If  we  take  Tn  =  ; - ,  then  the  above  constraint  on 

log  n  Tn 

would  imply  p„  <  C2  and-.thcrefore,  the  condition  pn  -»  +oo 
is  not  satisfied.  This  explains  why  temperature  steps  with  con¬ 
stant  length  are  not  suitable  for  optimization  problems  with 
constraints  (see  section  4.2  above). 

6.  Numerical  values 

6.1  Local  analysis 

We  determined  experimentally  the  parameters  we  intro¬ 
duced  in  the  section  4,  by  computing  a  mean  on  5000  iterations 
at  a  constant  temperature. 

6.1.1  Synchronization  and  updating  mean  time  $n 


sync  and  ufdatf  Wan  line 


Fig.  1  The  theoretical  graph  is  drawn  with 
surrounded  squares. 

We  deduce  from  this  graph  (Fig.  1)  the  estimated  value  for 
a: 

a  «  0.7 

The  divergence  of  the  theoretical  graph  from  the  experi¬ 
mental  one  for  N  >  7  is  due  to  the  processors^aturation.  In 
fact,  the  hypothesis  =  aN  is  legitimate  only  if  cach.proccss 
gets  a  processor  as  soon  as  it  is  ready  to  perform-a  step.  This 
is  not  true  when  the  number  of  processes  is  close  to  the  number, 
of  existing  processors  (eight),  because  in  the  UNIX  system,  at 
least  one  of  the  processors  has  to  run  the  kernel’s  processes. 


0.1.2  Move  achievement  mean  time  r/y 


•  a  =  0.45,  5  =  1.  The  mean  acceptance,  rate  is  a  =  0.45, 
corresponding  to  a  relatively  high  temperature,  and  we  syn¬ 
chronize  the  processes  as  soon  as  an  acceptable  move  is  found. 

»«  achievement  wan  Uw 


Fig.  2  «  =  0.45,  5  =  1 

We  can  thus  see  that  choosing  5  =  1  at  high  temperature 
slows  down  the  algorithm  (Fig.  2). 

•  a  =  0.45,  5  =  4.  The  mean  acceptance  rate  is  a  = 
0.45,  and  wc  synchronize  when  a  process  has  found  4  successive 
acceptable  moves. 


nove  achievement  twin  llw 


Fig.  3  a  =  0.45,  5  =  4 


The  local  speedup  is  optimal  when  N  =  4.  Its  measured  value 

is  G  =  —  =  *  1-2  (Fig.  3). 

r,j  2.78  '  6  ’ 
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0.2.1  Global  speedup 


•  a  =  0.05,  S  =  1.  The  mean  acceptance  rate  is  a  =  0.05, 
corresponding  to  a  low  temperature,  and  we  synchronize  as 
soon  as  a  process  lias  found  an  acceptable  move. 


move  achievement  wan  Mw 


proc  number 


Fig.  4r  a  —  0.05,  5  =  1.  The  theoretical  graph 
(ri  =  22 ,  a  =  0.7 )  is  drawn  with 
surrounded  squares 

In  this  case  (low  temperature)  the  experimental  value  of 
Nopt  is  7  (Fig.  4).  Its  value  computed  by  the  relation  (3) 
above,  with  rj  =  22  et  a  =  0.7  is 


wan  acceptation  rale  vs  lerareralvre 


leaperilure 

Fig.  5  mean  acceptance  rate 

The  graph  (Fig.  5)  above  shows  the  measured  variations 
of  the  mean  acceptance  rate  considered  as  a  function  of  the 
temperature.  Using  its  values  and  the  relation  (8),  one  can 
compute  the  global  optimal  speedup  obtained  when  the 
algorithm  runs,  for  each  temperature,  the  optimal  number  of 
processes.  For  the  instance  of  the  placement  problem  we  stud 
ied  one  obtains  the  value 


r  22 

The  measured  speedup  is  G  =  — -  -  « 

r7  7.1 

puled  by  the  relation  (6)  is 


3 


Its  value  com- 


0.1.3  Local  speedup 

With  the  notations  of  the  section  4  above,  the  parameter 
a  depends  the  implementation  of  the  algorithm  and  on  the 
architecture.  'The  values  of  t\  and  c  depend  also  on  the  instance 
of  the  placen  rnt  problem.  Using  their  measured. values  and  the 
relations  {/,),  (4)  ct  (6)  above,  one  can  compute  the  following 
table,  which  shows  the  estimated  optimal  number  of  processes 
and  the  local  speedup,  for  different  values  of  the  acceptance 
rate  a. 


a 

Nopt 

G 

0.05 

6 

3 

0.01 

13 

6.5 

0.005 

18 

9 

G glob  ~  7.5 

The  next  graph  (Fig.  6)  shows  the  estimated  optimal  num¬ 
ber  of  processes,  computed  by  the  relation  (3).  Recall  that 
the  machine  we  used  had  8  processors.  Thus,  one  see  that  we 
could  not  run  this  optimal  number  of  processes  for  tempera¬ 
tures  lower  than  30. 


orltnal  processus  number  vs  temperature 


6.2  Global  analysis  Fig-  0  optimal  processus  number 

In  this  section  we  study  the  algorithm  behavior  when  the 
temperature  is  varying.  0.2.2  Energy 

We  performed  five  simulated  annealing  for  the  same  ins- 
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tance  of  the  placement  problem  .  Wc  obtained  a  mean  final 
energy  m  =  41177  with  a  standard  deviation  <j  =  1011.  Let 
us.  remark  that  the  initial  placement  of  the  card1  was  done  “by 
hand”  in  about  a  week,  resulting  in  a  final  energy  30  %  higher. 

The  following  graph  (Fig.  7)  gives  a  typical  example  of  the 
variation  of  the  mean  energy  t/ersus  the  temperature. 


Eig.  7  energy 


0.3  Feasibility 

The  card’s  description  file,  in  a  standard  format,  is  read 
by  the  program  through  a  parser.  After  the  placement.is  com- 
pleted,  the  program  produces  a  file  in  the  same  format,  de¬ 
scribing  the  final  card.  This  last  file  is  then  processed  auto¬ 
matically  by  a  routing  software,  demonstrating  the  feasibility 
of  our  placement  solution. 

Conclusion 

The  results  above  show  that  the  parallelization  method  we 
studied  is  not  a  massive  parallelization  method.  But, .it  gives  a 
significant  speedup  at  low  temperature. 

In  order  to  obtain  the  best  speedup,  one  must  adapt  dy¬ 
namically  the  number  of  processes  to  the  current  mean  accep¬ 
tance  rate.  The  notion  of  adaptativc  strategy  was  introduced 
by  S.  A.  Kravitz  and  R.  A.  Rutenbar.  In  (5]  they  juxtapose 
different  parallelization  methods,  leading  to  complex  and,  a 
priori ,  not  optimal  schedules.  Our  theoretical  model  allows  us 
to  compute  the  optimal  number  of  processes,  and  the  speedup, 
for  each  step  of  the  algorithm. 

The  algorithm  and  the  theoretical  model  are  gcncralenough 
to  handle  both  shared  memory  and  distributed  architectures. 
They  were  tested  only  on  a  shared  memory  computer.  How¬ 
ever,  on  a  distributed  architecture,  the  synchronization  and 
updating  mean  time,  as  a  function  of  the  number  of  processes, 
is  likely  to  behave  differently,  leading  to  new  estimates  for  the 
optimal  number  of  processes  and  for  the  speedup.  Wc  plan  to 
experiment  on  a  distributed  computer  based  on  Transputers. 
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Abstract  -  We  present  an  overview  of  three-dimensional  electro¬ 
magnetic  particle-in-cell  (PIC)  simulation  techniques  for  vector 
supercomputers,  and  their  appheation  to  the  realistic  des.gn  of 
physical  devices.  We  first  desribe  the  fundamental  building 
blocks  of  electromagnetic  PIC  codes.  We  then  discuss  code 
architectures  for  combining  these  components  into  a  working 
design  tool,  using  the  ARGUS  system  of  codes  as  a  specific 
case  study.  Finally,  applications  and  examples  are  discussed 

L  INTRODUCTION 

For  more  than  twenty  years,  computers  have  been  used 
to  simulate  systems  of  charged  particles  subject  to  both  ap¬ 
plied  electromagnetic  fields  and  to  self-consistent  fields  gen¬ 
erated  by  the  particles  themselves.  Codes  of  increasing  gen¬ 
erality  and  complexity  have  evolved  over  this  period.  To¬ 
day,  with  the  widespread  availability  of  vector  supercomput¬ 
ers,  three-dimensional  codes  which  can  sclf-consistently  treat 
relativistic  particles,  electromagnetic  fields,  complex  multima¬ 
terial  structures  embedded  on  the  computational  mesh,  and  re¬ 
alistic  boundary  conditions  have  become  essential  tools  in  the 
physics  and  engineering  communities.  The. generality  of  such 
codes  permits  state-of-the-art  modeling  of,  for  example,  mi¬ 
crowave  tubes  (klystrons,  magnetrons,  traveling- wave  tubes), 
accelerators,  electron  guns  and  electron  optics  systems,  solid- 
state  devices,  and  antennas.  In  effect,  supercomputers  have 
transformed  electromagnetic  PIC  codes  from  research  projects 
into  truly  cost-effective  design  and  problem  solving  tools. 

II.  PHYSICS  MODELS 

The  basic  building  blocks  of  an  electromagnetic  PIC  code 
include  the  following: 

Field  solvers  -  These  consist  of  both  direct  and  iterative  algo¬ 
rithms  for  solving  particular  subsets  of  Maxwell’s  equations. 
The  full  electromagnetic  set  and  the  electrostatic  limit  are  the 
most  common,  with  the  magnetostatic  and  magnctoinductive 
approximations  useful  under  certain  circumstances.  In  addi¬ 
tion,  the  full  set  of  Maxwell’s  equations  can  be  solved  cither 
in  the  time  domain  (as  an  initial  value  problem)  or  in  the  fre¬ 
quency  domain  (as  an  eigenvalue  problem).  The  latter  tcch- 
nioue  is  an  efficient  and  accurate  way  of  determining  electro 
magnetic  spectra. 

Particle  pushers  -  These  perform  temporal  orbit  integration  of 
relativistic  particle  species,  and  accumulate  the  source  terms 
needed  by  the  field  solver.  The  particle  equations  of  motion 
may  include  clastic  and  inelastic  scattering  from  background 
species,  interactions  with  matter,  and  terms  describing  rate 
processes. 


"Kitchen  sink”  physics  -  Algorithms  for  describing  surface 
physics,  radiation,  and  other  dirty"  processes  are  developed 
as  needed.  These  can  include  phenomenological  descriptions 
as  well  as  more  fundamental  models. 

Geometry  specification  and  visualization  -  While  not  physics 
modules  in  the  strict  sense,  these  components  are  critical  to 
a  working  three-dimensional  PIC  model.  Complex  geometries 
can  be  extremely  difficult  to  set  up  in  three  dimensions,  sim¬ 
ilarly,  extracting  some  essential  physical  behavior  from  com¬ 
plicated  three-dimensional  field  topologies  and  particle  flows 
is  often  a  daunting  task.  Combinatorial  geometry  tools  (al¬ 
lowing  for  basic  Boolean  operations  to  be  performed  on  three- 
dimensional  objects)  and  advanced  visualization  packages  (of¬ 
ten  workstation-based)  are  essential  parts  of  an  overall  design 
system. 

III.  CODE  ARCHITECTURE 

Three-dimensional  electromagnetic  PIC  models  must  han¬ 
dle  vast  quantities  of  data:  a  typical  moderately-resolved  sim¬ 
ulation  may  require  of  the  order  of  100  million  words  of  stor¬ 
age.  Domain  decomposition  algorithms  must  be  coupled  with 
memory  management  and  data  management  techniques  for  op¬ 
timizing  the  use  of  fast  memory  for  each  calculation  and  for 
efficiently  moving  data  between  memory  and  disk  as  the  cal¬ 
culation  proceeds. 

In  SAIC’s  ARGUS  code,  for  example,  problems  are  de¬ 
composed  into  spatial  regions  known  as  field  block),  which  are 
then  arranged  on  a  set  of  generalized  lattices  known  as  logi¬ 
cal  )vpcrgrid).  The  size  of  each  field  block  is  chosen  so  that 
the  block  will  fit  easily  into  memory;  data-handling  routines 
move  blocks  between  disk  and  memory  as  needed.  Disk  I/O  is 
overlapped  with  computations  wherever  possible.  Algorithms 
used  by  both  the  field  and  particle  routines  permit  global  so¬ 
lutions  in  the  entire  physical  domain  by  performing  sequence- 
independent  operations  in  each  field  block,  followed  by  sharing 
of  data  at  interfaces.  Solutions  in  individual  blocks  may  be 
advanced  either  synchronously  or  asynchronously;  this  archi¬ 
tecture  is  naturally  suited  to  parallel  processing. 

IV  APPLICATIONS  AND  EXAMPLES 

Three-dimensional  electromagnetic  PIC  simulations  are 
now  widely  used  for  research  and  design  in  a  number  of  diverse 
areas.  We  briefly  describe  two  different  types  of  calculations 
that  have  been  performed  with  the  ARGUS  code. 

Microwave  device  and  antenna  design  -  The  process  of  measur¬ 
ing  the  if  properties  and  mode  structure  of  a  microwave  con¬ 
figuration  with  no  applied  voltages  ( i.c .,  with  no  particles  in 
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it)  is  known  as  cold  testing.  It  is  typically  the  first  series  of 
measurements  made  when  developing. a  new  device.  Once  the 
cold-test  properties  of  the  structure  are; satisfactory,  the  de¬ 
signer  will  proceed  to  hot  testing,  or  measurements  where  the 
device  is  under  voltage  and  partmles  are  present.  As  described 
above,  cold  testing  can  be  performed  in  either  the  time  domain 
or  the  frequency  domain. 

ARGUS  has  been  used  to  predict  the  cold  test  behavior 
of  numerous  devices,  including  microwave  cavities,  high-power 
rf  tubes,  and  high-frequency  component  packages.  Typically, 
the  code  is  first  benchmarked  against  a  configuration  for  which 
experimental  data  is  available,  agreement  is  usually  found  to 
within  a  fraction  of  a  percent.  Parametric  scans  are  then  per¬ 
formed  to  quantify  the  behavior  of  the  device  across  the  range 
of  interest.  It  should  be  stressed  that  these  devices  are  usually 
of  sufficient  geometrical  complexity  that  analytical  solutions 
are  impossible  (see  Figures  1  and  2,  for  example).  The  only  al¬ 
ternative  to  numerical  simulation  would  then  be  to  construct  a 
prototype  and  perform  an  experimental  study,  a  process  which 
is  usually  far  too  costly  and  time-consuming. 


-Mi 

ot.M 

b 

'« 

Fig  1  (a)  ARGUS  representation  of  a  portion  of  a  high-power 
antenna  used  for  ion  cyclotron  resonance  plasma  heating  in 
a  Tokamak  fusion  reactor,  (b)  ARGUS  generated  contours  of 
the  z-component  of  the  electric  field  at  the  midplane  of  the 
antenna  when  driven  at  its  fundamental  operating  frequency. 


Fig.  2a  ARGUS  gridding  of  a  microwave/millimetcr  wave  in¬ 
tegrated  circuit  module  housing. 


Fig.  2b  Electric  displacement  vectors  for  the  lowest  mode  of 
the  device. 


Accelerator  design  -  The  simulation  codes  traditionally  used  in 
the  particle  accelerator  community  have  either  employed  sim¬ 
plified  physics  models  (for  example,  ignoring  space  charge  ef¬ 
fects),  or  else  have  not  been  fully  tliree-dimensional.  However, 
modem  accelerator  designs  are  indeed  three-dimensional,  as 
can  be  seen  from  the  Lawrence  Berkeley  Laboratory  constant 
current  variable  voltage  (CGW)  device  shown  in  Figure  3(a). 
Fully  three-dimensional  PIC  codes  are  therefore  necessary  to 
do  a  proper  analysis. 

We  are  currently  using  ARGUS  to  study  such  devices,  with 
the  goal  of  determining  ah  optimal  match  between  the  accel¬ 
erating  system  and  attainable  beam  parameters.  Preliminary 
results  from  such  a  calculation  are  shown  in  Figure  3(b). 


Fig.  3  (a)  An  ARGUS  simulation  of  the  LBL  CCW  accelera¬ 
tor.  The  “fingers”  are  electrostatically  charged  in  a  quadrupole 
configuration  so  as  to  provide  alternate  gradient  focusing  and 
defocusing  of  the  beam  in  the  transverse  plane  as  it  is  acceler¬ 
ated  by  the  voltages  on  the  plates,  (b)  Comparison  between  an 
ARGUS  simulation  and  an  envelope  calculation  for  the  CCW 
accelerator.  An  x-z  projection  is  on  the  left,  and  a  y-z  projec¬ 
tion  is  on  the  right.  The  upper  plots  show  the  boundary  of  the 
beam  as  predicted  by  the  envelope  code,  while  the  lower  plots 
show  the  actual  beam  trajectories  as  calculated  by  ARGUS. 


V.  SUMMARY 

Three-dimensional  electromagnetic  PIC  simulation  is  a  ma- 
ture,  well-developed,  and  cost-effective  technique  for  the  anal¬ 
ysis  of  a  wide  variety  of  physical  devices.  As  supercomputer- 
based  codes  become  increasingly  better  coupled  with 
workstation-based  graphical  capabilities,  these  integrated  sys¬ 
tems  have  moved  to  the  forefront  as  everyday  design  tools.  As 
always,  work  in  the  field  is  ongoing,  and  we  expect  to  see  even 
more  dramatic  advances  over  the  next  few  years. 

1  Work  supported  by  the  SAIC  Independent  R&D  Program 
and  by  the  US  Government. 

2  Also  contributing  to  this  work  are  0.  Anderson,  S.  Bran¬ 
don,  C.F.  Chan,  C.L.  Chang,  A.  Drobot,  K.  Ko,  M.  Kress, 
A.  Mondclli,  J.  Moura,  J.  Pctillo,  and  L.  Soroka. 
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Abstract :  The  Wigner  equation  that  we  present  here  was 
proposed  by  physicists  as  a  model  for  quantum 
electronic  devices  in  the  kinetic  regime.  The  first  member 
of  this  equation  is  a  drift  term  while  the  quantum  effects 
are  taken  into  account  in  the  second  member  via  a 
Fourier  integral  operator.  We  solved  this  equation  by  a 
deterministic  particle  method  for  which  proved  the 
convergence. 

I-  The  Wigner  equation 

The  Wigner  equation  models  the  motion  of  electrons 
in  an  external  electrostatic  potential,  which  we  shall 
decompose  in  order -to  describe  quantum  tunneling 
effects :  the  electrons  are  accelerated  by  an  electric  field  E 
and  partially. tunnel  through  a  potential  barrier  given  by  a 

real  function  V(x),  x  e  iRd.  This  equation  governs  the 
evolution  of  a  distribution  function  w(x;k,t),  where 

xe  lRd,  pe  IRd  and  te  K*  are  respectively  the 
position,  the  impulsion  and  the  time  coordinates : 

0-1) 

|a,w  +  ^  3,w  -  qE  3pw  =  e;  V].  W 
\w(t=0)  =  W[ 


The  real  numbers  !i,  m  and  q  arc  respectively  the  Planck 
constant,  the  mass  of  electron  and  its  charge.  The 
operator  0[V]  is  a  Fourier  integral  operator  defined  by 


(1.2) 

tew  wK  p, ,) = JLjj J  J|v(k + ]  -  v(,  -  !a| 


(1.5) 

-  ■ 

A  classical  semi-group  analysis  provided  in-1 1 1  Mates 
that  the  operator  -  ^  dx  +  qE  3p  -  0[VJ  generates  a 
continuous  unitary  group  in  L^K20).  Thus,  if  the  initial 

data  belongs  to  iXlR  /,  this  equation  admits  a  unique 
solution  which  satisfies 

(1.6) 

||  w(t)  II  ,  =  II  W|  llL,  . 


II  -  The  piirticle method 


In  order  to  solve  numerically,  we  used  the 
deterministic  panicle  method  introduced  by  P.A.  Raviart 
and  S.  Mas-Gallic  in  [2]  (3).  The  exact  solution  of 
equation  (1.1)  is  approximated  by  a  linear  combination 
of  delta  functions : 


(2.1) 

w(x,v,t)  =  X  «>i  w,(t)  8(x  -  x,(t))  6{p  -  p,(t))  . 

i 

The  motion  of  the  particles  in  the  phase  space  is  given  by 


(2.2) 


dxj, Pi(t) 
di ' '  m 


dpt 

dt 


(0  =  -  ME  , 


x  w(x,p,,i)ei(Pi,')n  dp'  dq 

This  integral  can  also  be  written  as  a  convolution  with 
respect  to  the  impulsion  variable : 

(L3) 

(€>[V].w)(x,  p,  t)  =  j  ttfx.p-p')  wfx.p'.t)  dp'  , 

JR* 

with 


while;  the  control  volume  of  the  particle  i,  a)„  docs  not 
depend  on  t  and  its  weight,  Wj(t),  is  an  approximation  of 
w(x,(t),  p,(t),  t).  Tiic  weights  evolve  according  to 

(2.3) 

"jjpW  =  Z  tfMO  -  Xj(l))  tpfXjll),  p,(l)  -  p,(t))  w/t)  , 

1 

that  we  obtain  by  first  regularizing  the  integral  operator 
in  the  x  direction 


(1.4) 


**p>-er 


(JLf 

\ml 


Im 


i£ELd2p 


■'R 


and 


■ 

(©'V].vv)(x,  p,  ()* 

J  JR 


Cfx-x^x'.p.p'Jx 

i 

x  w(x',p',i)  dp'  dx' 


and  then  using  a  quadratural  fomiula. 
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The  numerical  analysis  of  this  method  relies  on  Wm-P 
estimates  for  the  solution  of  equation  (1.1).  This 
estimates  can  not  be  obtained  by  the  classical  semi-group 
analysis  which  yields  only  (1.6).  By  using  the 
convolution  form  of  the  integral  operator,  we  have 
proved  in  [41  the  estimate 

(2.4) 

l!w(t)ll^<C(t)llw|  l\VWf  . 
under  the  assumption 


(2.5) 
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Then  the  classical  arguments  of  consistence  and  stability 
yield  the  convergence  of  the  method  with  order  m 

111  -  Application  to  the  simulation  of  a 
resonant  tunneling  diode 


A  model  proposed  by  physicists  [5]  for  the 
simulation  of  resonant  tunneling  diodes  relies  on  the 
one-dimensionnal  (d=l)  Wigner  equation  where  the 
potential  V(x)  describe  a  double  barrier. 


[51  W.R.  Frensley  .  "Wigner  function  model  for  a 

resonant-tunneling  semi-conductor  device”,  Phys. 

Rev.  B  36  1570-1580  (1987). 

|6|  F.  Guyot-Delaurcns  and  P.  Degond:  “Particle 
Simulation  of  the  Semiconductor  Boltzmann 
equation  for  One  -Dinicnsionnal  Inhomogeneous 
Structures”,  Journal  of  Comp.  Phys.  90  65-97 
(1990). 
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The  equation  (1.1)  has  to  be  solved  in  a  bounded  domain 
(0,L]x[pnlj„,  pmax]  with  physical  boundary  conditions 
given  in  [5]  at  the  boundaries  x=0  and  x=L,  and  artificial 
boundary  conditions  for  p  =  pmj„  and  p  =  pm3j.  We 
chose  periodic  boundary  conditions  which  arc  thecasicst 
one  to  take  with  the  particle  method.  This  model  can  be 
improved  by  coupling  with  the  Poisson  equation  in  order 
to  take  into  account  the  electrostatic  interaction.  Then  the 
electric  field  depends  on  the  position  E  =  E(x)  and  is 
derived  from  the  electrostatic  potential.  We  compute  this 
potential  by  a  Particle  In  Cell  method  commonly  used  for 
this  coupling  [6|  [7J. 

The  main  difficulty  of  this  problem  is  due  to  the 
singularity  of  the  barrier  potential  of  which  the  Fourier 
transform  docs  not  satisfy  the  inequality  (2.5)  even  for 
m=0.  The  particle  method  was  proved  to  converge  in  this 
case  but  in  a  very  weak  sense  and  without  any  order. 
Moreover,  the  integral  (1.3)  is  an  oscillating  integral 
which  makes  the  numerical  computations  rather  heavy. 
In  spite  of  this,  we  got  results  which  allowed  to  justify 
the  simplified  models  used  by  physicists. 
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Abstract  The  aim  of  the  present  paper  is  the 
presentation  of  some  results  about  the  numerical  study 
of  the  flow  of  a  polyatomic  gas  between  one 
evaporating  and  one  totally  absorbing  plate.  Density, 
velocity  and  temperature  profiles  are  obtained  in  the 
range  0.01<Kn<0. 1  by  solving  a  kinetic  equation  by  a 
combination  of  Monte  Carlo  and  finite  difference 
techniques. 


I.  INTRODUCTION 

The  mathematical  description  of  evaporation  and 
condensation  phenomena  is  a  classical  problem  of 
kinetic  theory  and  a  large  number  of  papers  has  been 
devoted  to  the  study  of  Its  various  aspects. 

Most  of  the  previous  investigation 'were  aimed  at 
studying  evaporation  problems  connected  to  monatomic 
gases.  However,  in  many  situations, which  are  relevant 
both  from  the  scientific  and  practical  point  of  view, 
one  is  faced  with  the  evaporation  of  polyatomic 
species. The  strong  evaporation  of  polyatomic  gas  in  a 
half  space  has  been  considered  by  Cercignani1  who 
extended  Ytrehus’  trlmodal  Ansatz2  to  obtain 
approximate  solutions  of  a  BGK-like  kinetic  model  by 
moment  method.  The  aim  of  the  work  described  in  the 
present  paper  is  the  modeling  of  the  evaporation  of  a 
polyatomic  gas  by  the  direct  numerical  solution  of  a 
kinetic  equation.  The  approach  has  the  obvious 
advantage  of  requiring  no  a  priori  guess  of  the 
distribution  function,  therefore  it  has  a  wider  range 
of  applicability  as  compared  to  the  moment  method.  The 
one-dimensional  flow  resulting  from  the  evaporation  / 
condensation  of  a  polyatomic  gas  between  two  parallel 
plates  is  considered  as  model  problem. 

II.  BASIC  EQUATIONS 


c  of  a  gas  with  J  internal  (indistinguishable)  degrees 
of  freedom.  The  quantity  n(x, t,c)  is  the  number 
density  of  molecules  having  the  Internal  energy  e, 
N(x,t)  is  the  total  number  density,  U(x, t)  is  the  mean 
velocity  of  the  gas,  Tt(x, t)  is  the  translational 

temperature,  T(x, t)  is  the  overall  temperature.  The 
collision  frequencies  have  been  calculated  from  the 
viscosity  n (Tfc ) : 


v  =  (l-z)v  , 

el  tot 


v  =  zv  ,  V.  =  NkT  /p(T  ) 
on  tot  tot  t  t 


being  z  the  fraction  of  anelastic  collisions. 

Since  the  main  difficulty  lies  in  the  modeling  of 
anelastic  collision,  it  seems  reasonable  to  restrict 
the  use  of  EGK  terms  to  that  process  only.  A  second 
model  was  therefore  obtained  by  replacing  the  first 
collisional  term  by  the  full  Boltzmann  Equation  to 
describe  elastic  collisions.  The  second  term  was  left 
unchanged.  If  hard  sphere  interaction  is  assumed  to 
describe  elastic  collisions,  then  Eq. (1)  takes  the 
following  new  form  : 


(1-z)-^  J[F(g*)f  (§*,G)-F(§1)f  (g.c)]  x 

|gr.kjsine  dgtd0  d<f>  +  z  t>ColI  («w-f)  (4) 


In  Eq.  (4)  d  is  the  molecular  diameter  and  i>Co|i  is 
the  mean  collision  frequency  calculated  as  : 

‘W  IT  "fj  F(x.t.€.)F(x,t,?2)  x 


As  is  well  known  the  mathematical  description  of  the 
behavior  of  a  polyatomic  gas  Is  still  an  open  problem 
that  has  been  approached  in  a  variety  of  different 
ways3. 

Holway’ s  kinetic  equation 


H  +  §7f= 


v  (4-  f) 

ol  el 


+  V  (4<  -f) 
an  an 


(1) 


was  used  as  a  starting  point  for  this  study,  since  it 
lends  itself  to  a  simple  numerical  treatment.  In  Eq. 
•CD  the  functions  4'  and  4>  are  defined  as  follows: 

el  an 


n(c) 


el  (2nRTt)3/a 


exp 


(g  -  u  )2  ■ 

2RTt 


(2) 


and 


*  » 
an 


(2nRT  ) 


3/2 


exp 


(g  -  u  )2 
2RT 


|gr»k|sin0  dg_dg_do  d 4>  (5) 

The  reduced  distribution  function  F(x,t,g)  is  defined 
as  F(x,  t,g)=Jf  (x,  t,g,e)dc. 

The  kinetic  equations  are  solved  specifying  the 


initial  values  f(x,0,g, c) 

and  the  boundary  conditions: 

f  (0,  t,g,  e)  =  V  (N  ,T  ,g) 

v° 

(6) 

f  (L,  t,g,e)  =  0 

gx<° 

(7) 

The  boundary  condition 

(6),  which  holds 

at  the 

evaporating  plate,  specifies  the  distribution  function 
of  the  molecules  emitted  from  the  condensed  phase.  The 
temperature  T^  is  the  wall  temperature,  while  N^ 

denotes  the  saturated  vapor  density  at  the  temperature 
T  .  The  boundary  condition  (7)  at  x=L  implies  that  the 

second  plate  is  perfectly  absorbing.  As  is  clear  from 
Eq.  (6)  it  has  been  tacitly  assumed  that  the 
evaporation  coefficient  is  unit. 


c 


J/Z-l 


r(J/2)(kT)J/z 


exp 


(3) 


Eq.  (1)  approximates  the  collisional  term  by  the  sum 
of  two  BGK-like  terms.  The  first  of  them  describes 
elastic  collisions,  while  the  second  models  anelastic 
collisions.  In  Eq. (1)  f(x, t,g,c)  is  the  distribution 

function  of  molecular  velocities  g  and  internal  energy 


III.  Description  of  the  Numerical  Technique 

The  numerical  algorithm  Is  based  on  a  consistent 
finite  difference  discretization  of  Eqs.  (1)  and  (4). 
The  Monte  Carlo  method  is  used  to  evaluate  the 
collision  integral  at  the  right  hand  side  of  Eq.  (4). 
A  generalization  of  the  time-splitting  method  by 
Tcheremissine  and  Arlstov5  was  used. 

In  this  work,  the  region  between  the  plates  has  been 
divided  into  a  number  of  cells  of  variable  size,  and 
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the  distribution  functions  assumed  to  be  constant 
within  each  cell.  The  size  of  spatial  cells  was 
smaller  in  the  regions  of  stronger  gradients.  A 
similar  procedure  has  been  adopted  to  represent  the 
distribution  functions  in  the  velocity  space.  A 
regular  net  of  nodes  is  arranged  into  a  finite  domain 
of  the  velocity  space  assuming  that  the  distribution 
function  is  constant  within  the  cell  volumes.  The 
domain  has  to  be  chosen  in  order  to  contain  most  of 
the  particles  at  any  stage  of  the  calculations.  As 
far  as  the  discretization  of  f  in  the  space  of 
internal  energy  c  is  concerned,  it  was  convenient  to 
represent  the  distribution  function  through  a  set  of 
values  calculated  at  the  nodes  of  a  Gauss  integration 
formula  with  unit  weight  function  on  the  interval 
[0,E  ).  The  distribution  function  was  assumed  to 

max 

vanish  for  c>E 

max 

IV.  RESULTS  AND  DISCUSSION 

The  numerical  method  described  above  has  been  used  to 
obtain  approximate  solutions  of  Eq.  (1)  and  Eq.  (4) 
:for  values  of  the  Knudsen  number  Kn  in  the  range 
[0.01,0.1].  The  Knudsen  number  considered  here  is 
defined  as  A^/L,  being  the  mean  free  path  when  the 

gas  l's  in  equilibrium  with  the  condensed  phase.  Only 
the  case  of  a  diatomic  molecule  (j=2)  was  considered. 
The  values  of  the  parameter  z  were  selected  in  order 
to  have  the  anelastic  collision  frequency  not  too 
different  from  the  elastic  collision  frequency.  In 
this  way  the  relaxation  phenomena  associated  with  the 
internal  and  translational  degrees  of  freedom  occur  on 
a  scale  of  comparable  magnitude. 

The  first  result  of  the  analysis  was  that  Eq.  (1)  and 
Eq.  (4)  give  very  close  results  for  the  same  values  of 
Kn  and  z.  The  largest  difference  was  found  in  the 
profiles  of  the  rotational  temperature  shown  in  Fig.  1 
in  the  case  Kn=20,z=0.  5.  The  difference  is  due  to  the 
fact  that  the  value  of  the  overall  collision  frequency 
given  by  Eq.  (5)  is  slightly  higher  than  the  value 
.calculated  from  viscosity.  Therefore,  most  of  the 
results  have  been  obtained  from  Holway’s  model.  The 
effects  of  the  Internal  degrees  of  freedom  are  more 
evident  in  the  translational  temperature  profiles 
(Fig.  2).  The  density  and  velocity  profiles  are  very 
close  to  those  of  a  monatomic  gas.  Finally,  values  of 
the  back  scatter  fraction  are  presented  in  table  1.  It 
was  found  that,  as  expected  on  the  ground  of  the 
moment  method  calculations  of  Ref.  2,  a  larger 
fraction  is  scattered  back  to  the  surface  In  the  case 
•of  a  polyatomic  gas. 


Table  1 

:  Back 

scatter 

fraction  vs.  1/Kn 

S'v\l/Kn 

10 

20 

50 

100 

Z 

0 

0.130 

0.143 

0.155 

0. 160 

0.5 

0. 142 

0.167 

0.183 

0. 188 
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Abstact ;  a  family  of  riemann  solvers  for  the  Compressible 
Euler  equations  is  presented,  which  preservs  physical 
properties  of  the  flow.  They  are  obtained  using  a  kinetic 
approach  to  the  Euler  Equations . 

I-  INTRODUCTION 

We  derive  from  the  kinetic  theory  of  gas,  a  family  of 
Riemann  type  solvers  for  the  Compressible  Euler  Equations 
of  fluid  dynamics  that  we  call  Boltzmann  solvers. 

The  system  we  solve  is 

9t  p  +  9X  pu] +  9y  pu2  =  0  , 

9t  puj+  9X  (pui2  +  p)+-9y  pui  U2-0, 

9t  pu2  +  9x  Pulu2+  9y  (pu22  +  p)  =  0 
9t  E  +9X  (:E  +  p)uj+  9y  (E+p)U2  =  0, 

E=  1/2  p|ul2  +pe  ,  p=  pT  =(y-l)pe. 

And  ,W5  will  use  a  rectangular  mesh 

My  =  { (x,y) , I x - xj  IS  Ax/2, ly-yjl  S  Ay/2  } 
where  xj  =  i  Ax  ,yj  =j  Ay .  The  problem  we  address  is  to 
find  finite  volume  approximations  of  the  above  system  under 
the  form 

Ujjn+1  -  Ujj"  +  Gx  (F;+1/2j  -  F;  -1/2j) 

+  °y  (Gjj+i/2  -  Gij.i/2)  =  0 
crx  =  At /Ax,  Oy  =  At /Ay,  where  F;+i/2j  for  example  is 
an  appropriate  approximation  of 

(pui,  pui2+p,  puiu2,  (E  +  p)  ui)  (x,+i/2,  yj ) 
such  that ,  under  a  CFL  condition, 

(i)  Pijn+1  ^  0  ,  Tjjn+1>  0, 

(ii)  the  entropy  inequality  holds 

(iii)  the  maximum  principle  on  the  entropy  holds 

Sjjn+1  <  Max{S|^£n+'  ,  MXjg.  neighbor  mesh  to  Mjj ) 

where  S  is  an  entropy  of  Euler  Equations  for  instance 
S  =  p('H>/T. 

These  properties  can  be  realized  using  an  exact  solver 
(Godunov)  i.e.  by  computing  the  exact  value  Uj  +  j/2  j  at  the 
mesh  interface. 


II.  BOLTZMANN  SCHEMES. 

We  present  another  method,  which  allows  to  possibly 
take  into  account  the  comers  effect  (dependency  of  Fj+ j/2  j 
on  Uj+ij+i  for  instance) 


This  is  achieved  using  a  kinetic  approximation  to 
Euler  Equations 

9tf  +  v.Vf=0  on  (n  At,  (n+1)  At) 

f  (nAt,z,v)  =  pn/Tn  x((v '  «n)/^  1 

where}  (l,wi2,  W22)  Z(w) dw  =  (1, 1,  l)and 

0S%(w)<x(-w)  .  The  classical  choice  of  x  ( w)  is  the 

Maxwellian  x  (w)  =  exp  t.  - 1  w  1 2  /  2)  /  2n  (see  Deshpande 
for  instance),  In  order  to  preserve  (i)  (iii)  we  propose  to  use 

other  choices  of  x>  which  also  give  better  numerical  results. 

Then,  Fj  +  i/2j  is  exnlicitelv  and  easily  caltulated  using 
at  z  =  (xi+i/2,  yj )  the  exact  solution  to  the  transportequation 

Fi+l/2,j=}vl(1»vl.v2.!v|2/2+^T)t  f(nAt,zv)dv  , 
\=.5(2-W(y-l). 

Indeed  polynomial  choices  of  %  lead  to  integrate  polynomes 
in  order  to  get  Fi+l/2,j  (See  Perthame  SIAM  J.  Num.  Ana]. 
1991,  to  appear).  The  properties  (i)-(iii>  are  proved  for  the 

numerical  scheme  for  particular  choices  of  x ,  in  noticing  that 
they  hold  for  the  transport  equation  and  that  we  solve  exactly 
the  transport  equation. 

Neglecting  the  comers,  the  explicit  formula  for  F,+i/2j 
is  for  the  first  order  scheme 

Fi+l/2,j =  F+(  Ujj )  +  F-(Ui+1J) 
with 

F+(  U )  =  jy>0  v  (l,v,u2,  lvl2/2+lu2l2/2+(l/2+?.)T)t 
^[(v  -  u)HT  ]  dv, 

and  F~  is  obtained  integrating  for  v<0.  In  this  simplificated 
formula  we  have  specified 

X(w)  =  5(wj)  ^(w2)  with 
}  (l,w2)  q(w)  dw  =  (1,1)  and  0<q(w)<q(-w) . 

HI.  NUMERICAL  RESULTS. 

The  following  figure  presents,  for  a  2D  stationary 
reflection  problem,  the  improvment  obtained  using  the  exact 
solver,  using  comers,  compared  to  the  simplified  solver 
described  above. 
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Abstract  -  Hirota’s  method  for  finding  soliton  solutions  of  nonlinear 
evolution  and  wave  equations  is  briefly  discussed  and  illustrated. 
A  MACSYMA  program  that  automatically  carries  out  the  lengthy 
algebraic  computations  is  included. 

I.  INTRODUCTION 

Hirota’s  direct  method  [1,2]  allows  to  construct  exact  soliton 
solutions  of  nonlinear  evolution  and  wave  equations.  The  lengthy 
but  straightforward  calculations  inherent  to  this  method  can  easily 
be  performed  with  any  symbolic  manipulation  program.  In  this 
paper  we  present  a  sample  program  in  MACSYMA  to  illustrate 
the  symbolic  calculation  of  one,  two  and  three  soliton  solutions 
of  wcll-known  nonlinear  PDEs  such  as  the  Korteweg-de  Vries,  the 
Boussinesq,  the  Kadomtsev-Pctviashvili,  the  Sawada-Kotera  and  the 
shallow  water  wave  equations  [1-5]. 

II.  THE  HIROTA  METHOD 
■Hirota’s  method  requires: 

(i)  ardever  change  of  dependent  variable, 

(ii)  the  introduction  of  a  novel  differential  operator, 

(iii)  a  perturbation  expansion  to  solve  the  resulting  bilinear  equation. 
Details  about  the  method  can  be  found  in  almost  any  book  on  soliton 
theory  [1-4],  here  we  merely  outline  the  procedure. 

Our  leading  example  is  the  Kortewcg-dc  Vries  equation  [1-4], 


lit  +  Guux  +  U3r  =  0  . 

(1) 

Substitution  of 

(2) 

into  (1)  and  one  integration  with  respect  to  x  yields, 

J fit  ~  fxSt  +  fftr  ~  ^fzfh  +  3/2x  =  0 

(3) 

This  quadratic  equation  in  /  can  then  be  written  in 

bilinear  form , 

£(/•/)=  (/■/)  =  0  . 

OO 

where  the  new  operator  is  given  by 

D ff  DUf-a)  =  (Ox  -  dxT(0l  -  di')nf(x,t)g(x',t'] 

l|  •  (5) 

lx'=r,t'=l 

Introducing  a  book  keeping  parameter  c,  we  look  for  a  solution 

OO 

/=l  +  £cn/n.  (0) 

n=l 

Substituting  (G)  into  (4)  and  equating  to  zero  the  powers  of  c,  yields 


0(c°) 

B(M)  =  0  , 

(7) 

0(c>) 

B(l-fi  +  Ti'l)  =  0  , 

(8) 

o(e) 

B(bh  +  /i'/i  +  fi’l)  =  0  ! 

(9) 

o(e) 

B(bf 3  +  frh  +  /2  /1  +  /3-1)  =  0  , 

(10) 

o(e) 

B(l  /1  +  fyh  +  fi  hb  Mi  +  /i  i)  -  0 

,  (11) 

0(in) 

B(£,fsfn-j)  =  0,  with  /o  =  I , 

(12) 

1=0 


This  scheme  is  general  whatever  the  explicit  expression  of  the  bilinear 
operator  B  is.  For  the  KdV  equation  B  is  given  in  (4). 


If  the  original  PDE  admits  a  N-soliton  solution  then  (6]  will 
truncate  at  level  n  -  N  provided  /i  is  the  sum  of  precisely  N  simple 
exponential  terms.  For  simplicity,  consider  the  case  of  a  three  soliton 
solution  ( N  =  3).  Then, 

/i  =  2  exp(0;)  =  CXP  (*'  x~0Jit  +  Si)  ,  (13) 

;=i  1=1 

where  it,, ui,  and  6,  are  constants.  Of  course,  (7)  is  trivially  satisfied, 
whereas  (8)  determines  the  dispersion  law, 

w,  =  kj ,  i=  1,2,3.  (14) 


The  terms  generated  by  B(fi,fl)  in  (9)  justify  the  choice 

fl  =  *12  exp(01  +  02 )  +  *13  cxp(0,  +  03)  +  023  CXp(0 2  +  O3) 

=  an  exp  [(A'i  +  hi)  x  —  (tJi  +  o)2 )  t  +  Si  +  <$2] 

+  *13  exp  [(/.']  +  kz)  x  —  (wi  +  0)3)  t  +  0i  +  fe] 

+  *23  exp  [(A'2  +  £3)  x  —  (u>2  +  W3)  1  +  02+03]  >  (15) 


and  (9)  allows  to  calculate  the  constants  012,013  and  023-  With  (14) 
one  obtains 

i,j=1'2’3-  (1G) 


Then,  B(fy}i  +  h-h)  >n  (10)  motivates  the  particular  solution 


{3  =  0123  exp(0i  +  02  +  O3) 

=  0123  exp  [(fcl+fo+fo)!— ((Ui+a-2+U)3)l  +  01  +02  +  03],  (17) 


and  one  calculates 


0123  =  *12  *13  023  = 


(k i  -  k2)2  (0|  -  03^  (kt  -  ksj2 
(ki  +  kj)2  (kt  +  kz)2  ( ki  +  kz)2 


(18) 


Subsequently,  (11)  allows  to  verify  that  indeed  /t  =  0.  In  the  sixth 
equation  of  the  scheme  B(fcfz  +  fi-fz)  should  equal  zero  in  order 
to  assure  that  /$  =  0.  If  so,  it  will  be  possible  to  take  /«  =  0  for 
i  >  G.  Finally  setting  c  =  1  in  (6),  we  obtain 


f  =  1  +  exp  0i  +  exp  02  + exp  03 

+  *12  exp(0]  +  02)  +  *13  cxp(0i  +  Oz)  +  O33  cxp(02  +  O3) 

+  0123  exp(0i  +  02  +  03)  ,  (19) 


which  upon  substitution  in  (2)  generates  the  well-known  three  soliton 
solution  of  (1). 

The  construction  of  N-soliton  solutions  [1-6]  with  iV  >  3  is 
tedious  and  the  necessary  algebraic  simplifications  and  factorizations 
arc  bound  to  fail  if  carried  out  by  hand.  Hence  the  need  for  a 
symbolic  program  that  relieves  us  of  the  elaborate  calculations. 

III.  MACSYMA  PROGRAM  FOR  THE  HIROTA  METHOD 

This  preliminary  program  calculates  the  one,  two  and  three  soli¬ 
ton  solutions  of  a  fairly  simple  completely  intcgrablc  PDE,  provided 
it  can  bo  transformed  into  a  single  bilinear  equation  for  the  new  vari¬ 
able  /.  The  program  is  written  in  such  a  way  that  the  extension  for 
the  N-soliton  is  straightforward.  The  structure  should  also  allow  to 
'translate'  it  into  the  language  uf  c.g.  MAI  IILMAIIOA,  MAPLE 
or  REDUCE.  The  user  must  select  the  value  of  iV  and  also  provide 
the  bilinear  operator  B  for  the  PDE. 
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/*  MAGSYMA  program  for  the  HIROTA?  METHOD  */ 
writefile(”three.solitonjawada_kotera.out”); 
n:3; 

B(f,g):=Dxt[l,l](f,g)+Dx[6](f,g)S 
showtime:true  S 
depends([f,g],[x,y,t))S 

;Dx[n](f,g):=sum((-l)A(n-j)+n!*di(r(f,xj)*difr(g>x,n-j) 

/(j!*(n-j)!)j,0,n)S 

Dy['i](f,g):=sum((-l)A(n-j)*n!+difr(f,yj)tdiff(g)y,n-j) 

/(j!*(n-j)!)j,0,n)$ 

Dxt[m,n](f,g):=sum((-l)A(m-j)tm!*sum((-l)A(n-i)*n!+ 

difr(difF(f>xj),t,i)+difi'(difT(g,x,m-j),t,n-i) 

/(i!*(n-i)!),i,0,n)/(j!*(m-j)!)j,0,m)S 

for  i:l  thru  n  do  f[i]:0  S 

f[l]:sum(exp(th(i,x,y,t)),i,l,n)$ 

gradef(th(i,x,y,t),0,k[i],l[i],-om(i))$ 

bonfl:expand(cv(B(l,f[l]),difF))$ 

bonfl:expand(ev(bonfi))$ 

for  i:l  thru  n  do  (eqone[i]:ratcoef(bonfl,exp(th(i,x,y,t)),l), 

om(i]:factor(rlis(part(solvc(eqone[i],om[i]),l))), 

if  n>l  then(tf[2]:sum(a[i,j]*exp(th(i,x,y,t))*exp(th(j,x,y,t)),j,i+l,n), 

fl2]:cv(il2]+tf[2))))S 

om[l); 

om[2); 

om[3]; 

bonf2:expand(ev(b(l,f[2])+b(f[l],f[l])+b(f[2],l),difr))$ 

bonf2:expand(ev(bonf2))$ 

if:n>l  then(for  i:l  thru  n  do  (for  j:i+l  thru  n  do( 

eqtwo[ij]:ratcoef(bonf2,exp(th(i,x,y,t))*oxp(th(j,x,y,t)),l), 

a[ijJ:factor(fhs(part(solvc(cqtwo[ij],a[ij]),l))), 

if-'n>2'then(tf[3]:sum(b[ij,k]*oxp(th(i,x,y,t))?exp(th(j,x,y,t))* 

exp(th(k,x,y,t)),kj+l,n), 

f[3]:cv(f[3]+tf[3])))))S 

a[l,2]; 

a[l,3]; 

a[2,3]; 

bonf3:cxpand(cv(bll,q3]j+bffll],fl2];+blfl2J,fll])+blf(3),lJ)difrj;S 

bonf3:expand(ev(bonf3))S 

length(bonf3); 

if  n>2  thcn(for  i:l  thru  n  do  (for  j:i+l  thru  n  do  (for  k:j+l  thru  n 

do(eqthrce[ij,k]:ratcoef(bonf3,exp(th(i,x,y,t))*cxp(th(j,x,y,t))* 

cxp(th(k,x,y,t)),l), 

b[ij,k]:factor(rhs(part(solve(eqthrce[i,j,k],b[i;j,k]),l)))))})S 

f:l+sum(f[i],i,l,n); 

b[l)2,3]; 

closcfilc(); 

quit(); 

IV.  EXAMPLES  AND  TEST  CASES 

•  For  the  KdV  equation  [1-6],  ui  +  6uux  +  u3r  =  0,  one  uses  i2) 
and  B(f,g):=  Dxl[  1, 1  ](/,$)  +  Dx[<l)(f,g). 

The  output  of  the  program  confirmed  the  results  in  (Id),  (16) 
and  (18). 

•  For  the  Kadomtscv-Pctviashvili  equation  [2-6], 

(ui  F  6 uuz  +  u3z)x  F  3u2y  =  0,  one  has  u  =  23’ln/(x,y,t) 
and  B(f,g)  :=  £>xf(l,l](/,j)  F  Dx[A]{f,g)  F  3*Dy[2](f,g). 

In  this  case  0,  =  Ayr  +  I, y  -  s,t,  and  for  simplicity  we  selected 
/;  =  Aym;(i  =  1,2,3). 

Note:  insert  the  linc  /[rj  :=  A[i]  *  m[i]  at  the  beginning  of  the 
program.  We  obtain  ay  =  Ay  (A?  +  3m?),  i  =  1,2,3,  and 

_  (ki  ~  /;i  ~  +  mj)(kj  -  Ay  +  m,-  -  m,-)  .. 

,J  (Ay  F-A/F-m,-- rn,)(A,  +  kj  -  m,  +m;)’  t,]  ~  ' 

(20) 

The  program  could  not  calculate  6123  =  012013023  in  a 
reasonable  amount  of  time  because  the  equation  for  6123  lias 
267  terms  in  cxp(0i  +  02  F-  O3). 


•  For  the  Roussinesq  equation  [1-6],  «2i  -  “2r  -  3(u2)Jz  -  u.lz  =  0, 
one  has  again  (2)  and 

B(f,g)  :=  Dxt{0l2}(f,a)  -  Dz[2 ](f,g)  -  Dz[4)(f,g ). 

The  results  then  are uy  =  -A,y/l  -FA?,  i  =  1,2,3,  and 

Jl+kfJl+kj  -  2A?  +  3  Ay  A:  -  2  A?  -  1 

a„=  - • - 1 - - - ,  i,j  =  1,2,3. 

\J\  +  A?^l  +  A?  -  2Af  -  3  A;  Ay  -  2A?  -  1 

(21) 


The  program  did  also  determine  the  explicit  form  of 

*123  =  012  013  023- 


•  For  the  Sawada-Kotera  equation  [2,5,6], 
ui  +  45 u2ur  +  15tiiU2Z  +  15uu3r  +  U5r  =  0,  one  has  (2)  and 
B(f,g)  ■■=  Dxt[  1, l](/,<7)  +  Dz[6](f,g). 

Furthermore,  uy  =  Af  ,  i  =  1,2,3.  The  coefficients  arc  given  by 


&123 


(A;  -  Ay)2  (A?  -  A,Ay  +  A?) 
(A;  +  Ay)2  (A?  +  AyAy  +  A?) 
(A;  -  Aj)3(Af  +  A?) 

(Ay  +  Ay)3  (A? -A?)’ 

<*12  <*13  023* 


h  j  —  , 


(22) 

(23) 


•  For  the  shallow  water  wave  equation  [5], 
uzzt  +  3 utit  -  3uzfxutdz'  -  ux  -  u,  =  0,  one  uses  u  =  9Jln/ 
and  B(/,ff)  :=  l](/l£r)  -  Dx[2](/,y)  -  Dxt[\,  1  ](/,  j). 

Tlie  program  calculated  that 


ay 


Oi; 


Ay 

(1  +  Ay)(l  -  Ay)’ 


j  —  1,2,3, 


(2d) 


(Ay  —  Ay)3(A?  —  AyAy  +  A?  —  3) 
(Ay  +  Ay)2(A?  +  AyAy  +  A?  -  3)  ’ 


1,2,3.  (25) 


The  program  could  not  determine  6123  =  012  013  <123  due  to  the 
large  number  of  terms  in  f3. 

Hirota’s  bilinear  operators  used  in  these  examples,  Dxt[m,n}(f,g), 
Dx[n](f,g),  and  Dy[n](f,g)  are  defined  in  the  program  itself. 
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Abstract  -  A  new  differential  difference  equation  is  obtained  which  has  where  £  is  the  shift  operator  defined  by  £  V*  =  V^+i,  /  =  1, 2. 

as  its  limiting  form  a  highcr  nonlinear  Schrodingcr  (HNLS)  equation.  Performing  the  operations  indicated  in  (.4;  results  in  four  equations 

This  new  equation  is  constructed  by  methods  related  to  the  inverse  which  arc  given  by 
scattering  transform  (1ST)  and  can  be  used  as  a  numerical  scheme  for 

the  HNLS  equation.  z(A„A„)  -  CnQn  +  RnB„+\  =  0 


1.  INTRODUCTION 

In  1975  Ablowitz  and  Ladik  proposed  a  new  discrete  eigenvalue 
problem,  an  appropriate  generalization  of  adiserctized  version  of  the 
eigenvalue  problem  of  Zakharov  and  Shabat,  as  a  basis  for  generating 
solvable  discrete  equations  [1J.  They  derived  discrete  (differential- 
difference)  versions  of  the  nonlinear  Schrodingcr  (NLS),  Kortcwcg-dc 
Vries  (KdV),  modified  KdV,  and  "sinc-Gordon"  equations. 


J  Bn+l  ~  2Bn  *  Qn(An+ 1  “  Dn )  -  Qnl 

z  Cn+l  ~  BnAn  +  RnDn+ 1  —  “C„  =  Rrj 
j  (A„D„)  +  C„+i  Q„  -  Rn  Bn  =  0 


(5) 


In  1984  Taha  and  Ablowitz  derived  differential-difference  and 
.partial  difference  equations  for  KdV,  and  MKdV  equations  (2],  In  this 
paper  a  differential-difference  equation  is  obtained  which  has  as  its 
limiting  form  the  HNLS  equation 


where  A„  A„  =  A„+1  -  A„,  etc. 

Using  the  ideas  in  [1,2,3],  the  coefficients  for  the  time  dependence 
of  the  eigenfunctions  arc  expanded  as  follows: 


'<7/  =  W  +  Sqa  k  I2  +  +  6q‘  (qx)2 

+  Vfc  +  6I«  I4?  (1) 

This  differential-difference  equation  can  be  used  as  a  numerical  scheme 
for  the  HNl£  equation  (1). 

II,  DERIVING  NONLINEAR  DIFFERENTIAL-DIFFERENCE 
EQUATION 

The  key  step  in  obtaining  differential-difference  equations  which 
can  be  solved  by  the  inverse  scattcnng  transform  is  to  make  an 
association  between  the  nonlinear  evolution  equation  and  a  linear 
eigenvalue  (scattering)  problem.  To  find  a  nonlinear  diffcrcnual- 
differcnee  equation  associated  with  the  HNLS  equation,  u  is  essential 
to  use  (a)  a  suitable  eigenvalue  problem  c.g.. 


A„  =  £  inAPKB'  -  £ 

*— 2  *=-l 


CB  =  £  =  £  z “D™. 

*— I  k-2 


With  the  expanded  forni  of  A„,B„,C„,D„,  (5)  yields  a  system  of 
twenty  equations  in  eighteen  unknowns  corresponding  to  equating 
powers  of  z5,  z-5,  z4,  z-4,  •■■,z,z-1,  all  of  which  must  be 
independently  satisfied.  Carrying  out  the  algebra  we  find  the  values  of 
A„f4),  ,  D„w'  in  terms  of  the  potentials  [2].  The  remaining  two 

equations  arc  the  evolution  equations.  Tor  the  special  case  associated 
with  the  NLS  and  HNLS  equation  we  let  Rn  -  -Q\  iwhcrc  Q„  is  the 
complex  conjugate  of  Qrj  then  the  remaining  two  coupled  equations 
arc  consistent  under  the  condifions: 


Vlnil  =  zV,n  +  Qn( 0 

Vto+i  =  7^  +  R„(0  Vln 
z 


(2) 


where  z  is  the  eigenvalue  and  the  potentials  /?„.  Q„  are  defined  on  die 
spacclikc  interval  l/i  I  <  °°  and  the  rime  r  >  0,  and  (b)  the  associated 
rime  dependence, 


aP  _£><«>  =  pW  -  aF>*  =  a  , 
aP-dF  =  -  aL-w  =  p  ,  (7) 

AF  -Z>F  =  dF*  -  aF*  =  Y 

with  a  =  -a’ ,  P  =  -p*  ,  and  y  =  -y*  and  the  nonlinear 
differential-difference  equation  is 


VbU  =  , 

V*a  =  cn  Vla  +  D„  V J, 


(3) 


Qrj  =  (I  +  1  Qn  l2)[p«2„+I  +  Qn- 1)  +  a {(Qn.l  +  Qn-i) 


where  the  functions  A„,  Bn,  C„,  Dn  depending  in  general  on  the  +  £?„+2  I2  +  Q„-2  *2  +  Qr.(Q?*i  +Q*~ i) 

potentials.  Thc  cquations  for  detennining  tlic  sets  A„,Bn,C„,  D„  and 
hence  the  evolution  equation  are  obtained  by  requiring  the  eigenvalue  z 

to  be  time  invariant  (~  =  0)  and  by  forcing  the  consistency  +  Qn(Qn*\  Qn-i  +  Q*-\Qn*\  )|J  +  Y  Qn  (8) 


Jy(£  VJ  =  E{VtrJ),  i  =  l,2 


(4) 
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Let  Qn  =  Ax  qn,  taking  the  limit  as  Ax  ->  0  in  (8)  and  by  a  proper 
choice  of  the  constants 

i  a  _  -I6f  _  30 i 


(a)  a  = 

12<Ax)2 
NLS  equation 


>P  = 


12(Ax)' 


and;  y  = 


12(Ax)2 


yields  the 


iq,  =  qa  +l  \qpq  ;  (9) 

(b)  «  =  P  =  A.  and  y  =  yields  the  HNLS 
(Ax)  (Ax)  (Ax) 

equation  (1). 


|II.  CONCLUSION 

The  differential-difference  equations  derived  in-this  paper  have  as 
Iimitingforms  the  NLS  and  HNLS  equations.  These  equations  can  be 
used  as  numerical  schemes  for  the  associated  nonlinear  evolution 
equations.  These  1ST  schemes  have  a  number  of  special  properties  [2J. 
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Abstract:  The  Painleve  test  is  a  powerful  tool  [1-6]  in  the  study 
of  nonlinear  evolution  equations.  We  can  study  the  inlegrability 
of  ordinary  and  partial  differential  eouations.  Exact  solutions 
can  be  constructed.  Backlund  transformations  t^..s  can 

be  derived  within  this  approach.  By  making  use  of  the  Painleve 
lest  the  construction  of  Lie  Backlund  symmetries  is  straightfor¬ 
ward.  It  also  plays  a  fund’  » ehtal  role  in  the  investigation  of 
the  chaotic  behaviour  for  ordtnary  differential  equations.  We 
apply  the  Painleve  test  to  the  anhamtontc  oscillator,  the  stmt- 
classical  Jaynes- Cumming  model,  the  energy  eigenvalue  level  mo¬ 
tion  equation,  the  Katomdsev-Petviashivdi  equation,  the  nonlin¬ 
ear  Klein  Gordon  equation  and  the  self-dual  Yang-M ills  equation 
and  its  connection  with  the  Yang-Mills  equation. 

First  we  discuv.  ordinary  differential  equations.  The  ordinary 
differential  equations  arc  extended  into  the  complex  domain. 

Definition:  An  ordinary  differential  equation  is  said  to  have  the 
Painleve  property  when  every  solution  is  single  valued,  except  at 
the  fixed  singularities  of  the  coefficients.  That  is,  the  Painleve 
property  requires  that  the  movable  singularities  are  no  worse 
than  poles. 

Theorem:  A  necessary  condition  that  an  n-th  order  ordinary 
differential  equation  of  the  form  dw/dz  =  g(w)  where  g  is  ra¬ 
tional  in  w  has  the  Painleve  property  is  that  there  ,s  a  Laurent 
expansion 

wk{z)  =  {z  -  Zi)mkY-av(z  ~  ziY 
o 

with  n  —  1  arbitrary  expansion  '•ocfficients  (besides  the  pole  po¬ 
sition  which  i?  arbitrary). 

In  the  following  we  give  two  example.;  where  we  apply  the  Painleve 
test  to  find  solutions. 

Example  1.  The  oeir.iclas.hcal  Jaynes- Cummings  model  is  given 
by 


dSt 

dt 

dSs 

d>. 


-S2.  ^  =  5,+53E 
~S2E,  7T  Ar  fi1  E  =  CeS\ 


where  /t  and  a  ate  constants.  There  is  numerical  evidence  that 
the  system  shows  chaotic  behaviour  fot  certain  parameter  values 
and  initial  conditions.  To  perform  the  Painleve  test  we  have 
to  consider  the  system  in  the  complex  domain.  For  the  sake  of 
simplicity  we  do  not  change  our  notation.  First  we  look  /or  the 
dominant  behaviour.  Inserting  the  ansatz  (j  =  1,2,3) 


Sj(t)  <x  4o (t  -  h)m>,  E(t)  <x  E0(t  -  ;,)m‘ 


into  the  Jaynes-Cummings  model  we  find  that  the  sytem  with 
the  dominant  terms  is  given  by 


dSi 

dt 


dSs 

dt 


-StE, 


and  to i  =  -3,  m2  =  -4,  m3  =  -4  and  m(  =  -1.  For  the 
expansion  coefiicnts  we  obtain  SllU  —  S2j0  =  S3,0  —  — — , 

Eq  —  li.  From  the  dominant  behaviour  we  conclude  that  the  sys¬ 
tem  with  the  dominant  terms  is  scale  invariant  under  t  — >  e-1£, 
Si  — >  t3Si,  St  -»  e4St,  St  — *  t4Si,  E  — »  cE.  Next  we  deter¬ 
mine  the  resonances  and  the  Kowalevski  exponents.  Inserting 
the  ansatz  (j  =  1,2,3) 


Sj(t)  =■■  Sito{t  —  ti)m>  +  A(t  —  £,)mJ+r 
E(t)  =  Eoit-hr'+DV-ti)-1* 

into  the  system  with  the  dominant  terms  we  find  the  resonances 
- 1,  4,  8,  3/2  i i i/l5f2.  The  Kowalevski  exponents  can  be  found 
from  the  variational  equation.  We  find  that  the  resonances 
and  the  Kowalevski  exponents  coincide.  The  two  Kowalevski 
exponents  1  and  8  can  be  related  to  fust  integrals.  We  ob¬ 
tain  I\  —  S2  +  SJ  and  I2  =  aSs  —  aSiE  +  (dE/dt)2/ 2  since 
h(^Si,e4S2,  e'St,  c'E)  =  c8(S2  +  S2),  I2{(?Sue*S2,e*S3,clE)  = 
c4(aSt  -  aSiE  +  (dE/ dt)2/2).  Using  the  first  integrals  for  the 

system  with  the  dominant  terms  we  find  on  inspection  that 
the  first  integrals  for  the  Jaynes-Cummings  model  are  given  by 
h  =  S,2  +  Sj2  +  S3  and  I2  =  aS3  - aSi E  + 1  /2/i2E2  +  (dE/dt)2/2. 
From  the  Painleve  test  we  find  that  the  Jaynes-Cummings  model 
admits  a  Laurent  expansion  of  the  form  (j  =  1,2,3) 


sj(  t) = £  Si, ft  -  £,)i+mj ,  m = £  Eft  -  hr1 


i=0 


;=o 


with  thru,  arbitrary  constants  (including  £,).  The  expansion  co¬ 
efficients  are  dctc  mined  by  a  recursion  relation.  In  particular 
we  find  5i,j  •=  5'2li  =  S3|1  =  E\  =  0.  This  local  expansion 
is  not  the  general  solution  (owing  to  the  complex  resonances) 
which  requires  five  arbitrary  constants.  We  now  construct  an 
exact  solution  from  the  Laurent  expansions  (9)  through  (12). 
Let  k  be  the  modulus  of  the  elliptic  functions  sn(z,  k),  cn(z,  k) 
and  dn (z,k).  We  define  K\k)  .=  /0\l  —  t2)^'/2(l  —  kr2t2)~1t2dt 


where  k12  :=  1  —  k2.  By  the  addition-theorem  of  the  Jacobi 
elliptic  functions,  we  have  sn(z  +  iK',k)  —  \/ksn(z,k).  Sim¬ 
ilarly  cn(z  +  H(',k)  =  -i/kdn(z,k)/sn(z,k),  dn(z  +  iK',k)  = 
—icn(z,  k)/sn(z,  k).  For  points  in  the  neighbourhood  of  the  point 
z  =  0,  the  function  sn(z,  k)  can  be  expanded  by  Taylor’s  theo¬ 
rem  in  the  form  sn(z,/.)  —  sn(0,fc)  +  zsn'(0,fc)  +  l/2z2sn"(0,I;)  + 
l/3!z3sn"'(0,.’;)  +  where  accents  denote  derivatives.  ce 
sn(0,  k)  =  0,  sn'(0,  k)  =  I,  sn"(0,k)  =  0,  sn"'(0,I;)  =  -(I  +  k2) 
etc.  the  expansion  becomes  sn (z,k)  —  z  -  |(1  4  k2)z2  + 
Therefore cn(z,k)  =  (1— sn2z)'/2  =  1  —  l/2z2-j —  and  dn(z,k)  = 
(1  -  k2sn2z )'/2  =  1  -  \/1k2z2  +  ■  •  ■  .  Consequently 


sn{z+iK',  k)  = 


1 


__  _ — ) — z+  — (H-/;2)2z3+- 


ksn(z,k)  kz  6  k 


G2k' 


Similarly,  wc  find  that  cn(z  +  iK\  k)  =  jj  +  +  •  ■  ■  and 

dn(z  +  tK',k)  =  —  j  +  ^-iz  +  •  •  •  .It  follows  that  at  the  point 
z  =  iK';  the  functions  sn(z,  k),  c n(z,  k)  and  dn(z,  k)  have  simple 
poles,  with  the  residues  1  /k,  -i/k,  —i,  rosy —lively.  We  can 
focus  our  alfent'on  to  the  quantity  E  since  Si  can  be  derived 
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from  E.  Then  the  quantities  52  and  S3  can  be  found.  Comparing 
the  Laurent  expansion  and  the  expansion  of  the  elliptic  functions 
we  find  that: the  Jayncs-Cummings  model  admits  the  particular 
solution  (in  the  real  domain)  E(t) -=  E0dn[Sit,k)  where  Eg  = 
16H2,  k  =  2(14(1  -  vfe)/c), O2 =  c(/i2  -  1)/(4(vTT^-  1)) 
and 


The  quantities  Si,  and  S3  can  now  easily  be  found  from 
Jaynes-Cummings  model. 

Example  2;  In  the  study  of  energy  level  motion  of  the  Hamil4n 
operator  we  arrive  for  a  two  level  system  at  the  following  system 
of  ordinary  differential  equations 

dE__  ±_aY1  YY-  Yl 

d\~P‘  dA  “ 4  E'  dX  E  ' 

To  perform  the  Painlevc  test  we  consider  the  system  in  the  com 
plex  domain.  Inserting  the  ansatziJ(A)  cx  E^{\  —  Ao)m,  p(A)  a 
pf°f(A— A0)n,  V(A)  a  Vf°l(A— Ao)’  and  comparing  the  exponents 
yields  n  =  q  —  m  —  1,  where  m  is  arbitrary  at  this  stage.  Obvi¬ 
ously,  all  terms  are  dominant.  Therefore,  the  dynamical  system 
is  scale  invariant  under  A  — »  e-1A,  E  — >  e~mE ,  p  ■->  £~m+1p, 
■V  — »  £-m+1Vr.  Next  we  determine  the  coefficients  E(°\  pf°),  and 
yf°L  Requiring  that  E^°\  p(0',  yf°l  rf  0,  we  find  m  =  1/2, 
n  =  9  =  - 1/2.  Furthermore,  p,0)  -  E,0'/2  and  0°'  =  ±iE<° >/4 
with  arbitrary.  Consequently,  E( A)  =  E,0\X  —  Aq)1^2, 
p(A)  = ^(°)/2(A-  A0)‘/2,  P(A)  =  qFt£(0)/4(A- A0j-'/2  is  a  solu¬ 
tion,  where  E^  and  A0  are  arbitrary.  However,  it  is  not;  the  gen¬ 
eral  solution  which  requires  three  arbitrary  constants.  When  we 
determine  the  resonances,  using  this  solution,  we  obtain  -1, 0, 1. 
When  we  determine  the  Kowalewski  exponents,  using  this  solu¬ 
tion,  we  also  find  —1, 0, 1.  The  Kowalewski  exponents  0, 1  can  be 
associated  with  the  (polynomial)  first  integrals  of  the  dynamical 
system.  On  inspection,  we  find  that  lx(E,p,V)  =  p2/ 4  +  V2, 
I-i(E,p,V)  =  EV  arc  first  integrals.  Then  we  obtain  the  scaling 
behaviour 

Irie-V'E^e'/'V)  =  elh(E,  p,V) 

Ue-^E^p^V)  =  e°h(E,p,V) 

where  the  exponents  of  e  give  the  Kowalewski  exponents,  namely 
0  and  1.  Thus,  the  dynamical  system  is  algebraic  completely 
integrable.  Inserting  the  expansion 

E{\)  =  (A-Ao^g^HA-Ao)2 

;=0 

p(A)  =  (A-Aor^fy^A-Ao  y 

i=o 

m  =  (A-Aor^gy^HA-V 
;'= 0 

into  the  given  dynamical  system,  we  find  one  more  arbitrary 
constant  (besides  E^l  and  A0),  so  that  the  expansion  represents 
the  general  solution.  The  system  does  not  pass  the  Painlevc  test, 
due  to  the  dominant  behavior.  However,  it  passes  the  so-called 
quasi-Painleve  test,  i.c.,  it  admits  an  expansion  of  the  form  given 
above  with  three  arbitrary  constants  Obviously,  we  can  also  find 
the  general  real  solution  to  the  dynamical  system,  namely 


y2(A)  = 


The  general  solution  contains  three  free  parameters  h,  h,  and  A0 
which  are  determined  from  the  initial  values  E( A  =  0),  p(A  =  0), 
and  y(A  =  0). 

Next  we  consider  partial  differential  equations.  Suppose  that 
there  are  n  independent  variables,  and  that  the  system  of  par¬ 
tial  differential  equations  has  coefficients  that  are  holomorphic 
on  Cn.  We  cannot  simply  require  that  all  the  solutions  of  this 
system  be  meromorphic  on  Cn,  since  arbitrarily  nasty  singulari¬ 
ties  can  occur  along  characteristic  hy  persurfaces.  The  following 
definition  [2]  of  the  Painlevmproperty  avoids  this  problem.  If 
S  is  a  holomorphic  non-characteristic  hypersurface  in  Cn,  then 
every  solution  that  is  holomorphic  on  Cn\S  extends  to  a  mcro- 
morphic  solution  on  Cn. 

In  other  words,  if  a  solution  has  a  singularity  on  a  non  charade 
ristic  hypersurface,  then  that  singularity  is  a  pole  and  nothing 
worse.  A  slightly  weaker  form  of  the  Painlevc  property  was  for¬ 
mulated  by  Weiss  et  al  [1).  It  involves  looking  for  solutions  f  of 
the  system  of  partial  differential  equations  >n  the  form 

u  =  <t>~a  ]£  unj>n 

n=0 

where  <f>  is  a  holomorphic  function  whose  vanishing  defines  a 
non-characteristic  hypersurface.  Substituting  this  series  into  the 
partial  differential  equations  yields  conditions  on  the  number  a 
and  recursion  relations  for  the  functions  u„.  The  requirement 
is  that  a  should  turn  out  to  be  a  non-negative  integer,  and  the 
recursion  relations  should  be  consistent,  and  that  the  series  ex¬ 
pansion  should  contain  the  correct  number  of  arbitrary  functions 
(counting  <j>  as  one  of  them). 


It  has  been  found  that  integrable  equations  satisfy  this  weaker 
form  (perhaps  after  a  change  of  variables),  whereas  non-intcgrable 
equations  fail  it.  To  establish  Painlevc  property  is  more  difficult 
(the  Painlevc  property  implies  the  weaker  form,  but  the  reverse 
implication  need  not  hold  in  general).  However,  it  seems  that,  in 
practice,  the  weaker  form  is  sufficient  to  ensure  integrability. 
The  Painlevc  property  seems  to  be  a  useful  indicator  of  integra¬ 
bility  or  solvability,  or  both.  Integrable  here  means  ther  exists  a 
nontrivial  Lax  Pair  for  the  system. 

Example  1:  The  Kadomtscv-Pctviashvili  equation  is  given  by 


d2u  cPu  „  ,c>2u 
+  U3x2  +  chP  +3<T  dy2 


=  0 


where  a1  =  ±1.  The  Kadomtsev  Petviashvili  equation  is  a  com¬ 
pletely  integrable  soliton  equation.  The  Katomdscv  Pctvialshilvi 
equation  has  the  Painlevc  property.  We  consider  the  generalized 
variable-coefficient  Kadomtsev  Petviashvili  equation 


d2u  cPu  .  .du  ,,  ..du 
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where  a(y,t),  b(y,t),c(y,t),  d(y,t),  and  e(y,t)  are  analytic  func 
tions.  In  order  that  the  generalized  Kadomtsev  Petviashvili 
equation  satisfy  the  Painleve  property  the  function  a,  b,  c,  d,  e 
have  to  satisfy  the  system  of  equations 


da  .  2  t  ,da  Vdcde  d2e 
dt+2a  +%~  2dydy~Cdy* 


„  dd 
4  ac-2c-r- 
dy 


+ 


0 

0 


0. 


These  equations  are  necessary  and  suflicicnt  conditions  for  the 
generalized  Kadomtsev  Petviashvili  equations  to  be  transformable 
into  the  Kadomtsev  Petviashvili  equation,  provided  that  c  /  0. 
If  c  ■=  0,  the  equation  may  be  transformed  into  the  Korteweg  de 
Vries  equation  provided  that  b  —  0  and  da/dt  +  dda/dy  +  2a2  s= 
0.  Example.  2.  Consider  the  nonlinear  Klein  Gordon  equation 
d2v/d(dy  =  v3.  Inserting  the  expansion 

v  =  4>m  Y,  viP 

]=o 

we  find  m  =  —  1,  v$  =  2</>(</>n  and 

-<f>n(Vo  —  $nvoc  ~  i’t.Von  =  3uqUi 

=  3i>2«2  +  3t>0«i 

+  ulij£  =  2t)gl)3  +  6u0UiU2. 

At  the  resonance  r  =  4  we  obtain 

2^7j£t>3  +  2^„«3{  +  2^03,  +  vlrj(  —  6Uoniu3  +  3v2vl  +  3u0U2. 

Inserting  the  equations  for  the  coefficients  into  the  above  equa¬ 
tion  for  the  resonance  we  obtain  a  “huge”  partial  differential 
equation  for  <j>  [6].  If  <p  satisfies  this  condition,  then  the  expan¬ 
sion  coefficient  u,i(f,  y)  is  arbitrary.  The  nonlinear  Klein  Gordon 
equation  admits  the  symmetry  vector  fields  {d/dt,d/dy,d/d£— 
d/di i,  d/d(,  +  d/dy  —  vd/dv}. 

Next  we  construct  similarity  ansatze: 

(1)  From  d/dy  and  d/d(,  vie  find  s  =  +  c2 y  and  v(y,£)  = 

f(s).  We  obtain  cPf/ds 2  =  /3/(c1c2).  This  equation  passes  the 
Painleve  test.  Therefore  <£(tj,£)  =  c^  +  c^  satisfy  the  condition 
on  </>. 

(2)  The  symmetry  generator  (fi/df  —  yd/dy  leads  to  the  similar¬ 
ity  ansatz  11(17,  £)  =  f(s)  with  s  =  y£.  It  follows  that  (P f  /ds2  + 
(, df/ds)/s  -  f3/s  =  0.  This  equation  docs  not  pass  the  Painleve 
test.  This  is  in  agreement  that  </>((,  y)  =  (y  does  not  satisfy  the 
conditional  equation  on  </>. 

(3)  The  symmetry  generator  £d/d(  +  yd/dy  -  vd/dv  leads  to 
the  similarity  ansatz  e(i?,0  =  /(■$)/£  with  s  =  i//£.  It  follows 
that  d2f/ds2  +  2 (dfds)/s  +  f3/s  =  0.  This  equation  passes  the 
Painleve  test.  This  is  in  agreement  that  <j>(y,{)  =  y/Z  satisfy  the 
conditional  equation  on  4>. 

Exanple  3:  We  now  consider  the  self-duality  Yang  Mills  equa¬ 
tions.  Let  G  be  a  Lie  group  (the  ‘gauge  group’)  and  g  it  Lie 
algebra.  A  gauge  potential  (connection)  A  is  a  y-valued  l*form 
on  'll4.  The  corresponding  gauge  field  (curvature)  is  the  ^-valued 
2-form  F  :=  DA  s  d/\  +  [A,  A]  where  DA  is  the  covariant  exte¬ 
rior  derivative  of  A.  Two  gauge  potentials  A  and  A'  arc  regarded 


as  being  equivalent  if  they  are  related  by  a  gauge  transformation 
A!  —  n-Mft  +  D~ldQ,  where  O  is  a  G-valucd  function  on  7 14. 
The  self-duality  equations  are  *F  =  F  where  *  is  the  Hodge 
duality  operator.  These  equations  form  a  set  of  coupled  first- 
order  nonlinear  partial  differential  equations  for  Aa.  They  are 
underdetermined  (fewer  equations  than  unknowns),  but  this  un- 
dcrdeterminacy  can  be  removed  by  imposing  a  ‘gauge  condition’ 
such  as  Ao  =  0.  The  self-duality  equations  are  invariant  un¬ 
der  gauge  transformations.  The  self-duality  equations  are  com¬ 
pletely  solvable  as  a  consequence  of  the  twistor  correspondence. 
The  equations  possess  the  Painleve  property.  Many  other  inte¬ 
grate  partial  differential  equations  which  also  have  the  Painleve 
property  can  be  derived  from  the  self  dual  Yang  Mills  equation. 
Finally,  let  us  discuss  an  interesting  connection  of  the  self-dual 
Yang  Mills. equation  and  the  Yang  Mills  equation.  From  the  self¬ 
dual  Yang  Mills  equation  we  find,  after  reduction,  the  system  of 
ordinary  differential  equations  dui/dl  =  u2ti3,  du2/dl  =  tiiu3, 
du3/dt U|U2  When  we  differentiate  this  system  with  respect 
to  (  and  insert  it  into  the  new  second  order  equations  we  arrive 
at 


cPui  ,  2  2.  <Pu2  .  2  21 

—  =  Ui(u5  +  u|),  =  u2(«t  +  «5), 


<Pu3 
dt 2 


=  u3(u\  +  u\). 


This  system  does  not  have  the  Painleve  property.  It  is  not  inte¬ 
grate.  From  the  Yang-Mills  equation  D(*F)  =  0  we  find,  after 

reduction,  the  nonintcgrable  system 


-^■  =  -u,(u2  +  ^),  ~-  =  -u2  (u]+ul) 

=  ti3(u2  +  u2). 

This  system  is  nonintcgrable  and  can  be  derived  from  the  Hamil¬ 
ton  function  7/(u,  u)  =  (u|  +  u2  +  it3)/2  +  (ujti2  +  u\u\  +  u\u\)/ 2. 
It  shows  chaotic  behaviour.  Furthermore,  we  find  that  it  does 
not  pass  the  Painleve  test.  The  resonances  are  given  by  —1,  1 
(twofold),  2  (twofold)  and  4.  Studying  the  behaviour  at  the  res¬ 
onances  we  find  a  logarithmic  psi-serics.  The  two  systems  are 
equivalent  up  to  the  sign  on  the  right  hand  side.  Since  we  con¬ 
sider  the  system  in  the  complex  domain  for  the  Painleve  test  we 
can  find  that  the  two  systems  are  related  via  the  transformation 
t  — »  it. 
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Studying  dynamical  systems,  one  often  observes 
transient  chaotic  behavior.  Famous  examples  are  the 
f(6non  map,  the  forced  damped  pendulum,  the  forced 
Duffir.g  equation  and  the  Lorenz  equations.  Let  F  be  a 
differentiable,  Invertible  map  from  the  n-dimenslonal 
phase  space  to  itself,  such  that  the  derivatives  of  F 
and  its  Inverse  are  continuous.  Let  R  be  a  transient 
region,  that  Is,  R  is  an  open  and  bounded  set  in  the 
phase  space  that  contains  no  attractor.  The  stable  set 
S(R)  is  the  set  of  points  l in  R)  which  stay  in  R  for 
all  time  under  forward  iteration  of  F;  we  refer  to 
R\S(R),  the  complement  of  the  stable  set  S(R)  in  the 
transient  region  R,  as  the  transient  set.  The  invariant 
set  Inv(R)  of  F  in  R  is  the  set  of  points  in  R  which 
stay  in  R  for  all  time  under  forward  and  backward 
iteration  of  F,  and  we  assume  that  Inv(R)  is  nonempty. 
He  study  transient  regions  in  cases  where  the 
trajectory  through  almost  every  initial  point 
eventually  leaves  the  region.  We  are  looking  for 
trajectories  that  stay  in  the  region  R  as  long  as  we 
wish  to  compute  them.  A  first  question  is  "Find  a 
chaotic  trajectory  numerically  that  remains  in  the 
region  R  for  an  arbitrarily  long  period  of  time." 

A  point  p  in  S(R)  is  accessible  from  an  open  set  V 
if  there  is  a  continuous  curve  K  ending  at  p  such  that 
K\{p}  is  in  V.  He  first  investigate  the  case  where  V  is 
the  transient  set  R\S(R).  A  second  question  is:  "Given 
a  line  segment  J  that  crosses  SCR)  transversal ly. 
Describe  a  procedure  for  finding  a  numerical  trajectory 
on  the  stable  set  S(R)  that  starts  on  J  and  which  is 
accessible  from  transient  set  R\S(R)." 

Nonlinear  dynamical  systems  often  have  more  than  one 
attractor.  The  basin  boundary  is  the  set  of  all  points 
for  which  each  open  neighborhood  contains  points 
of  at  least  two  different  domains  of  attraction.  A 
generalized  attractor  A  is  the  union  of  finitely  many 
attractors,  and  we  define  basln(A)  to  bo  the  interior 
of  the  closure  of  the  domain  of  attraction  of  A.  He  now 
assume  for  the  transient  region  R  that  there  exist  2 
generalized  attractors  A  and  B,  and  each  point  in  R 
that  escapes  from  R  under  iteration  of  the  map  F  is 
either  in  baslnlA}  or  in  basiniB}.  The  stable  set  S(R) 


might  contain  points  on  the  basin  boundary  that  are 
accessible  from  basin(A)  (or  basln(B))  but  not 
accessible  from  the  transient  set  R\S(R).  Hence,  the 
ASST  method  for  finding  accessible  points  on  S(R)  is, 
generally  speaking,  not  a  procedure  for  finding 
accessible  points  on  the  basin  boundary.  A  third 
question  is:  "Given  a  line  segment  J  that  has  one  end 
point  in  basin(A)  and  the  other  end  point  in  basinlB). 
Describe  a  procedure  for  finding  a  numerical  trajectory 
on  the  basin  boundary  that  starts  on  J  and  which  is 
accessible  from  basin{A).“ 

The  numerical  methods  ("straddle  methods")  described 
below  have  been  developed  in  colloboratlon  with  J.A. 
Yorke.  He  restrict  our  attention  to  cases  in  which 
there  is  only  one  positive  Lyapunov  exponent. 

For  the  straddle  methods  below,  we  use  the  notions 
of  "escape  time"  and  "c-refinement" .  The  escape  time 
Tlx)  of  a  point  x  in  the  transient  region  R  under  the 
map  F  is  the  minimum  value  n  such  that  F  (x)  is  not  in 
R;  the  escape  time  T(x)  is  infinity  if  Fn(x)  is  in  R 
for  all  n.  For  (x,y)  on  a  line  segment  J  we  always 
assume  for  convenience  that  the  ordering  on  J  is  such 
that  we  may  write  x  <  y;  we  denote  (x,y)  for  the 
segment  joining  x  and  y,  and  |x-y|  for  the  distance  of 
x  and  y.  Let  (a,b)  be  a  pair  of  points  on  J.  For  every 
c  >  0,  an  e-reflnement  of  <a,b)  is  a  finite  set  of 
points  a  =  gQ  <  gj  <  ...  <  g^  -  b  in  la, b)  such  that 
|-|a-b|  s  |gk'gk+ll  5  c'  la_bl  for  a11  k|0Ski  N_1- 

STRADDLE  METHODS.  Straddle  methods  involve  a 

refinement  procedure  in  which  2  points  on  a  curve 

segment  are  replaced  by  2  new  points  In  some  cases  the 

points  have  different  roles.  Usually  each  of  the 

refinement  procedures  takes  a  pair  of  points  and 

returns  a  pair  of  points;  such  a  returned  pair  is  on 

the  line  segment  Joining  the  two  points  of  the  original 

pair.  The  distance  between  the  two  points  in  the 

returned  pair  is  smaller  than  the  distance  between  the 

points  of  the  original  pair.  Straddle  methods  consist 

of  applying  the  refinement  procedure  repeatedly  until 

the  points  in  the  resulting  pair  are  less  than  some 

”*8 

specified  distance  <r  apart,  say  <r  =  10  .If  the  points 
in  the  original  pair  are  already  less  than  ff  apart, 
then  no  refinement  is  carried  out.  Next  apply  the 
dynamics;  that  is,  apply  the  map  F  to  each  of  the  2 
points  of  the  resulting  pair,  giving  a  new  pair. 

The  basic  numerical  method  takes  a  pair  <an>bn^ 

which  is  separated  by  at  most  a  distance  <? ,  and  applies 

the  map  F  to  each  of  the  points  of  this  pair.  If  the 

new  pair  (F(a  ),F(b  )>  is  separated  by  less  than 
r  n  n 
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then  it  Is  denoted  <an+1.bn+1>.  and  otherwise  the 

refinement  procedure  is  applied  repeatedly  until  a  pair 

with  separation  at  most  cr  is  obtained,  and  it  is  called 

<Vi  However,  in  order  to  produce  the  first 

pair  ^ao>bo^’  ^he  Bethod  starts  by  applying  the 

refinement  procedure  on  the  given  pair  {a,b>,  whose 

points  are  presumably  more  than  cr  apart.  Writing  I  or 

(an>bnl  for  the  line  segment  from  an  to  b^,  and  to  the 

precision  of  the  computer  we  usually  have  1  c  F(I  ). 

n+1  n 

We  call  the  sequence  of  tiny  straight  line  segments 
{In}niO  a  straddle  trajectory. 


SST  METHOD.  The  "saddle  dynamic  restraint  problem" 
is  to  describe  a  numerical  method  for  finding  a 
trajectory  that  remains  in  a  specified  transient  region 
for  an  arbitrarily  long  period  of  time.  First,  we 
describe  the  refinement  procedure  that  is  involved  in 
the  current  straddle  method.  Let  {a,b}  be  a  pair  such 
that  (a,bl  intersects  S(R)  transversally. 

Let  (oc.r.fi)  be  a  triple  on  [a,bl.  We  call  (a.y.R)  an 
Interior  Maximum  triple  if  both  TR(y)  >  TR(a)  and  TR(y) 
>  TR(fl)};  we  call  (ot.y.p)  a  PIM  triple  if  (a,y,R)  is  an 
Interior  Maximum  triple  and  |p-a|  <  |b-a|.  Assume  that 
(a,?,p)  is  an  Interior  Maximum  triple,  and  let  P  be  any 

c-reflnement  of  {a,p>  including  y.  The  procedure  that 

•  *  * 

selects  in  the  refinement  P  any  PIM  triple  (a  ,y  ,p  ) 
is  called  a  PIM  triple  (refinement)  procedure. 

The  solution  to  the  "saddle  dynamic,  restraint 
problem"  is  the  straddle  trajectory  using  the  PIM 
triple  procedure.  We  call  the  sequence  of  tiny  straight 
line  segments  (In>  ©  a  saddle  straddle  trajectory  or 
SST  trajectory,  and  we  call  the  straddle  method  that 
generates  the  SST  trajectory  Un>nK0,  the  SST  method. 
Notice  that  each  tiny  line  segment  in  an  SST  trajectory 
straddles  a  piece  of  a  (chaotic)  saddle.  An  SST 
trajectory  typically  resembles  (after  a  few  iterates)  a 
basic  set  in  the  (chaotic)  saddle. 


ASST  METHOD.  The  "accessible  saddle  dynamic  restraint 

problem"  is  to  describe  a  numerical  method  for  finding 

a  trajectory  on  the  stable  set  S(R)  that  is  accessible 

from  the  transient  set  R\S(R).  The  refinement  procedure 

that  is  involved  in  the  current  straddle  method  is  a 

PIM  triple  (refinement)  procedure  in  which  a  PIM  triple 
#  *  *  r 

(«  ,y  ,p  )  is  selected  from  the  c-refinement  P  of  the 

Interior  Maximum  triple  (a,c,b)  such  that  (a, a*)  is  in 

the  transient  set.  This  refinement  procedure  is  called 

the  Accessible  PIM  triple  (refinement)  procedure.  The 

solution  to  the  "accessible  saddle  dynamic  restraint 

problem"  is  the  straddle  trajectory  using  the 

Accessible  PIM  triple  procedure.  We  call  the  straddle 

trajectory  <yn,0  an  accessible  saddle  straddle 

trajectory  or  ASST  trajectory,  and  we  call  the  straddle 

method  that  generates  the  ASST  trajectory  (I  }  the 

n  n£0 

ASST  method.  An  ASST  trajectory  typically  resembles 
(after  a  few  iterates)  a  subset  of  the  nonwandering 
points  in  R  which  are  accessible  from  the  set  R\S(R). 


ABST  METHOD.  The  "accessible  basin  boundary  dynamic 

problem"  is  to  describe  a  numerical  method  for  finding 

a  trajectory  on  the  basin  boundary  that  is  accessible 

from  basin(A).  The  refinement  procedure  in  the  current 

straddle  method  that  generates  a  proper  straddle  pair. 

Let  (a,b)  be  a  straddle  pair  such  that  a  is  in  basin(A) 

and  b  is  in  basin(B),  and  (a,b)  intersects  the  stable 

set  S(R)  transversally.  Let  P  be  any  ^-refinement  of 

(a,b).  In  the  unique  proper  straddle  pair  (a  ,b  }  from 

P  the  point  b  is  the  leftmost  point  of  P  that  is  in 
*  * 
basin{B>,  and  a  depends  on  the  grid  consisting  of  b 

* 

and  all  the  points  in  P  to  the  left  of  b  .  The  solution 

to  the  "accessible  basin  boundary  dynamic  restraint 

problem"  Is  the  straddle  trajectory  using  this 

refinement  procedure.  We  call  the  straddle  trajectory 

{I  )  ^_  an  accessible  basin  boundary  straddle 
n  nao 

trajectory  or  ABST  trajectory,  and  we  call  the  straddle 
method  that  generates  this  trajectory,  the  ABST  method. 

In  this  work  we  study  the  planar  cubic  map  Ho(x,y)  = 
3 

(ax  -  x  +  by,  x)  and  the  3-dimensional  H6non-llke  map 
2  2 

HZ(x,y,z)  =  (1  +  y  -  zx  ,  bx,  z  -  0.5  +  ax  ). 
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Abstract 


The  present  discussion  attempts  to  show  some 
mathematical  connections  between  chaotic 
dynamics,  fractal  sets  and  dimensionality 
which  may  have  relevance  to  physical  systems. 

1.  Introduction 

At  least  since  the  spacetime  of  relativity 
four  dimensions  have  occupied  a  special  place 
in  physics.  Modern  nonlinear  science  has 
reinforced  this  situation.  O.  Roessler  for 
instance  has  repeatedly  drawn  attention  to 
four  dimensional  sets  as  the  frontiers  of  new 
phenomina  associated  with  wrinkled  and  hairly 
attractors  (3].  Ruelle,  Takens  and  Newhouse 
envisages  chaos  as  a  sequence  of  a  finite 
number  of  Hopf  bifurcations  leading  to  a 
totally  unstable  torous  in  four  dimensions 
(4).  In  fact  one  of  the  most  important 
discoveries  in  topology  implies  that  four 
dimensions  are  more  complicated  than  any  lower 
dimension  and  surprisingly  even  higher  dimen¬ 
sion  (5).  To  motivate  our  approach  consider  a 
recent  result  [2]  where  it  was  found  that 
haemoglobin  has  a  surface  fractal  dimension 
ct  =  2.4.  Now  this  is  more  profound  than 
finding  for  instance  a  two  dimensional  object 
with  a  fractal  dimension  less  than  two  because 
somehow  holes  could  account  for  the  reduction. 
Here  however  they  are  Insisting  that  it  is  a 
surface. Consequently  the  0.4  may  be  attribu  - 
ted  to  "negative"  holes  in  the  surface.  It 
must  be  a  very  rugged  surface  full  with  little 
mountains  trying  in  a  sense  to  jump  out  into 
the  surrounding  three  dimensions.  Should  we 
ever  encounter  a  surface  which  has  a  fractal 
dimension  d  >•  3,  this  would  be  even  more 
radical.  In  a  "facon  de  parler"  such  a  surface 
wants  to  roach  out  of  the  embedding  three 
dimensional  Eucledian  manifold.  That  way  d»3 
may  be  regarded  as  a  "critical*  dimension  for 
this  "strange"  surface.  Generalizing  to  n 
dimensions  we  could  say  that  whenever  the 
fractal  dimension  of  an  object  and  the 
dimension  of  the  hosting  manifold  becomes 
equal  a  critical  state  in  the  preceding  sense 
is  reached.  For  reasons  which  we  are  about  to 
make  clear  here,  we  will  term  this  critical 
state  quasi  ergodic  criticality.  In  what 
follows  we  would  like  to  show  that  under  a 
fairly  reasonable  assumption  one  can  conclude 
that  four  dimensions  marks  a  special  point  in 
chaotic  dynamics. 

2.  Cantor-like  sets  and  critical  ergodicitv 

The  starting  point  of  our  analysis  is  the 
generally  accepted  realization  that  fractals 
( 6  J  are  the  carriers  of  complex  strange 
behaviour.  Second  and  without  going  into 
detail,  we  follow  Yorke's  conjecture  that 
single  Cantor  sets  are  some  how  the  bock  bone 
of  all  strange  behaviour  (7).  To  that  we  add 
what  we  intuitively  feel  as  evident  namely 
that  in  one  dimension  it  is  extremely  hard  to 
think  of  any  simpler  fractal  set  than  Cantor's 
middle  third  set  (2]  with  dc  »  Log  2/Log  3. 
If  we  can  accept  all  this,  which  is  not 
particularly  easy  to  justify  we  con  claim  that 
in  four  dimensional  phase  space  a  strange  set 


will  typically  have  a  Cantor-like  fractal 
dimension  dc  "=  4.  This  result  is  reached  using 
the  following  scaling  argument.  The  idea  is  to 
find  the  equivalent  to  a  triadic  Cantor  set 
in  two  dimensions.  Such  a  set  should  be 
triadic  Cantorian  in  every  conceivable  direc¬ 
tion.  It  cannot  therefore  be  the  Cartesian 
product  of  two  such  sets,  de  =  Log  4 /Log  2  nor 
a  Cantor  target  dc  °  1  +  Log  2/Log  3.  However 
we  know  that  a  unit  area  A  of  an  Euclidian 
manifold  is  given  by  A  =  ( 1 )  (!)  •  1  and 

consequently  a  corresponding  or  quasi  area  of 
a  Cantor  set  is  Ac  =  (dt)  (dc).  It  follows 
then  that  in  order  to  normalize  Ac  it  must  be 
multiplied  by  the  normalization  factor 
(A/Ac)^  .  By  analogy  in  n  dimensions  we 
would  have  S^=  (A/At  )„  .  Denoting  the  n-th 
Cantor-like  fractal  dimension  in  n  dimensional 
space  by  Clc  and  the  dimension  of  the  corres¬ 
ponding  Euclidian  space  in  n  dimensions  by 
d"0  a  n  it  follows  then  that 


4<rt)  9  J  -  ole  -  /l)'1  (J  ) 

where is  termed  the  escalation  factor.  This 
is  the  set  which  we  are  looking  for  and  the 
result  is  now  evaluated  for  dc  =  Log2/Log  3  in 
table  1.  Note  that  cAs  could  be  equally 
interpreted  as  the  Floquet  multiplier  of  a 
discrete  map 

J  J  J_ 

^  Ctrn- 1)  “  ^(tn)  K°) 

|«0  j  Co} 

where  n  =  m  +  1,  d-d  and 


-I 


ds  =  O  (  dcm-mV^Cdt",)) 

dr 

dr 

Basic  assumption 

° 

Co) 

dc  =  0.63092 

Normality 

i 

1 

Results 

2 

3 

4 

5 

6 

7 

8 

1.58496 

2.51210 

3.98159 

6.31067 

10.00218 

15.85309 

25.12655 

-  TABLE  1  - 

There  are  a  few  interesting  observations  here. 
First >  =■  is  the  fractal 

dimension  of  the  Serpenski  gasket  which  is  the 
prototype  of  fractal  lattices  with  infinite 
hierachy  of  loops.  Second  for  .all  n<4  we  have 
vhile  for  n>4  we  have  ct^  »  .  Only  at 

n=4  we  have  a  Cantor-like  structure  which 
comes  very  near  to  a  space  filling  set.  The 
two  dimensional  geometrical  analogue  of  this 
is  the  peano  curve  which  is  ergodic  and  shares 
a  few  properties  with  fat  fractals  [8J.  vie  may 
say  therefore  that  at  n»4  the  set  is  almost 


851 


ergodic.  The  third  observation  is  that  for  any 
three  successive  dimensiond<rt5/»4  o[(«-0+ 

This  is  strongly  reminiscent  of  the  Fibonacci 
numbers  (2)  and  the  corresponding  dimension 
will  be  termed  the  Fibonacci  fractal  dimen¬ 
sion.  Should  we  insist  that 

then  we  find  that  at  n=4  the  corresponding 
Cantor-like  dimension  is  dc  =  4 .23606 . while 
the  Serpenskr  gasket  [8]  is  replaced  by 0(5=  l/<f> 
where  is  the  Golden  mean  [2].  In  fact  our 

table  number  1  becomes  identical  to  the  table 
calculated  by  Cook  II]  for  Botticelli's  venus. 
The  next  step  is  of  course  the  obvious  thing 
to  do.  We  determine  the  escalation  value  c(s 
corresponding  to  exact  critical  equality  of 
d'"5  and  n  in  four  dimensions.  This  is  an 
elementary  application  of  our  formula  relating 
dtrt)  to  n.  This  way  one  finds 


This  is  very  close  to  the  Serpenski  gasket  [8] 
dc  =  1.58496.  Now  a  single  Cantor  set  is 

easily  made  to  have  any  fractal  dimension 
between  one  and  zero.  Within  this  range  it  is 
now  interesting  to  consider  the  consequence  of 
having  taken  a  Cantor  set  with  Hausdorf 
dimension  dc  =  Log  2/Log  4.  In  this  case 
dc  =  0.5  seems  to  be  a  distinct  value  between 
one  and  zero  which  might  be  regarded  naively 
as  the  most  "fractal"  value  in  this  unit 
interval.  It  is  also  the  correlation  dimension 
found  for  period  doubling  chaos  in  the  one 
dimensional  logistic  map  as  well  as  the 
probability  describing  the  random  behaviour  of 
the  tent  map.  It  is  an  elementary  matter  to 
show,  using  the  same  previous  formula,  that 
dc  =  2.  The  critical  state  thus  shifts  from 
n  =  4  to  n  =>  2. 

This  is  however  another  way  of  viewing  the 
“critical"  ergodic  state  n=4.  It  is  also 
related  to  quasi  periodically  forced  horse 
shoe  maps  displaying  peano-like  dynamics  (10 J. 
Finally  let  us  consider  the  implication  of 
shifting  criticality  in  the  present  ergodic 
sense  to  n=3.  This  clearly  implies  an 
escalation  factor  d  =  fT  ■>  1.732050.  Notice 
that  in  this  case  dc  =  1.73205  is  indeed  a 
value  found  frequently  in  two  dimensional 
Poincare  maps  of  dynamic  system  as  well  as 
numerous  fractal  objects  found  in  nature  [8]. 
The  role  of  multifractals  a3  well  as  fractal 
sets  made  up  of  the  union  of  different  fractal 
subsets  in  developing  more  accurate  mathe¬ 
matical  model  will  not  be  discussed  here. 

3.  Concluding  Remarks 

Looking  back  at  table  1.  One  may  be  lead  to 
speculate  if  fully  developed  turbulence  has  a 
fractal  dimension  -  d  V  6.3  and  that  five 
dimensional  phase  space  is  required  to  study 
this  phenomina.  This  would  be  for  instance  a 
nonlinearly  oscillating  set  described  by  a 
phase  space  x  ,  x  and  J2  representing 
temporal  and  spacial  oscilation  of  a  state 
variable  x.  In  addition  we  need  a  special 
fluctuation ^ and  a  temporal  fluctuation  *Jfras 
forcing  frequencies.  This  makes  them  indeed 
five  variables.  Another  worthwhile  observation 
is  that  the  Fibonacci  fractal  dimension 
c UJ)o  1  +  l/(Log  2/Log  3)  =  2.58496  is 
identical  to  dls  =  l/(Log  2/Log  6)  where 
Log  2/Log  6  is  clearly  a  reasonable  measure  of 
the  fractal  dimension  at  period  3  chaos 
of  a  Feigenbaum  cuscad.  Note  also  that 
dc  =  Log  2/Log  6  ~  0.387  is  very  close  to  the 
smallest  value  found  for  period  3  chaos  of  the 
logistic  map  [9,11]  (d  ~  0.378). 

It  is,  of  course  important  to  appreciate  the 
role  of  the  proximity  of  some  rational  and 


irrational  numbers  such  as  3/4,  TT/5 ,  and 
$  =  (1  +  ]f5)/2  and  dc  =  Log  2 /Log  3,  in 

arriving  at  some  of  the  preceding  conclusions. 
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ABSTRACT 

Typical  similarities  and  differences  between 
strange  chaotic  and  nonchaotic  attractors  in 
deterministic  systems  and  random  behaviour  are 
discussed.  It  has  been  shown  that  based  on  a 
single  time  series  it  is  impossible  to 
distinguish  between  these  types  of  behaviour 
even  using  Lyapunov  exponents  technique. 


In  last  decade  attention  has  been  given  to 
a  class  of  dissipative  dynamical  systems  that 
typically  exhibit  strange  behaviour  [1-3].  Such 
behaviour  has  been  found  in  numerical  experiments 
[3,4]  as  well  as  in  experimental  systems  [5,6]. 

Recently  two  classes  of  strange  attractors 
have  been  distinguished: 

(a)  a  strange  chaotic  attractor  -  one  which  is 
geometrically,  strange’  l.e.  the  attractor  is 
neither  a  finite  set  of  points  nor  it  is 
piecewise  differentiable  and  one  for  which 
typical  orbits  have  positive  Lyapunov 
exponents 

(b)  a  strange  nonchaotic  attractor  -  one  which  is 
also  geometrically  ’strange’  but  for  which 
typical  nearby  orbits  do  not  diverge 
exponentially  with  time  (7-9,  15-21]. 

Strange  nonchaotic  attractors  have  been  found 
to  be  typical  for  quasiperiodically  forced 
systems  [7,18].  Recently  they  have  been  also 
observed  in  experimental  system  [21]. 

Although  one  may  doubt  that  these  are  periodic 
or  quaslperiodlc  orbits  with  sufficiently  long 
period  but  even  in  this  case  period  Is  longer 
than  any  reasonable  observation  and  that  is  why 
their  name  is  justified. 

As  both  types  of  strange  attractors  look  very 
similar  (  compare  for  example  Poincare  maps  of 
Figure  1(a)  and  (b)),  the  value  of  Lyapunov 
exponents  seems  to  be  the  only  quality  which 
allows  us  to  distinguish  these  classes. 

In  this  paper  we  present  some  numerical 
experiments  showing  that  it  Is  impossible  to 
distinguish  between  strange  chaotic  and  nonchaotic 
deterministic  behaviour  basing  on  a  single  time 
series. 

For  systems  which  equations  of  motion  are 
explicitly  known  and  the  linearized  equations 
exist  there  is  a  straightforward  technique 
[10,11]  for  computing  a  complete  Lyapunov 
spectrum. 

For  most  of  the  experimental  systems  the 
equations  of  motion  are  not  known  [  12  )  or  are 
In  the  form  for  which  the  linearized  equations 
do  not  exist  [  6,13].  In  this  case  Lyapunov 
exponents  are  estimated  based  on  the  monitored 
long  -  term  time  series.  First  the  attractor  is 
reconstructed  by  the  well-known  technique  with 
delay  coordinates  [14  ].  Our  reconstructed 

attractor  though  defined  by  a  single  trajectory 
can  provide  points  that  may  be  considered 
to  lie  on  different  trajectories.  It  has  been 
shown  that  in  many  cases  this  attractor  has 
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Fig.  1.  The  Poincare  maps  of  the  quasiperiodically 
forced  eq.  (1):  a=5.0  ,  d=5.0  ,  0=VZ  + 
1.05  ;  (a)  strange  chaotic  attractor  cj  = 

0.002,  the  largest  nonzero  Lyapunov 
exponent  A=0. 1183,  (b)  strange  nonchaotic 
attractor  cj=0.  006,  A=-0. 1213. 

got  Lyapunov  spectrum  identical  to  that  of 
the  original  attractor  [10). 

The  technique  of  estimation  of  Lyapunov 
exponents  based  on  the  reconstructed  attractor 
gives  good  results  when  we  have  at  least  one 
positive  Lyapunov  exponent  In  the  spectrum. 

In  what  follows  we  consider  the 

quasiperiodically  forced  Van-der-Pol’ s  equation 

••  2  . 

x  -  a(l  -  x  )x  +  x  =  dcosutcosOt  (1) 


For  eq.  (1)  linearized  equations  exist  and  we 
can  compute  Lyapunov  exponents  directly  from  the 
formula  : 


>  -  ,,n  Mil 
X  BS  d(0) 


(2) 


whore:  d  =  >  while  y  is  a  solution 

of  a  linearized  equation. 

In  these  cases  we  have  computed  Lyapunov 
exponents  twice  from  the  formula  (2)  and 
from  time  series  based  on  Wolf  et  al, 
algorithm  [10].  In  numerical  similations  the 
four  order  Runge-Kutta  method  with  time  step 
T/200,  where  T=2U/u  has  been  used.  Strange 
nonchaotic  attractors  have  been  observed  up 
to  T=10  .  The  comparison  of  these  results  Is 

shown  In  Figure  2. 

From  Figure  2  one  finds  that  the 
calculation  of  the  Lyapunov  exponents  from  the 
explicitly  known  differentiable  equation  allows 
to  distinguish  between  strange  chaotic  and 
nonchaotic  attractors.  This  distinction  cannot 
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d 

5.0 

50 

S.0 

5.0 

0) 

0.006 

0.007 

0.003 

0.002 

Q 

v^+1.05 

V2+1.05 

v'2+1.05 

v'2+1.05 

A 

max 

formula  (2) 

-0. 1213 

-0. 2834: 

0. 1426 

0. 1468 

time  series 

0.0845 

0.0684 

0. 1183 

0. 1232 

Type  of 

strange 

strange 

attractor 

nonchaotic 

chaotic 

Fig.  2.  The  comparison  of  the  values  of  Lyapunov 

exponents  A  computed  from  formula  (2) 
max 

and  estimated  from  time  series. 


be  followed  based  on  the  Lyapunov  exponents 
estimated  from  a  single  time  series,  as  by  this 
method  we  obtained  positive  values  of  Lyapunov 
exponents  not  only  in  the  case  of  strange 
chaotic  attractors  but  for  strange  nonchaotic 
attractors  as  well. 

This  result  may  look  quite  surprising  but  it  is 
justified  when  we  follow  the  method  of  Lyapunov 
exponents  estimation  from  the  attractor 
reconstructed  from  single  time  series.  If  a  time 
series  is  irregular  (not  periodic,  quasiperlodlc) 


it  is  not  distinctive  from  chaotic  one  and 
the  reconstructed  attractor  has  got  the 
complicated  geometry.  Estimating  Lyapunov 
exponents  from  this  attractor  we  have  to  obtain 
a  positive  values  for'  both  strange  chaotic 
and  nonchaotic  attractors,  as  the  whole 
procedure  explores  the  aperiodiclty  of  time 
series  and  not  the  explicite  dependence  on 
initial  conditions.  As  other  methods  of 
estimating  Lyapunov  exponents  from  time  series 
[23-26]  are  also  based  on  the  same  method  of 
attractor  reconstruction  It  seems  that  using  them 
similar  results  are  very  likely. 

The  posslbllty  of  having  a  system  showing 
strange  behaviour  without  sensitive  dependence 
on  initial  conditions  should  not  be  overlooked. 
It  seems  that  more  care  will  have  to  be  given 
in  applying  theprocedure  of  estimation  of 
Lyapunov  exponents  from  time  series  to 
experimental  data.  The  general  conclusion  that 
it  imply  can  be  misleading,  as  there  are 
systems  for  which  distinction  between  strange 
chaotic,  strange  nonchaotic  behaviour  is 
Impossible  based  on  a  single  time  series. 
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Abstract  -  A  route  to  chaos  in  the  system  with 
dr/  friction  is  analyzed.  In  spite  of  the 
complexity  of  the  system,  a  similar  transition 
to  that  discovered  in  the  two-well  potential 
anharmonlc  oscillator  is  described  and  illus¬ 
trated.  Dry  friction  weakens  the  chaotic 
dynamics  and  induces  the  occurrence  of  stick 
and  slip  transitions  during  the  chaotic  wan¬ 
dering  of  the  trajectory  in  four  dimensional 
phase  space. 

1.  INTRODUCTION 

The  aim  of  this  paper  is  to  show  the 
"qualitative  universal"  transition  to  chaos  in 
a  certain  subclass  of  sinusoidally-driven  non¬ 
linear  oscillators,  i.  e.,  systems  with  a 
two-well  potential .  The  question  of  interest 
is  whether  or  not  the  scenarios  leading  to 
chaotic  orbits  discovered  in  simple  uncoupled 
oscillators  are  likely  also  hold  for  much  more 
complicated  systems,  such  as  coupled  nonlinear 
sinusoidally  driven  oscillators.  Simulation 
experiments  show  that  the  potential  has  two 
wells,  and  that  chaotic  dynamics  will  obtain, 
in  which  each  of  the  oscillators  jumps  between 
two  wells  in  an  unpredictable  way. 

2.  THE  SYSTEM 

We  consider  a  system  of  two  coupled 
mechanical  oscillators,  both  of  which  are 
externally  driven.  The  governing  equations  are 

mtZf  +  CC-t-C,)*,  -C3£v  +  C,x?;x,  *(k,  *kj)x, 
-k3x7*k7x:\  Q,cosi( u),i*Q). 

-k3x,+ksx7  “  q2cos(<JUxt)»  (1) 

where  m\  and  mz  are  the  masses  of  the  oscil¬ 
lators,  C,-Cs  and  fc|-fc5  are  damping  and 
stiffness  coefficients,  respectively  q,  and  qz 
are  the  amplitudes  of  the  exciting  forces  with 
corresponding  frequencies  uo,  and  10 2,  and  $ 
denotes  a  phase  shift  between  the  exciting 
forces . 

In  nondimensional  form  we  have 
\ 1 " *  (<*3  "  o-i  )?.  1' "  a3(k’M ' 1 )°  +  y ,  Zft  1 '  *  (*  1  *  K:.Hi 

-k3(KM~,)°!‘Z?  +  ^+  Rsyn(¥,l')  -  B,cos(-c*^)w 

-Mk3(MK  -  Af‘  ' K  si/J;ro!i(vi).  (2) 

where 
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t  =  u>,/ =  (to,m°s)  ' k.p/'x ,  ,$2  =  (uj 'k°/xz, 

M  =  01,012',  K  =  ktk's',  v  =  to2co,'. 

5,  =  g|Uj,3fn, '  S1°G.  fi2  =  gzu) ^/n, 1  , a,  =  C|(m|U),)  1 , 

a3=C3(mlu)l)'l,a,  =  C„(/n,iu,)  1  ,k,  =  10 

Yi  =  (a) | C  7kz  .  y2  =  (w  1 C 4k z  .  k*3 s  k3m i  (aj i  . 

/f“|igc*>J3fcgS/iii0'®.  (3) 

Using  the  transformations  (3),  the  nineteen 
parameters  of  equations  (1)  are  reduced  to 
fourteen  parameters  in  (2). 

Such  a  general  system  has  been  investigated 
earlier  by  the  authors  [1-3]  using  a  systemat¬ 
ical  numerical  approach.  Transitions  between 
quasiperiodic,  strange  chaotic  and  strange 
non-chaotic  attractors  have  been  reported  as 
well  as  some  special  chaotic  dynamics  has  been 
discussed  and  illustrated.  Here  an  attention 
is  focused  on  the  influence  of  friction  of  the 
chaotic  dynamics  on  the  mentioned  above  sys¬ 
tem. 

3.  NUMERICAL  ANALYSIS 
We  define:  F s,  =  \untg , 

F  =  (kt  +  k3)x,-  k3x2  +  kzX*  -  c3x3  -  q  ,cosvo,l .  (4) 

When  X|"0  and  \F\<\Fn  I,  the  first  oscillator 
is  in  a  stick  state.  During  the  transition 
from  a  slip-state  to  a  stick-state,  an  accel¬ 
eration  jump  occurs .  During  an  exit  from  a 
stick-state  to  a  slip-state  the  acceleration 
is  continuous,  but  a  jump  in  the  third  deriv¬ 
ative  of  the  displacement  appears.  The  veloc¬ 
ity  in  both  cases  is  always  continuous.  During 
"the  transition  over  a  stick  area",  but 
without  sticking,  the  acceleration  jump  also 
occurs.  When  a  regular  transition,  however, 
from  a  slip-state  to  a  stick  takes  place  with 
If  !<!(/  the  one  eigenvalue  of  the 

Jacobi  matrix  is  equal  to  zero.  When 
I F  !=»[(/■  5,)max.l  and  the  acceleration  jump  does 
not  appear,  the  Jacobi  matrix  is  not  singular. 
The  following  equations  govern  the  dynamics  in 
the  stick-state: 

-Af 1  --  ,Vf '  ’’ k  "  ’ /?,. ro:;  v  (  .  (b) 

with  the  following  transition-condition 
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R>  |  (K,  - -  k3(K/M)0U1,2 * 

-aa(tf/M)°%/- B ,  cost  I .  (6) 

We  consider  the  behavior  of  the  system  ( 2 ) 
for  the  following  fixed  parameters: 
v  =  M-=  K  *  1 .0,  k.|  ^  “0.8 16326,  <{i  =  0.0, 

Yi^Yz"0^-  fl|  =  0.05,  Bz  =  0.2,  and  for  two  val¬ 
ues  of  friction  R. 

Example  1  (R=0_.  05). 

We  take  a,=a4  =  0.01  and  a3  =  K3  =  0.3.  For 
these  parameters  and  without  friction  (R=0), 
the  system  exhibits  intermittent  chaos.  Fric¬ 
tion  dampens  the  chaotic  dynamics  of  the 
orbits  and  for  R=0.05  we  find  a  quasiperiodic 
attractor,  in  the  neighborhood  of  these  param¬ 
eters  (for  a,  =  a.,  =  0.05  and  a3=x3  =  0.3),  a 
periodic  attractor  is  found.  An  increase  in  a, 
(a, =  a,)  results  in  an  increase  in  the  magni¬ 
tude  of  the  self-excited  oscillations.  The 
periodic  orbit  grows  and  finally  leads  to 
intersections  of  the  stable  and  unstable  man¬ 
ifolds  and  a  trajectory  starts  to  wander  in  an 
unpredictable  way  between  two  potential  wells. 
This  situation  is  illustrated  for  a(  =  <*..,  =  0.2 
in  Fig.l. 


Fig.l.  Time  history  of  a  strange  chaotic 
attractor  (R=0.05). 

Example  2  (R=0.1). 

In  the  second  example  we  analyze  the  influ¬ 
ence  of  the  coupling  between  two  oscillators. 
The  numerical  calculations  have  been  carried 
out  for  the  same  parameters  as  in  Example  1 
and  additionally  for  R=0.1  and  a, -a,)  =  0.2. 

When  two  oscillators  are  strongly  coupled 
(a3  =  2.0,  k3  =  0.3),  a  periodic  orbit  is  found. 
This  orbit  lies  to  the  right  of  the  origin. 
However,  to  the  left  of  the  origin  there  is 
also  another  small  periodic  orbit.  These  two 
orbits  lie  in  two  isolated  potential  wells. 
Decreasing  a3  causes  the  trajectory  to  move 

from  the  potential  well  and  start  to  wander 
between  the  two  potential  wells  (Fig. 2).  The 
escape,  however,  from  one  of  the  wells  to  the 
other  is  rather  rare.  The  possibility  of  it 
occurring  increases  with  a  further  decrease  in 
an.  For  example,  for  a3  =  0.3,  one  of  the  pro¬ 
jections  of  the  Poincare  map  shows  a  very  com¬ 
plicated  dynamics  (Fig. 3). 

In  order  to  understand  how  two  oscillators 
move  in  a  chaotic  manner,  two  time  histories 
(for  relatively  long  time  intervals  of  the 
same  chaotic  attractors)  are  presented  in 
Pig. 4.  In  this  figure  one  can  also  observe 
stick  states.  These  states  correspond  the  a 
very  short  horizontal  parts  of  ?i(t). 


Fig.4.  Two  different  time  histories  from  the 
same  chaotic  attractor. 


4.  CONCLUSIONS 

In  the  six-dimensional  nonlinear  mechanical 
system  with  friction  that  was  investigated, 
quasiperiodic  and  chaotic  attractors  are 
detected .  We  have  discussed  and  illustrated 
that  in  this  case,  the  route  to  chaos  is  the 
same  as  in  the  simple  two-well  potential, 
sinusoidally-driven  oscillator.  An  investiga¬ 
tion  of  the  influence  of  dry  friction  on  the 
chaotic  behavior  of  two  coupled  oscillators 
shows  that  increasing  the  friction  weakens  the 
chaotic  dynamics  of  the  orbits.  During  the 
chaotic  motion  of  the  first  oscillator, 
stick-slip  transitions  are  observed. 
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Abstract  A  unified  approacli  to  time  series  analysis  for 
une-dimensional  discrete  chaos  is  given  vvhiJi  is  based  on  the 
Galerkin  approximation  to  the  Perron-Frobenius  integral  op¬ 
erator.  The  proposed  method  gives  approximations  with  high 
accuracy  to  statistics  of  various  chaos.  Numerical  results  for 
l/}6  power  spectrum  of  intermittent  chaos  also  show  that  in 
the  limit  of  zero  frquencies,  the  observed  exponent  5  of  the  FFT 
power  spectrum  of  long-time  trajectories  is  in  good  agreement 
not  with  the  Procaccia-Schuster’s  estimate  but  with  ours. 

I.  Introduction 

There  are  two  kinds  of  time  series  analysis  for  long-time  chaotic 
trajectories  {*m}m=o  generated  by  a  1-d  discrete  dynamical 
system  xm+1  =  r(zm),  r:I  =[ 0,  l]  —  /.  One  of  them  is  the 
“time-average  technique ,  in  which  we  evaluate  certain  statis¬ 
tics  of  a  sample  long-time  trajectory  {xm}j^_0  with  some  ini¬ 
tial-value  x  =  x0  ;  the  other  one  is  the  “ ensemble-average  tech¬ 
nique"  under  the  assumption  that  t  is  mixing  with  respect  to  an 
absolutely  continuous  invariant  measure,  denoted  by  f'(x)dx. 
We  give  a  unified  approach  to  time  series  analysis  for  chaos  by 
such  an  ensemble-average  technique. 

The  time-average  technique  which  is  a  usual  method  [2]  is  re¬ 
ferred  to  as  the  “direct  method'.  On  the  contrary,  the  ensemble 
average  technique  is  a  kind  of  “ indirect  methods  because  there 
is  no  need  to  directly  calculate  trajectories.  Hence  such  an  in¬ 
direct  method is  expected  to  play  an  important  role  in  theoret¬ 
ically  understanding  chaos.  In  fact,  the  existence  of  }’{x)dx 
permits  us  toHheoretically  calculate  the  ensemble  average  of 
several  statistics  by  using  the  Perron-Frobcmus  operator,  de¬ 
noted  by  PT  (3j,[<l].  This  operator,  however,  gives  no  practically 
calculating  method  because  of  its  infinite  dimensionality.  Such 
a  situation  leads  us  to  consider  an  efficient  algorithm  for  sys¬ 
tematically  calculating  statistics  which  is  based  on  tile  Galerkin 
approximation  to  P,  on  a  suitable  function  space[5],  Numcr 
ical  experiments  demonstrate  that  the  proposed  method  can 
give  approximations  with  high  accuracy  to  statistics  of  various 
chaos. 

II.  Perron-Frobenius  Operator  and  Statis¬ 
tics  of  Chaos 

If  g  =  r(x)  is  mixing  with  respect  to  f‘(x)dx,  then  for  almost 
initial  value  x  =  x0  sequences  {xm}£_0  tan  chaotically  behave. 
From  the  BirchofTindividual  ergodit  theorem,  the  time  average 
of  any  L\  function  F(x)  along  a  trajectory  {xm}m=o>  which  is 
defined  by  /•’  =  llmj-— »  j  E l=o  rn(x)),  is  equal  almost  ev¬ 
erywhere  to  the  ensemble  average  of  F{x)  over  I,  defined  by 
<  F  >=  J,  F(x)f'(x)dx.  The  direct  time  series  analysis  is 
based  on  using  F.  However,  the  sensitive  dependence  on  ini¬ 
tial  conditions ,  one  of  chaotic  propcrtics[l],  prevents  us  from 
precisely  evaluating  On  the  other  hand,  the  indirect  time 
series  analysis  is  based  on  using  <  F  >.  We  begin  with  re 
viewing  relations  between  typical  statistics  and  PT. 

The  operator  P,  is  defined  by  Prf{x)  —  /,  A(x  -  r([i))h[g)dij. 
For  any  I.\  functions  of  bounded  variations  ./(xj  and  /i(x),  PT 
has  the  important  properly  (>/(x),/i(r(x)))  —  (PTg(x),h(x)), 


where  (g,h)  —  J;  g(x)h(i)dx.  The  invariant  density  /*(x) 
which  plays  a  key  role  in  our  indirect method  is  the  eigenfunc¬ 
tion  of  PT  belonging  to  the  eigenvalue  1,  that  is,  PTJ'(x)  — 
f{x).  The  autocorrelation  function  is  defined  by  p(A.)  — 

<  xrk(x)  >  -  <  x  >5.  The  first  term  of  the  rhs  of  this 
equation  is  rewritten  as  <  xrk(x)  (Pkxf’(x),x),  where 
the  above  property  of  PT  is  repeatedly  used.  Let  A,(x j  be  the 
eigenfunction  of  PT  with  the  eigenvalue  A,  foi  the  eigenvalue 
problem  PTh,(x)  =  A,/i,(x)  [2].  If  we  can  expand  z/‘(x)  as 
xf"(x)  =  Egi  Vih;(x),  then  we  have  p(k)  =  £“2u,Af',  the 
Fourier  Transform  of  which  gives  the  power  spectrum  S(i-) 


^  §Ui(l“  V)(l  -A,z->) 


(1) 


where  Aj  =  1,  u,  =  r/,(x,/i,)  and  z  =  t xp(j2ni/)  with  0  <  n  <  1. 
Oono  and  Takahashi  [3]  [I]  demonstrated  that  ll,;  Fredholm 
theory  of  PT  plays  an  important  role  in  discussions  of  the  power 
spectrum.  It  is,  however,  difficult  to  find  exact  solutions  of 
eigenvalues  and  eigenfunctions  of  PT,  because  Pr  has  the  in¬ 
finite  dimensionality.  Such  a  situation  led  us  to  consider  an 
efficient  algorithm  of  the  indirect  method. 

III.  Galerkin  Approximations  to  the  Perron- 
Frobenius  Operator 

Let  A  be  a  function  space  which  is  spanned  by  a  vector  ba¬ 
sis  function  f(x).  Each  component  of  t’( x),  denoted  by  lnfc(z), 
is  an  appropriately  chosen  piecewise  polynomial  of  at  most 
D  degree  whose  combination  approximates  to  }‘(x)  by  the 
Galerkin  method  [5]  such  as  f"(x)  ~  f‘£(x),  where  the  su 
perscript  t  denotes  the  transpose  of  the  vector  f.  Using  £(x), 
we  get  <  xr*(x)  f '(Pk£(x),x).  Furthermore,  using  the 
Galerkin  method  with  £(x)  on  A,  we  approximate  to  Pr£(x j 
such  as  Pt£(x)  —  P’tE(x)  which  leads  us  to  readily  obtain 
<.  ir*(z)  f^P^^x),!),  where  the  N(D+  1)  x  iV(£>+  1} 
matrix  PT  is  referred  to  as  the  Galcrkm-approximated  matrix 
of  the  Perron-Frobenius  operator  where  iV  and  D  are  integers 
to  be  given  below.  The  explicit  form  of  P.  is  given  in  [5].  Let 
1),  be  the  i— th  right  eigenvector  of  Pr  with  the  eigenvalue  A, 
for  the  easily  tractable  eigenvalue  problem  Prli,  —  A,li,. 

The  constructing  method  of  A  is  as  follows.  We  divide 
I  into  .V  subintcrvals  {/„}  with  partition  points  0  sat 
isfying  0  =  co  <  Cj  <  c2  <  <  c,\  —  1  such  that 

I  =  Unsi  In*  =  [cn-i, c„j.  The  above  Galerkin  approxi¬ 
mations  depend  on  the  appropriate  selections  of  and  of 

f(z)  [3j.  A  simple  but  efficient  procedure,  however,  is  omitted 
here  for  selecting  Next,  we  take  bases  c„>.{x)  such  as 

fn*(i)  =  Pnv(x)s(x),\n(x),  0  <  k  <  D,  1  <  »»  <  A'.  Ill  tile 
above  equation,  ,\„(x)  is  the  characteristic  function  of  /„  and 
p„ *(x)  is  the  k  -th  order  Legendre's  polv noiuial  which  is  or¬ 
thogonal  to  each  other  on  /„.  For  most  of  practical  usages,  v. 
use  J)  —  2.  When  t  has  a  bounded  invariant  density,  the  fun 
tion  s(x),  referred  to  as  a  supplementary  function,  is  Ink- .. 
to  be  1.  On  the  other  hand,  t  has  an  unbounded  uivanaiM 
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density,  s(x)  is  chosen  to  be  a  singular  function  which  approx¬ 
imates  to  singularities  of  the  unbounded  invariant  density  and 
the  inner  product  (g,h)  must  be  also  replaced  by  the  weighted 
inner  product  (tr./t)*  =  Jj g{x)h(x)w(x)dx  with  the  weighting 
function  ui(x)  =  s~2(x). 

IV.  Numerical  Examples 

Example  1  Let 

ax:  +  (a  +  b  —  ab)/b  0  <  x  <  xp  =  (1  —  l/b)ll* 
-b(xz  —  1)  xp  <  x  <  1 

This  map  can  generate  periodic  chaos  for  suitable  parameters. 
Figures  1  and  2  show  /'(x)  and  the  power  spectrum  5y(i/)  for 
periodic  chaos  of  period  6  which  are  calculated  by  our  method. 
In  this  calculation,  we  take  {r"(0)}2i,  as  the  partition  points 
so  that  edges  of  the  support  of  /‘(x)  will  coincide  with 
the  partition  points.  In  the  calculation  of  Sj-(i/),  the  finite  dis¬ 
crete  Fourier  transform  of  {p(£)}£=o  (T  —  L  024  x  6)  is  used 
instead  of  using  (1).  On  the  other  hand,  Sr,m(f)  is  obtained  by 
averaging  m  =  200  discretc-Fourier  transforms  of  trajectories 
of  length  T.  The  spectrum  Sr(i/)  is  in  good  agreement  with 
ST.mty)  except  for  fluctuations  in  the  latter. 


Fig.  1  Invariant  density  f‘(x)  (by  our  indirect  method)  for 
periodic  chaos  of  period  6  in  the  example  I. 


°i  z=10,a=0-5,b=44 (periodic  chaos  :  p=6 ) 


,v  v 


Fig.  2  Power  spectra  (by  our  indirect  method)  and 
Sr** (v)  (by  the  direct  method)  for  periodic  chaos  of  period  G 
in  the  example  1. 


Example  2  Let 

(  x  +  ux‘  0<x<xp 

,x~[  (x  -  Xp)/{1  -  Xp)  Xp<X<  1 

where  r(xp)  =  1,«  >  0, 1  <  z  <  2.  This  map  generates  inter¬ 
mittent  chaos  witlr the  power  spectrum  1/ fs.  Figure  3  shows 
the  power  spectrum  S(v)  by  our  method  (the  smooth  solid  line) 
and  5r,m(t/)  with  T  —  215  and  m  =  100  by  the  direct  method 
(the  fluctuated  line),  each  of  which  is  in  good  agreement  each 
other  in  wide  frequency  range.  In  applying  our  method,  we 
used  s(x)  -  x_,'_n  because  ;  has  the  unbounded:  invariant 
density  with  a  (z  -  l)  th  order  pole  at  x  —  0.  In  this  figure, 
the  broken  line  shows  the  Froeaecia  and  Schuster  s  estimate  [t>] 
of  the  spectrum  when  s  goes  to  0  which  does  not  coincide -well 
with  the  former  two. 


log(f) 

Fig.  3  Comparison  of  power  spectra  calculated  by  using  three 
different  methods  for  intermittent  chaos  in  the  example  2. 
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Abstract 

In  this  paper,  a  new  algorithm  of  tracing 
solution  curves  for  the  honotopy  nethod  is 
presented.  The  algorithn  is  based  on  the 
predictor-corrector  aethod  and  guaranteed  that 
tracing  solution  curves  always  succeeds. 

l. Introduction 

Recently  the  study  of  the  hoaotopy  aethod  have 
been  saae  a  great  stride  for  solving  nonlinear 
equations  globally0’ <2’ .  In  the  hoaotopy  sethod, 
for  solving  a  nonlinear  equation 

f  (x)  =0,  f :  R"->  R",  (1.1) 

an  auxiliary  equation  g(x)=0  is  used,  having  a 
trivial  solution  xe€  Rn.  Changing  the  equation 
g (x) =0  into  f(x)=0  gradually,  a  solution  of  f(x)=0 
is  obtained  by  tracing  change  of  the  solution  of  (1. 
i).  For  the  purpose,  we  introduce  a  hoaotopy 
equation  with  paraaeter  t 

h(x,  t)=0,  n:  R"x  (0,l]->  R",  (1.2) 

where 

h (x , 0) =g(x) ,  h (x , 1 ) =f (x) .  (1.3) 

Typically,  the  following  honotopy  h  is  used: 

h(x,  t)=(l-t)g(x)  +  ti'(x) .  (1.4) 

Then  a  solution  x-  of  f (x) =0  can  be  obtained  by 
tracing  an  inplicitly  defined  solution  curve  h  ’(0) 
froB  (xe,0)  to  (x‘  ,1). 

For  tracing  such  a  solution  curve,  a  kind  of 
predictor-corrector  aethod  is  known  to  be  effective. 
In  this  aethod,  a  point  on  the  solution  curve  is 
soved  along  the  tangent  vector  of  the  curve 
(predictor),  and  correct  an  deviation  of  the  coved 
point  froa  the  solution  curve  h’(0)  (corrector)  by, 
for  exasple,  the  Newton  aethod.  However,  the 
predictor-corrector  aethoo  has  a  deficiency  such 
that  the  cethod  frequentry  fails  in  tracing  solution 
curves  since  the  Newton  iteration  is  used  in  the 
sethod.  Although  theoretically  we  can  avoid  the 
failure  of  tracing  if  we  choose  a  step  length 
sufficiently  ssall,  it  has  been  said  that  to 
esticate  such  a  step  length  is  icpossible'’’  . 

In  this  paper,  under  the  assusption  that  the 
derivative  of  h  is  LipsehiU  continuous,  we  snail 
present  "constructive'"  iepiicit  function  theorea.  §y 
the  theorea.  we  can  estiaate  the  radius  of  a 


neighborhood  in  which  implicit  function  theorea 
is  valid.  Horeover,  the  theorea  gives  a  nueerical 
algorithm  to  calculate  the  icplicit  function  in  that 
neighborhood  based  on  the  sisplified  Newton  sethod. 

Moreover,  using  the  theorea,  we  present  an 
laproved  predictor-corrector  algoritha  of  tracing 
solution  curves.  By  the  new  algoritha,  tracing 
solution  curves  of  (1.2)  is  guaranteed  to  succeed. 

2-Constructiv°  Iepiicit  Function  Theorea 

In  the  following,  when  a  Banach  space  X  is 
dire-  .a  of  a  subspace  Xi  and  a  subspace  It,  we 
wro  *  X,  when  x  is  a  sua  of  Xi€Xj  and 
as  (.  ..  Horeover,  By  B(c;a;X)  we  denote  a  ball 

with  center  c  and  radius  e  in  X. 

The  conventional  iaplicit  function  theorea  can 
be  written  as  follows: 

IThcores  1) (Iaplicit  Function  Theorea) 

Let  X  be  a  Banach  space  which  is  direct  sua  of 
subspaces  X:  and  X2,  Y  a  Banach  space,  UCX  an 
open  set,  and  g:U-»Y  a  C1  operator.  Assuce  that 
there  exists  a  (p» . pz ) €  X  such  that  the  following 
conditions  hold: 

©g(xi  ,xi)=0, 

©the  partial  derivative  of  g  at  {?.,?<)  with 
respect  to  the  second  paraaeter  is  hoseoaorphisa. 
Then  for  sufficiently  saall  a>0  and  <S>0.  the 
following  holds  true: 

An  equation 

g(xi,xj=0.  xt*  3(p;:0:X2)  (2.!) 

can  be  solved  uniquely  for  x;  with  fixed  x  ► 
B(p:;5-Z;).« 

A  sap  which  saps  x  to  x*  is  called  an  iaplicit 
function.  In  this  theorea.  one  can  not  esticate  the 
largeness  of  c  and  6  .  To  est.iate  th.es,  «e  assose 
that  the  Frcchet  derivative  ef  g,  Dg,  Is  at 
Lipschits  continuous.  Then  the  iaplicit  function 
theorea  can  he  extended  as  fellows: 
ffhenres  2’  (Constructive  leplii-i*  Function  Thoarcr.^ 
Let  X  fce  a  Banach  space  which  is  direct  san  of 
subspaces  X-  and  I,,  ?  3  Banach  space.  an 
open  set.  and  2  Cl  operator.  Assuac  that 

fr-ehet  derivative  of  g.  fg.  is  or  tipschitx 
continuous.  Horeover,  vt.  asstne  that  a  <;  .p.^X 
ar.d  a  bounded  linear  cp  ra* v  A:X^Y  ar*  gives  ar.d 
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that  there  ex  st  r.'.di  and  dz  such  that  the 


following  conditions  hold: 

fl/-|-S(Pi.P«)l£r-.  (2.2) 

©  II  Dgvpi  ,pa)-  AT  (2.3) 

©lU(-,0)  II  gdi,  (2.4) 

©There  exists  A(0 ,  • ) _  1 : Y  ->X2  such  that 

II  A(0. •)-*  II  gl/dz.  (2.S) 

Then  if  £>0  and  d>0  satisfy 

(la  £*+(X+d.)£  tr)/<S  +  a(e+<T)+Kgdz,  (2.6) 

a  ( e  )+K< dz,  (2.7) 

B(pi ;  £  ;Xt )  x  B(pz:;  6  ;Xz)  CU,  (2.8) 

the  following  holds  true: 

An  equation 

g (Xi  ,Xa )=0 ,  X2  €  B  (p2 ;  <5  ; X2 )  (2.9) 


can  be  solved  uniquely  for  Xz  with  fixed  xi  € 

,B (pi ;  «  ;Xt )  by  the  simplified  Newton  algorithm.* 

Here  we  note  that  r  and  K  represent  the  errc's 
of  (p 1 1 P2 )  and  A.  If  r-K=0,  the  situation  is  like 
that  of  theorem  1.  To  save  a  space,  we  omit  the 
proof  of  theorem  2. 

3.An  Algorithm  of  Tracing  Solution  Curves 

In  this  section,  we  consider  to  use  theorem 
2  to  improve  the  predictor-corrector  method.  An 
outline  of  the  idea  is  as  follows.  In  what  follows 
we  restrict  ourselves  to  a  problem  of  tracing  a 
solution  curve  of  a  equation  h(x)=0,  h:Rn*,-»Rn. 
Thus  X=R"*',  Y=R"  and  g=h  in  theorem  2.  Let  us 
consider  a  situation  in  which  using  a  point  x,  near 
a  solution  curve,  a  new  point  x..|  on  the  solution 
curve  is  desired  to  be  calculated.  For  the  purpose, 
we  calculate  an  approximation  of  Dh (x, )  A:X-»Y  using 
for  example  numerical  differentiation.  Then  we 
calculate  Mie  tangent  vector  of  the  solution  curve 
and  decide  l-dimensional  subspace  of  X,  X 1 , 
containing  the  vector.  Ho^eover  we  decide  n 
dimensional  subspace  of  X,  X2,  to  be  the  orthogonal 
complement  of  X» .  Then  we  calculate  £  >0  and  <7>0 
satisfying  Eq . ( 2 . 6 )  and  (2.7).  If  we  choose  a 
-redictor  q  such  that  i!  q  II  g  £  ,  we  can  obtain  a  new 
point  approximately  on  the  solution  curve  by  the 
following  it. ration  in  hyperplane  (pt  +q , • ) : 

yB=P2,  yn.)=yn-A(0,-)‘lh(pi+q,yB),  (3.1) 

where  (pi , p«)=x ■  and  the  new  point  x,. ,  is  given  by 
(pi-q.yx),  N  is  sufficiently  large.  Tracing  solution 
curve  is  executed  by  repeating  above  mentioned 
process. 

In  the  following  we  shall  describe  the  algorithm 
more  concretely.  Let  X  be  a  (n+l)-dioep.3ional 
Euclidian  space  E"*',  i'.troduced  a  Hilbcr.  space 
by  the  canonical  inner  product.  Then  we  determine  Xi 
and  Xz  concretely  as  follows.  Predictor  q€X  is 
decided  to  satisfy 

Aq=0,  q*0,  (3.2) 


where  A  is  an  approximate  matrix  of  Dh (x . ) .  Then  X( 
is  determined  to  be  [q],  a  subspace  which  is 
generated  by  q,  and  X2  is  decided  to  be  [q J T ,  an 
orthogonal  complement  of  Xt.  Here  we  note  that  in 
such  decision,  di  in  Theorem  2  is  estimated  co  be  0. 
Then  A(0 , * ) ' *  exists  if  A  is  maximal  rank. 

Ve  now  present  the  algorithm  for  tracing 
solution  curves. 

(Algorithm  11 (Tracing  Solution  Curves) 

Let  X  be  a  E"*’,  Y  a  E°,  h : X— *■  Y  a  C1  operator. 
Assume  that  Dh  is  a-Lipschitz  continuous.  Then  we 
consider  to  trace  solution  curves  of  the  equation 
h (x) =0 .  Let  xa€  X  be  a  starting  point  on  a  solution 
curve,  and  q-i€  X  a  vector  representing  a  prediction 
direction. 

©Let  i=0. 

©Calculate  h (x ■ )  and  r=  II  h(xi)  II  . 

©Calculate  an  approximate  matrix  of  Dh (x , )  A,  and 
an  error  estimation  K  such  that  ||  Dh(x , ) -A.  II  ^K. 
©Let  qi  be  a  solution  of  the  equation  such  that 
q.  €  H (A , ) ,  It  0,  ||=1,  qt.j  - q i  > 0 .  (3.6) 

©Decide  X>  and  '  to  be  [q]  and  [q]T. 

©Calculate  £>0  and  6  >0  such  that  Eq .  (2.6)  and 
Bq.(2.7)  is  satisfied.  Here  let  di=0  and 
dz=l/  II  At  (6,  ■)■’  II  . 

©Execute  the  iteration  such  that 
yo=Xi  +  £  qi , 

y«f.i  *yk-At  (0,  •)"'  (yv) .  (3.7) 

until  II  h(y k )  II  becomes  sufficiently  small. 

©Let  x..i=y»  and  i=i  +1 .  Go  to  @.  ■ 

4 .Concluding  Remarks 

In  this  paper,  assuming  that  the  derivative  of 
h  is  a-Lipschitz  continuous,  we  have  presented 
constructive  implicit  function  theorem  which  can 
estimat,  the  radius  of  the  neighborhood  in  which 
implicit  function  theorem  is  valid.  Using  the 
theorem,  based  on  the  predictor-corrector  method, 
we  have  presented  a  new  algorithm  of  tracing 
solution  curve  without  failure  in  the  homotopy 
method. 

This  paper  is  partially  supported  by  the  Grant 
-in-Aid  for  the  Hinistry  of  Education,  Science 
Research  and  Culture. 
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Abstract;  The  f inito-dif ferenco,  finitu-olemont,  and- tho  algebraic 
multiconfiguration  Hortree-Fock  methods  are  briefly  compared,  and 
some  advantages  and  disadvantages  of  tho  approaches  aro  discussed. 


where  4>±  are  the  occupied  orbitals,  kvz  io  tho  kinotlc  onorgy 
operator,  Z  is  tho  nuclear  chargo,  r^2  1®  the  intor electronic 
distance,  l  0^  is  tho  wave  function,  and  are  tho  excitation 
operators  [15]. 


1.  INTRODUCTION 

In  traditional  quantum  chemistry  and  physics,  the  moloculor  or 
atomic  orbitals  (one  -  electron  functions)  aro  oxptessnd  as  linoer 
combinations  of  global  basis  functions  of  the  Slater  (oxp(  fr))  or 
Gaussian  (oxp(-fr2))  typo.  Tho  truncation  of  tho  expansion  loads  to 
a  basis-settruncatlon  error  (BSTE),  tho  exact  magnitude  of  which  is 
difficult  to  establish.  With  recent  advancos  in  the  troatmont  of  tho 
electron  correlation,  tho  BSTE  has  become  a  sorious  bottleneck  in  ab 
initio  quantum  chemistry.  Tho  BSTE  can  be  systematically  roducod  to 
negligible  magnitude  by  using  numerical  rather  than  algobraic 
approximation. 

In  the  numerical-approximation  the  uuknuwri  fuiiutiuus  (orbitals)  aro 
oxpandod  in  piocewiso  differentiable  local  basis  functions,  whilo  in 
the  algebraic  approximation  global  functions  aro  used.  In 
engineering  scloncos  low-ordor  polynomials  can  bo  usod  as  local 
bosls  functions,  whilo  to  achievo  tho  high  accuracy  needod  in 
quantum  mechanical  problems  polynomials  of  fourth  to  eight  ordor  aro 
usod.  Tho  numerical  approach  can  bo  dlvldod  into  at  loast  two 
different  classes,  tho  finite-difference  (FD)  and  tho  finito-elemont 
(FE)  methods. 

In  this  paper,  tho  algobraic,  tho  finito-dlfforonce,  and  tho  finito- 
elemont  approaches  in  quantum  mechanical  problems  will  bo  comparod, 
and  some  of  the  advantages  and  disadvantages  of  those  methods  will 
bo  discussed.  In  ordor  to  concentrate  on  tho  differences  between  tho 
three  approaches,  wo  will  restrict  tho  discussion  to  atomic  systems. 
For  molocules,  there  are  numerical  mothods  for  solving  various 
local-donsity  functional  (LDF)  equations  using  FD  method  [1,2),  FE 
method  [3, A] ,  and  splinos  in  2D  [5J  and  in  3D  [6)  based  on  one 
centre  expansions.  Fully  numerical  approaches  to  Hartrec  Fock 
equations  for  diatomic  molocules  using  FD  method  [2,7,8),  FE  raothod 
[9,10),  and  partial  wavo  expansions  [11,12]  have  boon  developed. 
Multiconfiguration  Hartree  Fock  equations  for  diatomic  molecules 
havo  also  been  solved  by  using  FD  mothod  [2,13]  and  partial  wavo 
expansions  [12,1A). 


2.  THE  MCHF  METHOD 

For  atoms,  tho  orbitals  are  expressed  in  spherical  coordinates 
(r, £,9),  as  products  of  a  radial  and  an  angular  part 


In  tho  MCHF  method  both  tho  expansion  coefficients  of  tho  orbitals 
(occurring  in  h^j  and  8ijkl^  onc*  t^10  coefficients  of  tho 
configuration  state  functions  (occurring  in  ru  and  aro 
optimized.  In  the  Hartree  Fock  mothod  tho  number  of  configurations 
is  restricted  to  ono,  and  the  donsity  matrices  aro  thus  fixod. 


3 .  THE: FD-TCHF -APPROACH 

In  tho-finitodii feronce  (FD)  approach,  tho  Euler  (Fock)  equations 
aro  obtained  from  tho  energy  functional  (2),  and  tho  Laplacian  is 
discretlzod  using  n-point  formulao.  In  onglnoorlng  sciences  low- 
ordor  (n»2-3)  polynomials  aro  mostly  used,  while  to  echiovo  tho  high 
accuracy  noodod  in  quantum  mochanical  problems,  one  has  to  uso  high 
ordor  approximations  (n=5  9/dimension) .  For  each  orbital  i,  the 
discretized  couplod  systems  of  nonlinear  Fock  equations 

2  occ  occ 

[-**!-  +  2  SjjVjj  -  VU  -  «u>  1  -  SjtVij  ♦  <ij)  (7) 


are  solved.  The  olocbron-oloctron  interaction  potentials,  Vj«,  aro 
obtained  using  tho  Poisson  oquatlon 

A 

iZ  vij  "  ~  (87 


The  Lagrango  multipliers  of  equation  (7),  which  onsuro  tho 
orthonormelity  of  the  orbitals,  are  calculated  as  oxpoctatior 
values.  The  equations  (7)  and  (8)  are  solved  until  the  rosidual 
vanishes  and  tho  energy  bocomos  stationary.  For  simplicity,  we  above 
assumed  tho  Hartroo  Fock  approximation.  In  tho  MCHF  mothod,  tho 
configuration  interaction  (Cl)  coefficients  are  also  optimized.  This 
is  done  by  constructing  tho  Hamilton  matrix  of  tho  chosen 
configuration  space  and  diagonalizing  It.  Aftor  the  diagonalizntion, 
tho  potentials  which  now  Includo  tho  configuration  interaction  ero 
recalculated,  and  tho  orbitals  are  rooptlmlzed.  This  cycle  Is 
repeated  until,  the  changes  of  the  orbitals  and  those  of  tho  Cl 
coefficients  are  negligible.  A  moro  dotailod  description  of  tho  FD- 
MCHF  mothod  is  givon  in  refs.  (16,17). 


ni(l) 

1  R^(r)  /i(i)($,V> 


(1) 


Tho  sngular  parts- ore  sphoricol  harmonics,  whilo  the  radial  parts 
R(r)  are  expanded  in  local  or  global  basis  functions.  Using  tho 
second-quantization  formalism  with  normalized  wavo  functions,  the 
multiconfiguration  Hartreo-Fock  energy  is  given  as 


l  hi  i-  n  t  *  *  &  .  8 
i,j  iJ  l,  j ,k,l 
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whoro  hii  and  8i«fcJL0£0  ^he  one  ond  two  eloctron  integrals,  and  Tw 
*  “  the  *  “  -  — J 1  *■ - ,-  i  -  J 


and  aro  the  elements  of 

matrices,  respectively. 


tho  one-  and  two  electron  donsity 
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4.  THE  ALGEBRAIC  MCHF  (MCSCF)  APPROACH 

In  tho  algebraic  approach,  tho  orbitals  of  the  energy  functional  (2) 
are  expanded  in  global  Slabor  or  Gaussian  functions.  The  onorgy 
function  obtained  is  optimized  with  rcpect  to  the  orbital  paromoters 
ond  the  Cl -coefficients,  with  Imposed  orthonormality  constraints. 
The  orbital  and  tho  Cl  parameters  appear  in  the  integrals  and  tho 
donsity  matrices,  respectively.  The  main  features  of  the  MCSCF 
optimization  will  be  described  horo.  For  details,  tho  roador  is 
rof erred  to  tho  lltorature  (15,18). 

Tho  variation  of  the  MC  enorgy  function  is  described  by  two  unitary 
operators  oxp(S)  and  oxp(t)  for  orbital  and  configuration  parameter 
rotations,  respectively.  When  tho  unitary  operators  aro  applied  on 
a  given  state,  tho  transformed  wavo  function  will  remain  normalized 
and  tho  orbitals  orthonormal.  Tho  £  end  t  operators  contain  tho 
independent  variational  parameters  of  tho  MC  energy  function.  Tho 
Taylor  sorlos  expansion  of  tho  onorgy  function  wi*4*  rospcct  to  the 
parameters  of  tho  S  ond  t  con  bo  constructed,  ond  at  tho  stationary 
point  the  first-ordor  term  (gradient)  vonlshos.  Tho  coercaon  choices 
for  solving  the  optimization  equations  are  tho  Nowton-Raphson 
procedure  or  tho  Hessian  updato  mothods  (quasl-Howton  mothods) 
(19,20).  Tho  Cl  coofficlonts  aro  usually  calculated  by  using  direct 
methods  instead  of  explicit  diogonallzabion  of  the  Hamilton  matrix. 


ru  -  <oi  £jj  l  o> 


(5) 

5.  THE  FE-MCHF  APPROACH 


rljkl  "  <0  1  £ij  £kl  -  2Jk  £U  1  0> 


(6)  In  the  FE  approach,  tho  orbitals  aro  oxpressod  in  local  piocewiso 
difforontlable  functions.  Wo  uso  Lagrange  interpolation  polynomials 
as  basis  functions  (10],  Similarly  to  tho  algebraic  approach  an 
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energy function  con  be  constructed  in  tho  numerical  basis.  Howover, 
it  is  not  possiblo  to  construct  a  fully  orthonormai  basis.  The 
number  of  basis  functions  is  huso,  A  basis  where  tho  occupied 
orbitals  aro  orthonormal  and  orthogonnl  to  those  in  the  unoccupied 
space,  and  tho  unoccupiod  orbitals  aro  non-orthonormai  con  bo 
constructed.  A  transformation  that  rotates  tho  virtual  space  into 
that  of  the  occupied  orbitals  with  out  changing  the  orthonormality 
properties  can  also  be  mado  (22).  By  using  this  generalized 
exponential  mapping,  it  is  possiblo  also  in  tho  numerical  caso  to 
parametrize  tho  orbital  rotations  like  in  the  algebraic  approach. 
Tho  exact  gradient  and  the  vector  obtained  by  multiplying  the 
Hessian  matrix  on  tho  update  vector  can  bo  calculated.  The 
optimization  equations  can  be  solved  using  tho  Hewton-Raphson  or 
quasi-Newton  methods.  The  configuration  interaction  paramotors  can 
be  optimized  as  in  tho  algebraic  approach  using  the  direct  Cl 
technique  [20,21].  Tho  numerical  methods  are  discussed  in  more 
detail  in  refs.  (22-24). 

Tho  FE-HCHF  atomic  structure  pnekogo  was  used  recontly  in  tho 
calculation  of  the  electron  affinity  of  boron  (24).  In  tho  largost 
calculation  (Is  Inactive  and  4  electrons  in  tho  5s5p4d3f  valence 
shulls),  the  number  of  configuration  stato  functions  (CSF)  in  D«h 
symmetry  was  105447,  The  electron  affinity  obtained  was  0.2668(30) 
eV  as  compared  to  tho  experimental  value  of  0,277(10)  eV  (25). 


6.  COMPARISON 

The  FE  and  algebraic  methods  aro  variational,  while  tho  FD  method  is 
not.  In  tho  FD  method,  the  variational  foaturo  is  used  for  deriving 
tho  Fock  equations  which  than  are  discretized,  while  in  the  FE  and 
algebraic  methods  the  energy  functional  is  first  discrotlzod 
(oxpandod  in  basis  functions)  and  then  varied.  In  general  tho  FD 
matrix  equations  are  unsymmotric ,  whilo  the  FE  and  tho  algebraic 
approaches  result  in  synmotric  matrix  equations.  The  matrices  of  tho 
FD  method  aro  more  sparse  than  those  of  tho  FE  method. 

Tho  FE  and  the  algebraic  matrix  problems  can  also  be  seen  as 
optimization  problems,  which  easily  can  bo  controlled  automatically, 
after  each  change  of  orbitals  the  energy  should  decrease,  otherwise 
one  has  to  go  back  to  the  previous  point  and  try  again.  This  is  not 
true  for  FD  mothod.  In  that  enso,  tho  orbitals  are  adjustod  until 
equations  (7)  and  (8)  are  satisfied,  and  tho  energy  may  go  up  or 
down  after  each  change  of  tho  orbitals.  Second-order  convergence 
methods  (Ncwton-Raphson)  can  easily  bo  usod  in  tho  FE  and  algebraic 
methods,  whilo  it  is  not  obvious  how  to  implement  them  Into  tho  FD 
method. 

In  tht  numerical  FD  and^FE  methods,  only  integrals  of  tho  occupied 
space  are  noeded.  All  integrals  aro  recalculated  after  each  chango 
of  orbitals.  By  doing  this  the  storage  and  tho  computation  of  tho 
two-electron  integrals  of  the  unoccupied  space  and  tho  timo 
consuming  Integral  transformation  («  M*  operations,  where  N  is  tho 
number  of  basis  functions)  aro  avoided. 

The  basis  of  the  FD  and  FE  mothods  cannot  bo  fully  orthonormalized 
because  the  number  of  basis  functions  is  hugo,  while  the  equations 
In  tho  algebraic  approach  are  usually  solved  in  on  orthonormai 
basis.  The  main  advantage  of  the  FD  and  FE  mothods  is  the  systematic 
convergence  towards  the  limit  of  tho  model  with  an  increasing  number 
of  basis  functions. 

In  the  FE  and  algebraic  mothods  the  orror  of  the  energy  is  quadratic 
in  the  orror  of  tho  wave  function,  while  in  tho  FD  method  those 
errors  ore  of  the  same  order.  Therefore  it  is  Incorrect  to  claim 
that  tho  accuracy  of  the  algebraic  approach  is  comparable  to  or 
bettor  than  the  accuracy  of  the  FD  mothod  (26,27)  even  though  tho 
energy  may  have  the  same  accuracy.  The  accuracy  of  a  given  property, 
the  operator  of  which  does  not  commute  with  tho  Hamilton  operator, 
has  tho  some  accuracy  as  the  energy  in  tho  FD  approximation  but  not 
in  the  algebraic  approach.  Ho  conclude  that  tho  algebraic  approach 
cannot  compote  with  the:F£  method  as  for  os  accuracy  is  concerned. 
The  comparison  is  surrmarized  in  table  1. 
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Table  1.  A  :omparlson  botwoon  FD,  algobraic  andFE  mothods 


FD 

Algobraic 

FE 

Variational 

No 

Yes 

Yos 

Symmetric  matrices 

No 

Yes 

Yos 

Sparco  matrices 

Vos 

No 

Yes 

Automatic  optimization  control 

Ho 

Yes 

Yes 

Socond-ordor  convergence  methods 

Ho 

Ves 

Yos 

Numbor  of  two-electron  integrals  0 

n* 

,  N* 

n* 

Integral  transformation 

No 

Vos 

No 

Well  defined  convergence  with 
increasing  size  of  tho  basis 

Vos 

No 

Yos 

Orthonormai  basis 

No 

Yes 

No 

a)  n  is  the  number  of  occuplod  orbitals  and  N  is  tho  number  of  basis 
functions. 
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I.  INTRODUCTION 

According  to  Eyring  and  Polanyi  [1],  a 
chemical  reaction-coordinate  can  be  seen  as  a  path 
going  from  an  energy  minimum  reactant  state  via  a 
transition  state  to  an  energy  minimum  product  state. 
The  transition  state  is  characterized  by  a  maximum 
energy  along  the  reaction  path.  This  stationary 
point  is  maximum  along  the  reaction  coordinate  and 
minimum  in  all  other  orthogonal  directions.  Thus, 
this  first-order  saddle-point  on  the  potential  energy 
surface  [2]  ^associated  to  an  indefinite  Hessian 
matrix  with  only  one  negative  eigenvalue. 

The  purpose  of  this  paper  is  to  propose  an 
augmented  quasi-Newton  algorithm  to  locate  a  first- 
order  saddle-point.  Tire  algorithm  is,  compared  to 
the  efficient  method  of  Baker  [3]  in  the  study  of  the 
methanolysis  of  protonated  methyl-formic-ester. 


H.  ALGORITHM 
A.  Quasi-Newton  step 


where  b-  and  V-  are  the  eigenvalues  and 
eigenvectors  of  the  Hessian  H.  G-  is  the  component 
of  the  gradientvector  along  the  eigenvector  V-. 

If  the  Hessian  matrix  H  is  indefinite  with 
one  negative  eigenvalue,  then  the  quasi-Newton 
step  is  a  good  search  direction.  But,  if  the  Hessian 
does  not  have  this  expected  inertia,  then  the  Hessian 
matrix  has  to  be  perturbed  in  order  to  obtain  a  new 
step  calibration  which  is  ascendent  in  one  direction 
and  descendent  along  all  the  orthogonal  ones.  The 
new  proposed  algorithm  gives  rise  to  an  augmented 
quasi-Newton  step. 


B.  Augmented  quasi-Newton  step 

The  quadratic  approximation  Q(D)  is  only 
significant  near  the  current  point.  A  scaling  of  the 
direction  step  is  then  done  via  a  restricted  step 
method.  The  displacement  vector  is  chosen  inside  a 
trust  region, 


The  energy  E(x),  a  function  of  n  real 
variables,  is,  at  least,  twice  continuously 
differentiable.  A  quadratic  approximation  of  the 
energyjfunction  around  the  current  point  x  can  be 
considered  as, 


E(x+D)  ~  Q(D)  =  E  +  G-b  +  \  D*HD 

1  (1) 

where  E,  G  and  H  are  the  energy  function,  the 
gradient  vector  and  the  Hessian  matrix  evaluated  at 
die  current  point  x,  respectively.  D  is  a 
displacement  vector  around  the  current  point. 

The  stationary  point  of  Q(D)  is  the  quasi- 
Newton  step : 


£2=  {d  :  DlD<  R2}  (4) 

with  a  trust  radius  R.  Inside  this  trust  region,  the 
transition  structure  search  step  is  calculated  via  a  • 
maximisation  of  the  quadratic  approximation  along 
an  eigenvector  Vj  and  a  minimisation  of  the 

approximation  along  the  other  eigenvectors. 

The  solution  of  this  optimization  problem 
generates  the  augmented  quasi-Newton  step 


DW  =  .  Oi  v.-X-^v, 
b,-l  i=2bi+x  (5) 


D=-H“1G.  (2) 

This  step  can  be  written  as, 


The  positive  parameter  X  is  chosen  such  that 

(i)  the  search  direction  is  inside  the  trust  region  £2, 

(ii)  the  augmented  Hessian  matrix  is  indefinite  with 
one  negative  eigenvalue.  Thus,  the  conditions 

bj-^cO  and  bi  +  A,>0,i=2,.,.,n  ^ 
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have  to  be  fulfilled. 

If  the  Hessian  matrix  has  the  expected  inertia 
and  if  the  quasi-Newton  step  is  inside  die  trust 
region,  then  the  quasi-Newton  step  is  selected. 
Otherwise,  the  step  is  chosen  on  the  boundary  of 

the  trust  region  with  a  parameter  X  solution  of 

D‘(X)D(X)=R2 
X>0 

%  >  maxjbi,  -b2} 

in.  APPLICATION 

The  algorithm  is  used  for  the  location  of  a 
transition  state  arrangement  of  the  methanolysis  of 
protonated  methyl-formic-ester  (figure  1).  The 
results  are  compared  to  those  derived  from  the 
method  of  Baker  [3]. 


Figure!.  Methanolysis  of  protonated  methyl- 
formic-ester.  .First-order  saddle-point  located  by 
the  augmented  quasi-Newton  algorithm. 

The  energy  surface  associated  to  this  protonated 
system  has  a  low  curvature.  From  a  starting  point, 
which  is  not  taken  within  tire  quadratic  region  of  the 
solution.fhe  algorithm  converges  to  the  saddle  point 
(figure  1)  after  20  iterations.  The  eigenvector 
componentsassociated  to  the  -0.00139  eigenvalue 
well  explain  the  flip-flop  of  the  water  molecule  from 
the  hydrated  methanol  to  the  methoxy  ester  group. 
After  116  iterations,  the  algorithm  of  Baker  [3] 
converges  to  a  saddle  point  in  which  only  the 
torsional  angles  of  the  methyl  rotation  are 
concerned.  Therefore,  this  critical  point  looks  like  a 
complex  between  ester  and  the  couple  methanol- 
water  (figure  2). 


Figure  2.  Methanolysis  of  protonated  methyl- 
formic-ester.  First-order  saddle-point  located  by 
the  algorithm  of  Baker. 

Forcing  the  algorithm  to  retain  the  right  Hessian 
inertia,  the  calculation  of  D  without  any  guide,  as 
given  by  the  trust  region  method,  can  converge  to 
saddle-point  structures  which  are  not  related  to  the 
expected  chemical  rearrangement 


IV.  CONCLUSION 

This  paper  deals  with  an  algorithm  involved 
in  a  transition  state  arrangement  location  on  an 
energy  surface.  This  algorithm  solves  the  problem 
of  step  estimation  as  an  augmented  quasi-Newton 
displacement  by  adding  a  positive  shift  parameter. 
The  efficiency  is  well  illustrated  by  a  18-atom 
system  associated  with  a  very  low  curvature 
surface. 

One  important  problem  inherent  to  the  matrix 
inertia  requires  further  more  investigations.  Based 
on  the  Hessian  inertia,  the  D  step  calculation 
involves  a  second  derivative  update  which,  at 
present  time,  has  to  be  improved. 
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The  model  of  a  molecule  in  which  the  nucleL  and  electrons  are 
assumed  to  be  non-relativistic  point  charges  interacting  through 
electrostatic  (Coulomb)  forces  has  been  found  to  provide  a 
satisfactory  description  of  molecular ^properties- [1].  Ab  initio 
calculations  in  molecular  quantum  chemistry  most  often  mean  solving 
the  time-independent  Schrodinger  equation  HT;  =  E'Pi  where  H  is 
the  Hamiltonian  of  a  molecule  based  on-that  model,  'Fi  is  the  i-th 
wavefunction  and  Ej  the  corresponding  energy  eigenvalue.  Even 
when  complexity  is  reduced  by  considering  only  the  motion  of  the 
electrons  in.  a  fixed  nuclear  framework  (Bom-Oppenhcimer 
approximation),  the  inherent  mathematical  difficulties  due:  to  the 
multicenter  nature  of  the  electrostatic  interactions  are  such  that 
solutions  are  not  obtainable  in  explicit  form. 

Finding  suitable  but  manageable  approximate  solutions  to  the 
electronic  Schrodinger  equation  has  thus  been  a  major  preoccupation 
of  quantum  chemists.  Central  to  attempts  at  solving  such  problems  is 
the  Hartree-Fock  (HF)  theory  [1].  The  essence  of  this  approximation 
is  to  replace  a  complicated  many -electron  case  by  a  one-electron 
problem. in  which  the  electron-electron  interaction  is  treated  in  an 
average  way. 


equations  give  way  to  numerical  approaches  in  which  Coulombic 
interactions  become  tractable  even  fu  pi  1>  atomic  molecules  [3]  In 
momentum  space,  eq(l)  becomes, 

(y ~  Jt  t  (  SM  ‘1 2Wjj*(q))6,{p-q) 

2it  j 

(V2 

p) 

i 

where  the  molecular  structure  factor  S(q)  and  the  interaction  terms 
Wjj(q)  are: 


S(q)=^zb«p(iqRi) 

1 

(3a) 

W.(q) = Jdr9j»(r)9j(r)ei!,r=  |(ip^(p)^(p-  q) . 

(3b) 

Among  other  advantages,  these  equations  do  not  require  coordinate 
systems  adapted  to  the  geometry  of  the  molecules  to  remove 
Coulombic  singularities  which  make  the  the  position  space 
formulation  numerically  untractable  beyond  diatomic  systems.  In 
eq(2)  the  only  singular  contribution  comes  from  the  q'2  factor. 


Position  and  momentum  HF  equations. 

Restricted  to  closed  shell  systems  with  n  electrons,  the  n/2  doubly 
occupied  HF  orbitals  tp,  are  obtained  in  position  space  as  solutions  of 
an  integro-differential  equation,  (F  -  £,)  tp,  =  0,  where  the  HF 
operator  F  is  a  one-electron  Hamiltonian.  It  includes  a  kinetic  term 
and  an  effective  potential  itself  comprising  the  electron-nucleus 
attraction  and  a  Coulombic  potential  approximating  the  real 
electron-electron  interactions.  In  atomic  units,  the  equation  writes  as: 


aft 


L' 

j 


9,« 


till 

■\«l 


9/(0  9,(0 

Ml 


9/0- 


(l) 


Explicit  solutions  to  eq(  1 )  cannot  be  obtained  because  of  the  terms 
|r-Ru|'*  and  |r-rj  *.  In  position  space,. numerical  solutions  can  be 
constructed  for  diatomic  molecules,  but  not  for  polyatomic  systems. 
In  such  cases  approximate  solutions  are  exprcsscd.as  truncated  linear 
combinations  of  basis  functions  (LCAO  expansion).  In  spite  of  us 
successes,  the  LCAO  approximation  experiences  various  difficulties 
(truncation  limits,  nature  of  the  basis  functions,  etc.)  which  arc  not 
entirely  controllable  [2].  Formulated  jn  momentum  space,  the  I  IF 


Numerical  Procedure  and  Problems. 

In  both  position  and  momentum  spaces,  iterative  procedures  are 
necessary- to  solve  the  HF  equations.  Starting  from  a  trial  orbital 
9/°Hp),  an  approximate  orbital  <J>ifv+n(p)  is  constructed  after  k+ 1 
iterations  of  cq(2)  rewritten  as  [4]: 


ril 

*Xw>f(p-q>}-  « 

i 

Numerical  and  computational  problems  associated  with  the 
implementation  of  the  approach  for  routine  use  fall  in  two  main 
categories  :  (a)  numerical  integration,  and  (b)  control  of  the 
orthogonality  of  the  numerical  orbitals  during  the  iteration  steps 
Different  integration  schemes  have  been  considered  To 
advantageously  cancel  the  singular  q"2  factor  in  eq(4)  by  the 
integration  volume  element,  Navaza  and  Tsoucaris  [3]  have  proposed 
the  use  of  spherical  polar  coordinates.  However,  because  of  the 
convolution  integrals,  interpolation  schemes  arc  needed  in  these 
coordinates  since  arguments  (p  •  q)  do  not  necessarily  belong  to  the 
grid  points.  Another  point  of  view  has  been  to  focus  on  these 
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convolution  integrals  and  treat  them  via  a  riiore  economical  fast 
Fourier  transform  procedure,  but  at  the  expense  of  an  approximate 
treatment  of  the  q'2  singular  factor  [5,6].  Variants  [7,8]  based  on  the 
Fock  transformation  [10]  have  also  been  proposed  to  deal  with  the 
infinite  limits  of  integration.  Computational  tests  [10]  in  the  case  of 
the  helium  atom  have  shown  the  importance  of  accuracy  and 
convergence  of  the  integrals  and,  at  present,  none  of  the  approaches 
so  far  attempted  has  been  satisfactory  enough  to  bring  the  momentum 
quantum  chemistry  calculations  beyond  a  stage  of  prematurity. 

Orthonormalization  also  raises  problems.  At  each  step,  the  new 
iterates  <!>i(k+1kp),s  need  to  be  renormalized  and  orthogonalized  to 
form  true  canonical  HF  orbitals  [1],  Great  care  must  be  exercised  in 
selecting  orthogonalization  procedures,  for  instance  the  so-called 
Lowdin's  symmetric  orthogonalization  procedure  [11],  pervasively 
used  in  quantum  chemistry,  mixes  all  the  orbitals  simultaneously, 
tends  to  contaminate  the  iterates,  and  impairs  the  convergence  of  the 
iterative  steps  [12].  Schmidt  orthogonalization  does  better  but  looses 
track  of  the  symmetry  of  these  orbitals.  Reformulation  of  eq(4;  in  a 
form  with  symmetry  and  orthogonality  constraints  would  be  very 
valuable. 


4.  NiV.  Svartholm,  /\rk.  Mat.  Astron.  Fys.,  35A.  n°  7  &  8 
(1947). 
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22(1987)361. 
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Phys.  25  (1988)  263. 

7.  W.  Rodriguez,  Y.  Ishikawa,  Chem.  Phys.  Lett.  146.  (1988; 
515. 

8.  Y.  Ishikawa,  I.L.  Aponte-Avellanet,  S.A.  Alexander,  Int.  J. 
Quantum  Chem.  Syrup.  22  (1989)  209. 
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and  Polyatomic  Molecules,  M.  Defranceschi,  J.  Delhalle 
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Promises  of  the  Approach. 

In  spite  of  the  above  problems,  increasing  number  of  results  have 
been  harvested  with  momentum  space  quantum  chemistry 
calculations. 

Fully  numerical  HF  orbitals  for  a  triatomic  molecule  have  been 
obtained  for  the  first  time  [13]  with  a  procedure  similar  to  that 
originally  proposed  by  Navaza  and  Tsoucaris  [3].  The  qualitative  and 
quantitative  advantages  of  using  high  quality  numerical  HF  orbitals  to 
go  beyong  the  HF  level  have  also  been  pointed  out  [14], 

With  trial  orbitals  <>/0)(P)  expressed  as  linear  combinations  of 
gaussian  functions,  it  is  possible  to  work  out  the  first  iteration  and 
write  the  first  iterates  Q/'Hp)  in  terms  of  transcendental  functions 
(e.g.  Dawson  function);  the  only  numerical  steps  left  being  the 
normalization  and  orthogonalization.  An  analysis  [15]  earned  out  on 
the  first  iterates  reveals  that,  by  the  virtue  of  its  integral  form,  cq(4) 
imparts  the  right  asymptotic  behaviour  to  the  first  iterates  <J>/2(p)  at 
large  and  small  values  of  |p|.  Recent  investigations  [12,16-18]  on 
atomic  systems  of  increasing  complexity  (H,  He,  H',  Be,  B+,  etc.) 
indeed  show  significant  improvements,  qualitative  and  quantitative, 
in  energy  and  wavcfunction  properties.  Thus,  already  with  a  first 
step,  it  is  possible  to  correct  for  the  deficiencies  of  orbitals  expressed 
as  truncated  linear  combination  of  basis  functions  and  produced  by 
standard  quantum  chemistry  packages. 
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Abstract :  the  knowledge  and  understanding  of  the  particle  and 
energy  transport  in  a  tokamak  are  of  crucial  interest  to  obtain 
controlled  fusion.  In  fact,  the  confinement  and  stability  of  the  plasma 
cannot  be  ensured  without  a  whole  comprehension  of  these 
phenomena.  Our  atm  is  then  to  determine  numerically  the  transport 
coefficients  which  govern  the  equations  of  conservation  from 
extraneous  informations  contained  in  experimental  data.  This  is 
achieved  by  a  ID  1/2  representation  of  the  resistive  MHD  equations 
added  to  a  least  square  formulation  of  the  constraints.  This  optimal 
control  problem  is  then  solved  using  the  linear  quadratic  sequential 
method  and  finite  elements  for  space  discretization. 

1  ■  THF.  EQUILIBRIUM  AND  TRANSPORT  MODEL 

At  the  diffusion  time  scale,  the  momentum  conservation  equation 
reduces  and  the  equilibrium  assumption  holds  at  each  time  { cf.  Ref 
[1]  for  a  complete  bibliography ).  In  an  axisymmetric  configuration, 
it  leads  to  the  following  2D  Grad-Shafranov  equation : 

L'F=jt(T)  (D 

where: 

'F  is  the  poloidal  flux  of  the  magnetic  field  B, 

L  =  -  —(——•)  -  — )  is  an  elliptic  operator, 

3rpordr  3zpordz 

jt  is  the  toroidal  plasma  current  density,  and 
PO  is  the  magnetic  permeability  in  air. 


Fig.l  Flux  lines 
obtained  from 
IDENTD  for  an 
equilibrium  at 
JET  tokamak. 


The  determination  of  jt  from  experimental  data  and  the  numerical 
resolution  of  equation  (1)  with  appropriate  boundary  condition  is 

operated  by  the  software  IDENTD  ( cf.  Ref  [1][2J[3J ).  This  gives 
the  location  of  the  nested  magnetic  surfaces  where  ¥  is  a  constant  as 
shown  in  Fig.l. 

The  averaging  of  the  conservation  equations  on  each  magnetic 
surface  leads  to  the  following  ID  system  ( cf.  Ref  [1] ): 

Conservation  of  electrons : 

T(V'ne)  +~(VTC)  =  y<S\>  (2) 

3t  3p 


where: 

p  =  (-^-)l/2  labels  the  magnetic  surfaces, 

nBo 


<|)  is  the  toroidal  flux  of  the  magnetic  field  B, 

Bo  is  the  magnetic  field  at  a  fixed  point  r  =  Ro, 
ne  is  the  electronic  density, 

V  -  -T-  where  V  is  the  volume  enclosed  by  the  magnetic  surface  p, 

3p 

and  <S  i>  is  a  source  term. 

In  the  "diagonal"  model,  the  particle  flux  is 

re  =  -D<V2p>^ 

3p 

Conservation  of  energy  for  electrons : 

l^vWPeJ^WQ^fkW) 

=  V’(-^r-a(Pe-Pi)  +  S0hm  +  <S2>)  (3) 

ne  3p 

where: 

Pe  =  nekTe  is  the  electronic  pressure, 

Te  is  the  electronic  temperature, 
k  is  the  Boltzmann  constant. 


3T 

Qc  =  -Ke<V2p> — -  is  the  "diagonal"  heat  flux, 

3p 

a(Pe-Pj)  is  the  equipartition  term, 

Pi  is  the  ionic  pressure,  S0hm  is  a  source  term  due  to  the  Joule 
effect, 

Sohm  =  -i02-- f<c2r> 

P02VC32  9p  3p  P 
3»F 

4"  =  — ,  tj  is  the  resistivity,  C2  and  C3  are  geometric  coefficients, 

3p 

and  <S2>  is  a  source  term. 

Conservation  of  energy  for  ions : 

=  V'(  Pvi+a(Pc-pi)  +  <s3>)  (4) 

ni3p 

where: 

Pi  =  nikTj  is  the  ionic  pressure, 

Tj  is  the  ionic  temperature,  nj  is  the  ionic  density; 

for  reason  of  neutrality,  nc  =  Zn;  and  Ic  =  Z Fj,  where  Z  is  the  mean 
charge  of  ions; 

Q1=-K,<V2p  > — 1  is  the  "diagonal'1  heat  flux  for  10ns  and  <S3>  is  a 
3p 

source  term. 

To  determine  the  resistivity  11,  wc  use  the  resistive  diffusion 
equation  for  the  flux  derivative, 

<5, 

3t  3p  poC3”  3p  p 
and  the  averaged  Grad-Shafranov  equation : 


f<C2'n  =  -W)V,4> 

3p  1 


(6) 
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Boundary  conditions :  (7) 

~(0,t)  =  ~(0,t)  =  ~(0,t)  =  mo  “  0 

dp  dp  dp 

ne(pmax,t).  Pe(Pmax.t),  PiXpmax.t)  are  given,  and  either  the 
total  current  Ip(t)  or  the  tension  by  lap  V (t)  arc  known : 

C2'P’(pmax.O  =  -  2npoIp(t)  from  (6),  or 


tip  3  ^203^,.  , 

— — r  - Xpmax.O = V(t) 

P0C323p  p 


2.  THETNVERSE  PROBLEM 

At  each  time,  we  can  calculate  the  equilibrium  and  determine  the 
flux  lines  by  the  software  IDENTD.  The  averaging  technique  gives 

the  geometry  pOP),  V‘(p),  C2(p),  C3(p)  of  the  magnetic  surfaces, 
the  profiles  nem(p),  Tem(p),  Tjm(p),  obtained  from  experimental 
data  by  Abel  inversion  on  the  geometry  ofthe  flux  lines,  the  current 

density,  <p>  as  a  result  of  the  identification  -  procedure  used  in 

IDENTD,  and  the  profile  'P’(p)  by  solving  equation  (6)  with  the 

boundary  condition  'l''(0,t)  =  0.  The  idea  is  to  solve  the  equilibrium 
problem  at  times  tf  and  t2  and  then  try  to  determine  the  transport 

coefficients  D,  Ke,  Ki  and  q  for  which  the  equations  (2)  to  (7)  lead 
from  the  initial  state  at  time  ti  to  the  final  state  at  time  t2. 

Setting  u  =  [D.Ke.Ki.q]  and  y  =  [ne,Pe,Pi,'F’],  the  problem  (P)  is 
then  to  minimize;over  («i,yj  solutions  of  equations  (2)  to  (7)  the 
following  cost  function  : 

J(u,y)  =^]ne(.,t2)-nem(.,t2)|2v 
-:-^Te(.,t2)-Tem(.,t2)|2v 
+~^p|  Ti(.,t2)-Tim(.,t2)  |2y 

+^l'P'(.,t2)-4'™(.,t2)|2v 


JD 

32d; 

l  JM 

32Ke 

■*T 

3p2 

V+1T 

3p2 

6Ki 

32Kj 

i2v^ 

32r[  2 

2 

Dp2 

Dp2 

where  the  last  four  terms  are  due  to  a  Tichonov  regularization 
technique,  the  K's  and  e's  are  weighting  factors,  and  V  = 
L2Q0,pmaxD- 


4.  NUMERICAL  RESULTS 

The  validity  of  our  tool  has  been  checked:  by  the  following 
procedure  :  for  given!D,Ke,  Kj,  T|  and  initial  state,  we  first  integrate 
the  transport  equations  and  then  try  to  reconstruct  the  coefficients 
from  initial  and  final  conditions.  The  behavior  of  the  algorithm  has 
been  studied  for  both  exact  and  perturbated  measurements.  First 
results  are  presently- obtained  during  discharges^  the  European 
tokamak  TORE  SUPRA  seated  in  Gadarache  (France). 

5.:CONCLUSION 

Those  preliminary  results  show  that  the  method  allows  to  identify 
transport  coefficients  in  a  way  consistent  with  full  2D  equilibrium 
and  experimental  data.  Great  improvements,,  in  understanding 
transport  phenomena  are  made  possible  and  it  remains  to  rely  those 
coefficients  to  a  global  physical  theoiy. 

Acknowledgement ;  the  authors  are  grateful  to  J.  Le  Foil  who  is  at 
the  origin  of  this  work  for  many  helpful  discussions  about  this 
problem. 
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3.  NUMERICAL  METHODS 


The  problem  (P)  is  an  optimal  control  problem  equivalent  to  the 
determination  ofthe  saddle  point  of  the  following  lagrangian  ( cf.  Ref 
[4]): 

L(u,y,p)  =  J(u,y)  +  <F(u,y),p>  where  F(u,y)  =  0  represents  the 
set  ofthe  state  equations  (2)  to  (5),  the  adjoint  state  p  their  Lagrange 
multiplier,  and  <q,p>  the  scalar  product  in  L2(]tl,t2[x]0,pmaxD- 
The  optimality  conditions  for  (P)  give : 

— z=0forallz,  (9) 

3y 


or 


3F*  3J  L  J 

<  —  p,  z  >  =  -  —  z  which  determines  p,  and  the  gradient 

ay  dy 


dJ 

du 


3L  DJ  3F 
3u  Du+  3u’P> 


(10) 


After  a  linearization  with  respect  to  u  and  y  of  F,  in  the  same  way 
the  cost  function  J  becomes  quadratic,  and  we  finally  derive  a 
discrete  formulation  using  the  finite  element  method.  The  problem  is 
then  solved  by  a  conjugate  gradient  algorithm  at  each  iteration  of  the 
Newton  procedure. 
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Abstract  -  We  investigate  numerically  the  nonlinearly  saturated 
singlc-hclicity  tearing  instability  of  a  visco-resisdve  current-cariying 
plane  plasma  slab  using  a  2D  spectral  code.  The  ratio  of-viscosity  to 
resistivity  is  fixed  ty/p  -  0.2).  The  equilibrium  state  depends  on  the 
x-coordinate  only,  perturbations  are  supposed  to  be  periodic  in  the 
y-direction  (period  L)  and  independent  of  the  z-direction.  The 
Lundquist  number  S  is  chosen  as  bifurcation  parameter,  and  we 
investigate  solutions  with  different  fixed  values  of  the  period  L  by 
varying  S. 

Choosing  a  sufficiently  low  value  of  L  (L  =  L0),  the  first  branch  of 
the  set  of  solunons  bifurcating  from  the  given  static  equilibrium  is 
numerically  found  to  be  stable  up  to  high  values  of  the  bifurcation 
parameter  (  S  =  106 ).  Passing  to  a  new  value  L  =  2L0  ,  that  same 
branch  presents  a  symmetry  breaking.  For  a  period  L  =  4Lq,  that 
branch  becomes  unstable  but  a  lower  branch  is  found  stable. 
Moreover,  depending  on  the  choice  of  the  initial  conditions,  the 
evolution  code  may  yield  spatially  very  complicated  transient  states. 


I.  THE  2D  TEARING  INSTABILITY 


We  briefly  recall  here  the  physical  and  mathemaucal  model  [1  J,[2]. 
Let  Q  =  J-i/2 ,  +l/2[  x  J9,L[  be  an  open  set  in  IR2.  The 


unknowns  y,  b>  to  obey  the  following  equations: 

X  "  +  S(V-VV  +  V*^r)  =  0 


A(>  =  © 


dco 

"5T  “ 


-Aco  +  S  ( 


where  %  =  Aijr,  and  Ycq  is  a  given  static  equilibrium  magnetic 
flux  such  that 

Ycq  (x)  =  -(l/a)log{ch(ax)}. 

v  and  T]  arc  the  (constant)  viscosity  and  resistivity,  respectively 
(v/q  =  0.2),  and  S  is  the  Lundquist  number  (bifurcation 
parameter). 


The  velocity  and  the  magnetic  field  are  related  to  b  and  \jr  as 
follows: 

V  =  V<>  x  ez  ,  B  =  V\jr  x  ez 

We  choose  periodic  boundary  conditions  in  the  y  direction 
(sometimes  imposing  an  additional  symmetry)  and  take 
<|>  =  Ab  =  \jr  =  0  at  x=±l. 

For  the  numerical  calculations,  X  -is  also  an  unknown  of  the 
problem,  with  %  =  0  at  x  =  ±l. 

As  already  proved  [2],  we  can  mathematically  justify  the  existence 
of  bifurcation,  making  use  of  compact  operators. 

The  equilibrium  magnetic  field  corresponding  to  the  flux  function 
ycq,  given  above,  is  parallel  to  the  y  axis  and  changes  sign  at  x  =  0. 
When  the  instability  sets  in,  a  magnetic  island  appears  (see  the 
representations  of  curves  H»(x,y)  =  constant  in  the  figure). 

For  the  problem  of  linear  stability  of  the  equilibrium  we  look  for 
solutions  expanded  in  Fourier  scries. 

exp(cot  +  imky )  with  me  IN  (1) 

k  =  2rt/L  (or  jt/L  if  we  impose  symmetries  in  the  y-direction). 

A  pseudo-spectral  code  is  used  to  solve  our  equations,  with 
Fourier-Galerkin  decomposition  in  y,  and  Chebyshev-tau 
approximation  in  x,  together  with  implicit  or  semi-implicit 
discretization  schemes  in  time.  We  also  impose  symmetries  in  the 
two  directions  x  and  y. 

n.  BRANCHES  OF  STATIONARY  SOLUTIONS 

II.  1.  Structure  of  the  stationary  solutions 
We  consider  three  different  values  of  the  parameter  k ,  namely : 
k  =  2.5,  k  =  1.25,  k  =  0.625,  corresponding  respectively  to 
lengths  L ,  2L ,  4L  in  the  y-direction. 

To  each  number  m  of  formula  (1)  we  associate  a  value  S(m)of 
the  parameter  S  ,  which  corresponds  to  a  bifurcation  point  where  a 
branch  of  nonlinear  stationary  solutions  (labelled  as  "branch  m" ) 
bifurcates  from  the  equilibrium. 
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Our-main  results- are  represented  in  the  figure  and  may  be 
summarized  as  follows: 

For  the  length  Lo  (k  =  2.5),  the  branch  1  has  been  found  to  be 
numerically  stable.  Taking  into  account  the  imposed  symmetries  , 
our  computation  yields  only  a  part  of  the  magnetic  island  as  shown 
schematically  at  the  bottom  of  the  figure  (the  lines  inside  each  box 
represent  the  separatrix  of  the  magnetic  field  configuration). 

The  branch  2  for  length  2Lo  (obtained  by  symmetry  in  the  y- 
direction  from  the  branch  1  corresponding  to  length  Lo  )  is  again 
numerically  stable,  but  it  exhibits  a  symmetry  breaking. 

For  length  4Lo  ,  the  branch  3  (obtained  by  symmetry  from  the 
branch  2  corresponding  to  length;  2Lo)  is  now  found  to  be 
numerically  unstable,  with  solutions  converging  in  time  towards  the 
(stable)  solution  of  the  branch  2  of  length  4Lo. 

11.2.  Sensitivity  to  initial  conditions 

Choosing  some  initial  conditions  in  the  vicinity  of  a  stationary  stable 
solution,  we  have  sometimes  observed  periodic  oscillations  in  time, 
with:a  very  slowly  decreasing  amplitude.  Moreover,  if  we  start 
away.from  a  given  stationary  stable  solution,  the  evolution  of  the 
system  presents  numerically  certain  spatially  very  complicated 
transient  states.  These  phenomena  will  be  investigated  in  later 
work. 
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Abstract 

The  Reissner-Mindlin  model  describes  the  deformation  of  a 
plate  subject  to  a  transverse  loading  in  terms  of  the  normal 
displacement  of  the  midplane  and  the  rotation  of  the  fibers 
normal  to  the  midplane.  T  e  model  is  widely  used  Tor  plates 
of  small  to  moderate  thickness. 

It  is  well  known  that  the  numerical  approximation  of  the 
Reissner-Mindlin  plate  with  standard  low  degree  finite  elements 
leads  to  solutions  that  are  very  sensitive  to  the  plate  thickness. 
For  small  thickness  the  numerical  solution  is  very  farfrom  the 
exact  one.  The  phenomenon  is  referred  to  as  locking.  Several 
non-standard  finite  element  spaces  and  techniques  have  been 
devised  to  overcome  such  a  difficulty.  We  recall,  among  oth¬ 
ers, -reduced  and  selective  integration,  interpolation  and  projec¬ 
tion  techniques  combined  with  non-classical  formulations  like 
mixed  or  hybrid  approaches.  As  far  as  we  know  onjy  low  or¬ 
der  element,  generally  with  degree  1  or  2,  have  ben  tested  for 
Reissner-Mindlin  plates,  both  for  standard  and  non-standard 
formulations. 

In  recent  years  high  order  finite  elements,  known  as  p  finite  ele¬ 
ments,  have  been  introduced  and  succcsfujly  applied  in  several 
fields,  e.g.,  for  elasticity  and  Kirchhoff  plate  problems.  High 
order  elements  havevshown  to  be  robust  and  able  to  absorb 
locking  phenomena  in  the  case  of  nearly  incompressible  mate¬ 
rials.  In  this  note  we  present  some  numerical  results  obtained 
with  a  family  of  hierarchic  finite  elements  with  degree  from  1 
to  4  for  the  solution  of  Reissner-Mindlin  plates  in  the  standard 
formulation.  We  show  that  the  locking  of  the  solution  docs  not 
appear  when  high  order  elements  are  used. 

1.  Derivation  of  the  Reissner-Mindlin  model 

Let  us  consider  a  three-dimensional  body  occupying  a  region 
V.  We  assume  that  the  body  under  consideration  is  isotropic. 
The  potential  (or  strain)  energy  per  unit  volume  is  given  by 

W  =~x(exs  +  evy  + 

+**(eL  +  elv  +  e«  x  2ev*  +  2esx  +  2eiy) 
where  exx,c.,u,elx,eVI,exx,exy  are  the  components  of  strain 
and  A  and  p  arc  the  Lame  coefficients,  constant  characteriz¬ 
ing  the  clastic  behaviour  of  the  body.  The  coefficients  can  be 
expressed  in  terms  of  the  modulus  of  elasticity  E  and  the  Pois¬ 
son’s  ratio  v. 


~  (1  +  i/)(1-2j/) 

-  E 

**  “  2(1  +  u) 

The  components  of  stress  at  a  given  point  are  linear  and  ho¬ 
mogeneous  functions  of  the  components  of  strain  at  the  same 
point  and  viceversa  (see,  e.g.,  (5)).  Denoting  by  u,v,w  the  com¬ 
ponents  of  displacement  we  have  the  relations  between  strain 
and  displacement: 


du 


_  1  /3u  3u\ 

C‘v  ~  2  \dx  +  !hj) 


In  the  Reissner-Mindlin  theory  two  new  fields  <j>i  and  ^  are 
introduced.  These  fields  represent  the  rotation  of  the  cross- 
sectional  planes  to  which,  respectively,  the  a>axis  and  y-axis  is 
normal: 

u  =  -2^,(s,y) 
v  =  -z<h(z,y) 
w  =  w(x,y) 

Through  the  Reissner-Mindlin  hypotheses  the  total  strain  en¬ 
ergy  becomes: 

Et?  f  / 

=  » 12(1  — j/2)  Jn  \fit*  +  +  2«^i/**/» 

+  — /v  +  &/*)2)  dxdy 

+  »  Wh)  L  ((t0/l  "  + "  *»>*)  dxd’J 

where  k  is  the  shear  correction  factor. 

Taking  into  account  the  external  load  p  we  get  the  follow¬ 
ing  variational  formulation  for  the  Rcissncr-Mindiin  model  for 
plates: 
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=  12 (fb»)  fa  (<*>l/x'*’l/x  +  fe/v^/v 

+  V  (^X/x02/ll  +  ^2/y^l/x) 

+  ~~2~~(^i/y  +  4>2/x)('I>i/v  +  ^2/*))  dxdy 

+wk 7)J0(fa-'’i*)to-vl*y 

+  {4>2  -  “>/y)(^2  ~  «y))  dxdy  -  J  pv  dxdy 

Setting  ij>  =  (^1,^2)  the  previous  problem  can  be  stated  in  the 
following,  way: 

Find  (<ii,u/)  e  (//,}) 2  x  2#  such  that 
_£t3  ,  7,  Etk  ,  , 

'  12(1- ^A^)+ i(TMli  _?,|lo  =  M 

.  V(^u).€.(#o1)2  x  Bh 

where 

A(.£,$):=  (d’l/x’Pl/x  +  fa/yfa/u 

+  V  [tl/xfolv  +  fa/ytl /*) 

'J  —  (/  \ 

+  — 2~ (&/v  +  ^2/x)(t^i/y  +  &/*)J  dxdy. 


ible  materials  (see  [4]).  In  this  whay  we  present  some  numerical 
results  obtained  with  a  family  of  hierarchic  finite  elements  for 
the  Reissner-Mindlin  plate  in  the  standard  formulation.  Hier¬ 
archy  of  finite  elements  means  that  shape  functions  are  added 
to  increase  the  degree  of  approximation,  leaving  unchanged  the 
previous  functions.  The  functions  usedare  based  on  the  family 
of  Legendre  polynomials.  This  class  presents  good  properties 
from  the  point  of  view  of  roundoff  error  accumulation  whith 
respect- to  the  increase  of  the  polynomial  degree.  The  family 
consists  of  finite  elements  of  degree  from  1  to  4. 

Referring  to  the  classification  of  the  shape  functions  suggested 
by  BabuSka  [l]  as  nodal,  side  and  internal  functions,  v/e  give  in 
Table  Tthe  number  of  sha,  e  functions  of  each  type  for  general 
value  of  the  degree  p. 


d. 

nodal  f. 

side  f. 

internal  f. 

total  ff  f. 

1 

4 

— 

- 

4 

2 

4 

4 

- 

8 

3 

4 

8 

- 

12 

4 

4 

12 

1 

17 

5 

4 

16 

3 

23 

6 

4 

20 

6 

30 

. 

. 

, 

. 

’ 

* 

• 

- 

' 

P 

4 

4(p~l) 

h(P~  2)* 

(P-3) 

4p 

+|(p-2)(p-3) 

Table  1:  Number  of  shape  functions  for  different  degrees 


2.  Numerical  approximation 

One  of  the  advantages  of  the  Reissner-Mindlin  approach  is  the 
fact  that  the  variational  formulation  allows  the  use  of  contin- 
uos  (C°)  finite  elements,  since  only  first  derivatives  appear.  We 
recall  that  in  the  Kirchhoff  model  conforming  approximations 
require  Cl  finite  elements.  It  is  well  known  that  the  numeri¬ 
cal  approximation  of  the  Reissner-Mindlin  plate  with  standard 
low  degree  finite  elements  leads  to  solutions  that  arc  very  sen¬ 
sitive  to  the  plate  thickness.  For  small  thickness  the  numeri¬ 
cal  solution  is  very  far  from  the  exact  one.  The  phenomenon 
is  referred  to  as  locking.  Several  non-standard  finite  clement 
spaces  and  techniques  have  been  devised  to  overcome  such  a 
difficulty.  We  recall,  among  others,  reduced  and  selective  inte¬ 
gration,  interpolation  and  projection  techniques  combined  with 
non-classical  formulations  like  mixed  or  hybrid  approaches.  As 
far  as  we  know  only  low  order  clement,  generally  with  degree 
1  or  2,  have  ben  tested  for  Reissner-Mindlin  plates,  both  for 
standard  and  non-standard  formulations. 

In  recent  years  high  order  finite  elements,  known  as  p  finite 
elements,  have  been  introduced  and  succcsfully  applied  in  sev¬ 
eral  fields,  c.g.,  for  elasticity  and  KirchhofT  plate  problems  (sec 
(1,2,3}).  High  order  elements  have  shown  to  be  robust  and  able 
to  absorb  locking  phenomena  in  the  :asc  of  nearly  incomprcss- 


We  have  written  a  code  where  shape  functions  with  degree  from 
1  to  4  are  used.  The  hierarchic  structure  of  the  functions  allows 
easy  extensions  to  higher  degrees. 

We  introduce  two  finite  dimensional  spaces  $  and  V,  respec¬ 
tively  for  the  discrete  rotations  and  displacement.  The  approx¬ 
imate  problem  can  be  stated  in  the  folk  wing  way: 


(Find  {<ph,  wh)  €  $  x  V  such  that 

El3  A(?,P)  i  r7^-ci!Vu,'‘  -  =  (P,vh) 


12(1 -1/*}“'’'  '  *  2(1  +  1/) 
(v(^/)e$xv 


where 


Meh,th)  = fj4l/A/x+$,A/„ 


+  +  $/*)(#/„  +  V2/J)  dxdy. 
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3.  Numerical  results 

A  series  of  numericalexperiments  on  several  plates  with  differ- 
ent  physical  data  has  been  performed.  Due  to  the  lack  of  space 
only  a  few  of  them  are  presented.  Comparison  are  made  with 
the  theoretical  results  computed  by  Timoshenko  [6j. 

For  each  test,  among  others,  displacement  at  the  center  C  of 
the  plate  and  the  strain  energy  have  been  computed.  Let  w(C) 
denote  the  exect  displacement  at  the  center  of  the  plate  and 
u>h{C)  the  finite  element  solution.  The  relative  displacement 
error  is  defined  as 

j.-*Sbss!Qxm 

w(C) 

The  exact  strain  energy  was  not  available.  Out  of  the  discrete 
strain  energy  an  extrapolation  has  been  made  in  order  to  get 
an  accurate  value  of  the  energy.  Let  £  denote  such  a  energy, 
let  Eh  be  the  discrete  energy.  The  relative  energy  norm  |Je||  of 
the  error  e  =  w  —  to/,  can  be  expressed  in  the  following  way: 


Q2-teO.pi 


We  consider  a  square  plate  with  uniform  decomposition.  On 
the  boundary  the  plate  is  clamped.  Due  to  the  simmetry  we 
have  solved  the  problem  on  a  quarter  of  plate.  We  have  consid¬ 
ered  a  unit  plate  with  thickness  0.1  (thick  plate),  0.01,  0.001, 
0.0001.  The  last  value  is  related  to  an  ultrathin  plate.  We  have 
considered  this  valuer,-,  order  to  assess  the  stabilit 
that  the  locking  is  larger  when  small  thicknesses  arc  taken  into 
account. 

In  Fig.la-d  we  consider  a  plate  with  thickness  t  =  0.01.  The 
relative  error  for  the  displacement  vs.  number  of  degrees  of 
freedom  is  shown.  The  results  arc  given  for  values  of  the  degree 
P  —  1,2,3, 4. 
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The  previous  results  are  related  to  a  moderately  thick  Dlalc. 
The  pictures  show  that  for  p  =  1  the  rate  of  convergence  is 
very  slow  and  the  solution  is  very  inaccurate.  The  numeri¬ 
cal  solution  exhibits  a  strong  locking.  For  p  =  2,3,4  we  note 
a  good  behaviour.  The  respective  displacement  solutions  ap¬ 
proach  the  exact  solution  with  a  relatively  small  number  of 
degrees  of  freedom.  As  expected,  the  better  convergence  is 
achieved  for  increasing  values  of  p. 


relative  energy  error  relative  energy  error  relative  energy 


In-Fig.2a-d  we  consider  a  plate  with  thickness  0.001.  We  show, 
in- log-log  scale,  the  relative  energy  norm  error  vs.  number 
ofdegrees  of  freedom.  The  results  are  given  for  values  of  the 
degree  p  =  1,2, 3, 4. 
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In  the  previous  pictures  a  thin  plate  is  considered.  The  dis¬ 
crete  strain  energy  is  a  good  global  indicator  since  it  takes  into 
account  a  distributed  solution.  For  p  =  1  we  observe  no  conver¬ 
gence.  The  behaviour  is  far  worst  than  the  case  with  thickness 
t  =  0.01. 

In  Fig.3a-d  we  consider,  for  a  fixed  degree  of  approximation 
p  =  2,  different  values  of  the  thickness.  We  show,  in  log-log 
scale,  the  relative  error  for  the  displacement  vs.  number  of 
degrees  of  freedom,  freedom. 
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In  the  previous  pictures  we  consider  the  numerical  approxima- 
tion  with  fixed  degree  p  =  2  and  we  change  the  value  of  thick¬ 
ness.  The  sequence  of  figures  well  shows  that  the  convergence 
slows  down  noticeably  when  the  thickness  is  reduced.  The  log- 
leg  scales  allow  to  evaluate  the  different  rates  of  convergence 
(note  the  different  scaleson  the  y-axis).  In  particular,  for  the 
smaller  thickness,  the  locking  of  the  numerical  solution  is  well 
exhibited. 


Q4  -i=0.1  (thick  pUK) 


In  Fig.4a-d  we  consider,  for  a  fixed  degree  of  approximation 
p  =  4,  different  values  of  the  thickness.  We  show,  in  log-log 
scale,  the  relative  error  for  the  displacement  vs.  number  of 
degrees  of  freedom,  freedom. 


We  now  consider  a  fixed  degree  p  =  4  and  we  changcthe  thick¬ 
ness.  We  observe  that,  with  such  an  high  order  element,  con¬ 
vergence  is  achieved  even  for  the  smaller  value  of  thickness 
l  =  0.0001  This  shows  that  the  high  order  element  is  able  to  to 
absorb  the  phenomenon  of  locking  found  for  lower  degrees  (sec 
Fig.3a-d). 
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VISUALIZATION  OF  ELASTIC  WAVE 


YANZHAO 

Dept,  of  computer  science 
Arizona  State  University 
Tempo,  AZ  85287 

Abstract  A  finite  difference  method  is  used  to  solve  the  system  of  2-D  elasuc 
wave  equations.  The  solution  is  expressed  as  the  displacement  of  a  particle  from  its 
original  position.  By  means  of  computer  graphics  we  describe  the  solution  as  a  3- 
D  wave  surface,  and  describe  its  propogation  by  real  time  animation.  In  this  way, 
we  can  observe  the  phenomena  described  by  the  system  of  equations  more  easily 
and  in  a  much  more  obvious  fashion  than  with  convenuonal  methods.  Here,  we 
use  an  explicit  method  to  solve  the  equations  in  time,  this  makes  real  time 
calculation,  modeling  and  rendering  possible.  The  algorithm  has  been  implemented 
on  an  Iris-4D  personal  graphics  workstation. 


1.  Introduction 

Computer  graphics  provides  an  excellent  means  for  exploring  the  clastic 
waves  visually.  Hero  we  shall  give  an  experimental  procedure  for  modeling  and 
rendering  the  clastic  wave  and  its  propogation  in  real  lime.  To  make  things  easier 
for  demonstration  we  choose  some  typical  parameters  for  the  wave  equation.  That 
will  not  have  any  influence  on  the  method  to  express  the  solutions. 

Mainly,  we  discuss  solutions  obtained  from  second  order  finite  differences. 
We  suppose  that  at  begining  the  wave  surface  looks  like  a  plane,  nothing  happens 
until  an  external  body  force  is  applied.  The  external  body  force  car  act  at  any  time, 
last  any  period  and  be  at  any  place.  The  source  function  can  be  given  in  any  form 
you  want  We  suppose  two  kinds  of  boundary  conditions  .  1>  a  free  boundary 
condiUon,  a  fixed  boundary  condiuon. 


2.  2-D  elastic  wave  equations 

The  equation  is  written  as  a  system  of  second  order  wave  equations  for 
the  displacement  vector  U(x,t)  =  lUlx.iy,  Vyt.iy),  see  U  J.  Here  Uix.y  describes  the 
horizontal  displacement .  V(x,t)  the  vertical  displacement,  and  x=(x,  y)  within  die 
domain  of  interest 

PUU  =  [c(Ux  +  Vy)  +  2wUx]x  +  [w(Uy  +  Vx)]y  +  pfl 

PV([  =  (w(Uy  +  Vx))x  +  [c(Ux  +  Vy)  +  2wVy]y  +  pf2  (  1  ) 

The  Lame  parameters  c=ctxy  and  w=w(x )  as  well  as  the  density  p=pw 
can  varyin  space.  The  external  body  forces  arc  denoted  bydic  source  funcUons 

fl(x,t)  and  f2(x,t).  If  we  substitute 

f=c(Ux+Vy)  +  2wUx 

g  =  w(Uy+Vx)  (2) 

h  =  c(Ux+Vv)  +  2wVy, 

the  cquau'ons  can  be  written  as 

put  =  fx  +  gy  +  pfl 
pvl  =  gx  +  hy  +  pf2 

f(  =  (c+2w)ux  +  cvy  ( 3  ) 

gt  =  W(Vx+Uy) 

ht  =  cur  +  (c+2w)u  . 

In  these  cquau'ons,  (u.v)  =  (Ut.Vt)  represents  the  velocity  of  the  material  panicles. 


Let 


3i  Finite-difference  method 

Here  we  use  the  2nd  order  approximauon  for  the  first  denvauves. 

u'(Xq)  =  [  u(x0+h)  -  u(xQ-h)  ]  /  2h  ( 4  ) 

ulm  =  u  ( 1  Ax,  m  Ay,  n  At ),  Ax  =  Ay  =  h.  At  =  k,  r  =  k/ii 
0  <  I  <  L,  0  <  m  <  M,  •  >  0 . 
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Then  (3)  can  be  expressed  as  an  explicit  system 
C  =  <  +  W»£l  m  -  Cl  m  +  $*+.  -  S?m.l  1  +  2k 

C  =  <  *  m -  C,  m  +  hL+l  -  *W.  1  +  2k  ¥"k> 
C  =  C  +  r  (e+2w)K+l  m  '  U"l  +  r  e  ^m+1  '  ^ m.l> 

Sim  =  S?m  +  w  r  f^i  m  ’  ^-1  m  +  U?m+1  '  ^  nJ 

hIm  =  hIm  +  e  r  Kl  m  '  “?-l  +  (e+2wXv? m+t  *  ^  m-l^  (  5  ) 

Using  the  Trapezoidal  rule,  we  get  the  displacement  U  and  V  as 

Ulm  =Ulm  +  0'5kKm  +  «£> 

C=VL+0-5k<  +  V?m)  (6) 

Here  we  should  observe  that  the  soluuon  points  of  all  the  functions  L\ 
V,  u,  v,  t,  g,  h  arc  uncoupled  in  space  domain,  but  using  this  method  they  can  be 
divided  into  two  coupled  sets  of  points.  This  means  that  the  soluuon  for  each 
tuncuon  has  been  separated  into  two  independent  groups  along  each  axis,  the  group 
of  even  points  and  the  group  of  odd  points.  The  value  at  one  even  point  only 
altccts  other  even  points.  The  value  at  one  odd  point  only  affects  other  odd  points 
For  the  propagation  of  the  wave,  this  phenomenon  means  that  if  an  external  body 
force  acts  at  an  even  point  it  will  only  propagate  among  the  even  points.  Equation 
(5)  and  Diagram  1  can  explain  why  this  happens  to  u  and  v.  The  equations  for  u 
and  v  given  by  (5)  m  the  x  direction  arc  considered  here.  We  suppose  that  the  u 
wave  begins  at  ulm  and  the  v  wave  begins  at  vlm  ,  then  they  affect  fj+i  m  .  fj.j  m 

■  8l+l  m  ■  81-1  m  ■  hl+l  m  •  hl-l  m  al  lhc  nMl  *‘mc  stcP  After  two  limc  ?,CPS 
the  waves  only  propagate  to  u,m  ,  u1+2  m  ,  u,.2  m  and  vlm  ,  v1+2  m  ,  v,.2  m  . 
nothing  will  be  affected  at  uj+j  m.  uj.j  m  and  vi+1  m,  vj.j  m.  From  equation  (6). 
we  see  that  functions  U  and  V  arc  the  ODE  soluuons  of  the  function  u  and  v  in 
time,  and  thus  this  uncoupled  property  is  also  observed  in  U  and  V.  However,  we 
car,  aiill  use  these  kind  of  soluu'ons  to  demonstrate  our  visualization  technique  by 
taking  only  the  even  points  or  only  the  odd  points,  depending  on  where  the 
external  body  force  acts.  But  observe  thet  because  of  this  uncoupling,  the  Couranl 
Friedrichs  Lewy  condition  is  not  satisfied  and  thus  these  solution  arc  not  trucly 
physical  [3J.  We  will  discuss  this  in  more  detail  in  a  later  paper. 
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Diagram  I 


If  a  higher  accuracy  dulutiun  ,s  desired,  an  approximation  fot  the  first 
derivative  of  order  4  can  be  used,  see  (2).  The  formula  is  given  by 
«-(x0)=[.(l/<j)u(x0+2h)+(4/3)u(x0+h).(4/3)u(x0-h)+(I/6)u(x0-2h)jy2h  (  7 ) 

This  will  exhibit  almost  the  same  uncoupled  properties  as  formula  (5). 

Initial  values  and  boundary  conditions  can  be  chosen  as  desired.  Here, 
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initial  values  are  chosen  as  zero.  Two  kinds  of  boundary  conditions  arc  chosen 
here.  One  is  the  free  boundary  condition,  or  zero  Neumann  boundary  condition.  The 
other  the  fixed  boundary  condition,  the  usual  zero  Dinchlct  boundary  wn  f  non. 
Initial  values: 

At  t=0  and  t=k :  U=V=u=y=f=g=h=0.  ( 8 ) 

Boundary  conditions: 

A.  Free  boundary: 
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B.  Fixed  boundary: 
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4.  Parameter  selection 


\  fyTV'T.  |  '"|  Rp-  IV  K  TV 

A,P_ ^  _\  s  V 

v  V  v  \  \  \  \  \ 

_AA,7__  \  \  \  \  \ 

I  \|>*  _  VJ  ■■  '•J  ■>!  4 

Fig-  1  Fig,  2 

Tlic  triangulaied  surface  is  then  obtained  by  jo.  ring  one  pair  of  diagonal 
points  for  each  square  of  the  solution  mesh.  This  is  show  •  m  figure  2.  Phong’s 
lighting  model  is  used  for  getting  color  at  each  vertex  of  t\  jlution  mesh  and 
Gouraud  shading  is  used  for  each  triangular  patch  rendering  on  the  suf-.cc.  The 
double  buffer  is  used  for  rendering,  for  a  better  results  in  continuous  char 

Because  we  use  an  explicit  method  for  the  time  variable  t,  the  time 
spent  for  dealing  with  the  equations  allows  for  real  time  animation. 

6.  Example 

The  area  of  interest  chosen  here  is  0  <  x  <  1,  0  <  y  <  1,  so  that  Mh  = 
Lh  =1,  and  t>0.  Chose  M  =  L  =  20,  h  =  0.05,  k  =  0.008,  x0  =  y0  =  0.1,ts  =  0.2. 

Fixed  boundary  conoilion  (10)  and  external  body  force  function  (11)  are  used. 
Pictures  1  -  8  show  the  vertical  displacement  function  V(x.  t)  at  die  times  for  n  = 
16,  48, 64,  80,  112,  160,  192, 256.  Here  we  see  that  the  wave  begins  from  the 
lower  left  comer  and  propagates  towards  die  upper  right  vomer. 

7.  Conclusion 

We  have  shown  a  way  to  visualize  clasdc  wave  propogation  with  real 
time  animation  by  means  of  computer  graphics.  This  improves  interpretation  of 
the  numerical  results.  We  can  use  this  method  to  show  how  the  different  media  or 
different  external  forces  aftcct  on  the  clastic  waves  and  how  clastic  waves 
propogatc,  as  well  as  how  different  parameters,  boundary  conditions  or  initial 
conditions  affect  the  solutions. 


Actually,  we  can  s..,cct  any  parameter,  source  function  and  area  of 
interest  that  we  wish  to  obscivc.  As  some  simple  examples,  the  parameters  arc 
selected  as  p(x,y)  =  c(r,y)  =••  w(x,y)  =  1  .The  external  body  force  is  selected  as 
[>  2> 
fl  =  fl  =  -  V  8(y  -  y0)  s,(t) , 

f2  =  5(x-  x0)  8(y  -  y0)  S,(t) .  i~2  =  5(x  -  xQ)  5(y  -  yQ)  S2(t) . 

(11)  (12) 
Here 

S,  (t)=  fAs,n(-4r^  0<t  •  '*<'5  s  /Aoos(4ni)  0<t  -  t^t, 

l°  's<t  2  *0  ,<t 

»  » 

5.  Rendering 

From  the  solution  of  the  above  difference  cquau'on  system,  we  can  get 
the  discretized  points  of  the  wave  surfaces  described  by  U(lh,mh,nkj  and 
V(lh,mh,nk).  Also,  we  can  get  the  solution  of  the  surfaces  described  by  the  speed 
functions  u(!h,mh,nk)  and  v  (Ih.mk.nky.  As  the  solutions  arc  uncoupled,  along  each 
axis,  we  take  only  the  even  points  or  only  the  odd  points  to  form  each  solution 
mesh,  depending  on  whether  the  external  body  forces  act  at  an  even  point  or  an  odd 
point. 

For  surface  rendering,  we  should  first  get  the  normal  for  each  vertex  of 
the  solution  mesh.  This  can  be  done  by  taking  the  average  of  the  normals  on  the 
four  neighbouring  triangular  patches,  as  the  normal  for  each  neighbouring 
triangular  patch  can  be  easily  oblainc  J.  This  is  shown  in  figure  I . 
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MODELLING  AND  SIMULATION  APPROACH  TO  STRUCTURAL 
REARRANGEMENT  OF  DISTILLATION  COLUMN 

M.Atanasijevid,  R.Karba,  B.ZupanCiC,  F.BremSak 
FacuRy  of  Electrical  and  Computer  Engineering 
TrzaSka  25,  C1000  Ljubljana,  Yugoslavia 


ABSTRACT  -  The  paper  deals  with  mathematical 
modelling  of  industrial  continous  distillation  column  for 
separation  of  four  -  component  mixture  composed  of  furfural, 
methanol,  acetic  acid  and  water.  The  aim  of  the  work  is 
optimisation  of  existing  device  in  the  sence  of  product  quality 
improvement  and  minimisation  of  energy  consumption.  The 
model  was  examined  by  the  aid  of  digital  simulation  language 
SIMCOS.  Presented  results  show  that  the  best  solution  lies  in 
construction  change  which  have  good  influence  especially  to  the 
bottom  product  and  so  to  the  energy  consumption  of  the  device. 


1.  Plant  description 


Presently  the  input  mixture  is  fed  to  the  device  at  the 

25^  tray  and  futfural  is  taken  out  at  the  28th  tray  as  a  side 
stream  product.  The  second  product  is  methanol  which  is 
separated  in  the  upper  part  of  the  column.  As  it  is  shown  in 
Figured,  furfural  mixture  is  kept  in  separating  reservoir  leaving 
the  device  with  flow  rate  D^.  Furfural  is  heterogeneous 
azeotrope.  In  mentioned  reservoir  it  separates  to  heavier 
component,  which  leaves  the  system  with  flow  0  and  represents 
one  of  the  final  products  while  lighter  component  is  taken  to  the 
bottom  reservoir  where  it  mixes  with  the  industry  environment 
flow.  The  energy  needed  for  the  operation  of  the  column  is 
supplied  in  the  form  of  water  vapor  flow  G  at  the  bottom  of  the 
device. 

2.  Mathematical  modelling  and  simulation  of  existing 
device 


It  is  obvious  that  the  most  important  variables  of  the 
system  are  input  and  output  flow  rates  and  their  compositions. 
So  we  started  modelling  procedure  by  writing  component  and 
mass  balances  for  each  tray  of  the  column  ( for  the  simplicity  of 

notation  the  condenser  is  numbered  as  the  441*1  plate ): 


d(  x  (t)m  (t)) 

jt  — wV.w-V%(llt 

V‘>Wl)  ■  w + 

L  .  ,(t)x  .  ..(t)  -  L  .(0-x  „(t)  + 
V  .  ,(t)y  .  „(t)  -  V  ,(t)y  (t) 

Si.j  Si.JI  SO’J  SOU* 

j  =  1 , ...  ,44;  i  =  I,  —  ,4; 


where  L_(t)  and  V^(t)  denotes  the  liquid  and  vapor  flow  rates 
from  the  j-th  tray,  x,,(t)  the  liquid  composition  of  i-th 


component  on  j-th  tray  and  y..(t)  the  vapor  composition  of 
i-th  component  upon  j  th  trayf  L  (t),  L  (t),  V  (t)  and 

, ,  ,  ,  .  .  SI.J  SOij  silj 

so,jvl>  Ate  lr‘Pu^  an“  output  liquid  and  vapor  flow  rate,  on 

j-th  tray  with  compositions  x  ,  ft),  x  (t),  y  (t)  and 

si>J*  so.jp  ■'si.jP  ' 

^so.jP  '' 

A  lot  of  methods  can  be  used  to  describe  the  relationship 
between  liquid  and  vapor  compositions  of  mixture  at  defined 
pressure  and  temperature.  Especially  in  the  absence  of  reliable 
vapor -liquid,  equilibrium  data  the  following  equations  are  very 
popular  in  chemical  engineering: 


yji{t)  =  IWt);  j=I*- 

i  =  1 . .4 


where  K  is  distribution  coefficient  of  f  -th  component  at  j-th 
tray- of.  tile  col.-mn. 


The  analysis  of  measured  data  and  simulation  results, 
which  we  obtained  by  the  aid  of  digital  simulation  language 
SIMCOS,  gave  the  following  conclusions: 


-  Concentration  of  methanol  in  the  flow  rate  DM  i  •  higher  than 
the  prescribed  value  so  the  G  could  be  reduced. 


-  Concentration  of  furfural  in  the  flow  rate  D^  is  inside  the 
prescribed  values. 


-  Concentration  of  furfural  in  bottom  flow  B  is  too  high  thus 
demanding  the  vapor  flow  rate  G  to  be  enlarged  for  10  to  15%. 
( Normal  value:  of  furfural  concentration  in  bottom  product 
were  approximately  0.17%.  Due  tc  more  rigorous  ecological 
demands  this  values  have  to  be  reduced  to  0.05  -0.1%. 


Simulation  results  and  experiments  on  the  plant  have  shown 
that  for  such  improvement  vapor  flow  rate  G  should  be  enlarged 
for  10  to  15%. ) 


Figure  1.  Schematic  representation  of  discussed  distillation 
column. 
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These  conclusions  indicate  that  vapor  flow  rate  G  should 
be  enlarged-because  of  ecological  demands  meaning  that  energy 
consumption  will  of  course  be  also  greater.  Nothing  really 
effective  couldsbe  therefore  made  with- this  column  structure. 


JjPjQ  rr?n  igsd  ci-F3  n»wsi  ran  ivn  p.«-n 

ii* _  _ _ 

r 

U-o 

L*' 

M»- 

1.00 

4M 

—  —  C _ 

*.»*  '  ~  -  -  _ 

*  **”  **a  *■”-  ■  *>  i-«o  !■«>  x«o  «.«■ 

Figure  2.  Input  inj  output  fun  rates  of  tin.  ilcutc. 


Figure  3-a.  Concentration  of  furfural  at  the  Ist,  G11'  and 
7t!’  tray. 


3.  Structural  rearrangement  of  distillation  column 

In  the  second  step  of  modelling  we  decided  to  examine 
some  possibilities;^  structural  rearrangement  of  the  device.  The 
best  result  in  this  phase  was  given  by  the  solution  in  Figure  1. 
The  column  is  now  fed  back  with  the  lighter  furfural  component 

from  the  separation  reservoir  on  the  26th  tray.  This  of  course 
changed  mass  balances  of  26in  tray  and  reservoir  in  which  4>. 

ind 

is  entering.  The  concequence  is,  that  also  feed  flow  rate  F  and 
its  concentration  is  changed.  The  steady  state  values  of  this 
changes  can  be  evaluated  from  previous  equations. 

The  simulation  was  made  for  changed  working  conditios  of 
the  plant  and  results  are  shown  in  Figures  2  to  4  for  input  and 
output  folw  fates,  furfural  and  methanol.  From  this  we  can  see 
that  the  steady  state  composition  of  all  trays  in  the  column  are 
changed  and  that  this  rearrangement  caused  the  lowering  of 
concentrations  of  furfural  in  the  bottom  flow  B  to  the  prescribed 
values,  leaving  the  other  requirements  fulfilled. 

4.  Conclusion 

Experiments  on  the  plant  showed  that  the  proposed 
assumptions  were  justified.  We  also  assume  that  the  model 
could  benefit  with  the  introduction  of  nonconstant  distribution 
coefficients,  what  will  be  needed  in  later  work  for  the 
improvement  of  the  existing  control  loops.  Digital  simulation 
language  S1MC0S  we  used  was  very  efficient  tool  for  solving 
complex  mathematical  models  with  a  large  number  of  variables, 
nonlinearities  and  measured  data  and  saved  a  lot  of  time  and 
work  on  the  real  device. 
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ABSTRACT — In  this  paper,  a  material-nonlinear  finite 
cilement  program  of  the  quasi-three  dimension  problem 
developed  by  authors  of  this  paper  is. described  from 
a  few  respects.  Further,  it  is  illustrated  how  this 
program  is  used  to  analyze  plane  problems.  Finally, 
a  finite  element  analysis  of  the  process  of  slow 
crack  growth  is  made  for  a  center-cracked  specimen 
subjected  to  monotonically  increased  load  until  the 
point  of  fast  fracture  is  reached.  Numerical  results 
and  experimental  results  are  compared. Variation  laws 
of  some  fracture  mechanics  parameters  are  given  with 
the  stable  crack  growth. 

I  .  INTRODUCTION 

In  a  cracked  body  with  toughened  materials  or  in 
the  plane -stress  state,  the  crack  will  grow  with  mo¬ 
noton;  ally  and  slowly  increased  load  before  the 
fast  fracture  is  reached. Many  scholars  attracted 
their  attention  to  it  .They  have  done  a  lot  for  it11*71. 

Experiments[8,9]  showed  that  there  is  the  stable 
delamination  crack  growth  in  some  stacking  sequence 
composite  laminates.  MahishillO]  ever  pointed  out 
that  while  considerable  progress  has  been  made  in 
understanding  the  delamination  mechanisms  in 
composites  incorporating  brittle  or  quasi-brittlc 
matrix  materials, the  problem  of  toughened  polycr  ma¬ 
trix  or  metal  matrix  composite,  in  which  large  scale 
yielding  is  associated  with  the  cracking,  requires 
special  attention. 

In  view  of  these,  a  material-nonlinear  finite  cle¬ 
ment  program  of  the  quasi-three  dimension  problem 
was  recently  developed  by  the  authors  CllJ.  Using 
this  program,  not  only  the  nonlinear  stress  analyses, 
the  delamination  onset  and  the  stable  dclamination 
crack  growth  for  composite  laminates  but  the  nonli¬ 
near  finite  element  analysis  of  stable  crack  growth 
process  for  plane  cracked  body  are  made.  Here,  the 
program  is  described  from  a  few  respects  and  a  finite 
element  analysis  for  a  center-cracked  specimen  sub¬ 
jected  to  monotonically  and  slowly  increased  load 
until  the  point  of  fracture  is  reached  is  taken  for 
example  to  check  it.  Finally,  the  variation  laws  of 
some  fracture  mechanics  parameters  are  given  with 
the  stable  crack  growth. 

II  .  DESCRIPTIONS  OF  PROGRAM 

Here,  a  material  nonlinear  finite-clement  program 
[11]  of  the  quasi  three  dimension  problem  developed 
by  the  authors  will  be  described  from  a  few 
respects. 

A.  GEOMETRICAL  DESCRIPTION 


rield  expressions  are  listed  as  fo'lows(13]- 
u=e0xtU(y,z) 

v=V(y,z)  (2-1) 

w=W(y,z) 

where  e,  is  uniform  action  strain  in  the  direction 
of  x. 

Strain-displacement  relations  are 

c  i  -  ii,,  ,  c  y— v,y  ,  e  I=w,j  (2— 2) 

Y»i=v.2+w.y,  Y„K  =  w.x+>J.i  '  Yn-«.y+v.i 

It  can  be  seen  that  the  strains  corresponding  to 
displacement  expressions  (2-1)  can  be  ciassfied  into 
two  parts, one  part  not  depending  on  the  coordinates, 
the  other  depending  on  the  coordtnates,  i.e. 

[  e  ).=  [e„  0  0  0  0  O]1  (2-3) 

[E]i=[0  Cy  e,  y  ,2  y«  Y  »rJ 

and  that  total  strains  are 

[e]=[e)o+[e  )i 

Awarding  to  the  displacement  finite  element  method, 
we  have 

U=£  NiUi  (2-4) 

V=£  N,V, 

W=£  NiW, 

where  Ni  are  interpolation  functions11*1,  Ui,Vj  and 
Wi  nodal  displacements 
Introducing  the  symbols: 

ti=ciM  fi=I,2,—  ,  5) 

then  the  following  results  can  be  obtained  from  for¬ 
mulas  (2-2)  and  (2-4): 


[  c  Jf=  1B)[  6  1*  (2-5) 


where  [5  J*  is  tho  clement  displacement  vector,  IB), 
for  a  triangle  element,  is  the  (5a 9)  strain  matrix 
whose  expression  is  deleted. 


B.  MATERIAL-NONLINEAR  FINITE  ELEMENT  EQUATIONS 


Here,  it  is  supposed  that  the  individual  lamina  oa' 
terial  in  composite  laminates  Is  homogeneous, 
orthotropic  and  after  yielding, fol lows  Hill's  ortho 
tropic  plasticity  theory .referred  to  the  Ref  [12]. 


In  a  material  coordinate  systcm.Incrcmcntal  stress- 
strain  relations  can  be  written  as  [12]: 


The  origin  of  the  quasi-three  dimension  problem  can  [do  ]=  [C]»»[dc  J  (2-6) 

refer  to  the  Ref [13).  Its  schamatic  illustration  and 

simplified  model  arc  shown  in  Fig. 1. Its  displacement  By  coordinate  translation  for  (2  6).  incremental 
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stress-strain  relations  expressed  in  the  structural' 
coordinatesystsm  can ;be  obtained  as  follows: 

(da]  =  tC]»p[de  J  (2-7) 

where 

(da  3=(TJ-‘[do  3 
(de  ]s(T]-JCde  3 

(c].»=  mT[c3s»(T) 

and  (TJ  is-the-translqtion  matrix  whose  expression 
is  deleted >hero; 

introducing  the  following  symbols: 


da  *=da  i«i 
d  e  i  =  d-e  i*i 


(i=l,2,—  ,5)  (2-8) 


(2-16)  atld  (2*17)  that  tfco.  original  stresses  [d  a 
depend  on  not  only  the  stress  state-before  immediate 
loading  :but  the  strains  Id'S  3*  duo  to  immediate 
loading.  Thus, the  original  stress  vector  (142  trans- 
latodIby_  original  stresses  [da  )J  deponds  on  the 
immediate  strain  increment  (de  l*.  The  following 
finite  element  equations-can  be  derived  by  using 
stress-stfainrelations  (2-15), strain-displacement 
relations  (2-5)  and  the  variation  priciple: 

[K](d5  ]i  =  [dR)i-[dR]0i+[dR(A  e  })»  (2-18) 

where  the  subscript  i  expresses,  the  ith  step  loading 
increment: 

[K]  the  elastic  structural  stiffness  matrix,  in 
which  an  element  stiffness  matrix  is 


a  serics  cf  derivations  are  made  to  find 
(d a  ]s=  [da  ]o+[d a  ]" 

=  (Ci2  Ej3  Eli  Cu  Ci6]T«jde0T[p]tj[de  3s  (2-9) 

in  which 

(Du).<;=  (C**i  sti)*p  (m,n=l  ,2,\-  ,5)  (2-10) 

and  de0  expresses  the  increment  of  e0. 

It  is  noted  that,  in  a  material  coordinate  system, 
the  elastic-plastic  matrix  [CJep  can  be  expressed  in 
tents  of  the  elastic  (£]«  and  the  plastic  matrix 
[CJp,  i.e. 

(C].p=  (CJ.-(C]P  (2-11) 

Similarly, in  a  structural  coordinate  systeo.the  ela¬ 
stic-plastic  matrix  (Cj.p  can  also  be  expressed  in 
terms- of  the  elastic  matrix  [Cj*  and  the  plastic 
matrix  (C3p,  i.e. 


(K3„=  /  [B3T[D3«[B3dv:  (2-19) 

v 

(d6  )i  the  displacement  vector  due  to  the  ith  step 
loading  increment; 

[dRli  the  load  vector  due  to  the  ith  step  loading 
increment; 

(dRJoi  the  original  stress  vector  translated  by 

fdu  in  which  an  element  c^iginal  stross 
vector  is 

(dR3o.i=  /  [B3I(d5-3oidv  (2-20) 

Because  the  original  stress  vector  (dR(  A  e  )3i 
depends  on  the  immediate  strain  increment  [de  3*, 
and  the  immediate  strain  increment  [dc  ]"  is  also 
unknown,  equations  (2- 18)  must  be  solved  by  using  an 
iterative  methodcm.  After  finding  the  approximate 
[d£  ]*,the  calculation  formula  of  [dR(A  e  )3io  is 


(C].p  =  [Cj.-CCjp  (2-12) 

in  which 

(Cl.=  (T]t(C]„[T] 

(C1p=  (T3r(C]p[T3 

Introducing  the  symbols: 


(!?**)•—  (Cs»i  i*i)« 
(Dsi)^  (Ea*l  ■»! )p 


(m,n»l,2,-,5)  (2-13) 


then  the  following  results  can  be  obtained  from  for¬ 
mulas  (2-10)  and  (2-12) 


(0J.p=  (Dj«-(Djp  (2-14) 


(dR(  A  e  ))„=  /  (BlUDlpjIde  ifdv  (2-21) 

C.  LOADING. AND  UNLOADING  CRITERIA 

Since  the  local  unloading  around  the  crack  tip  due 
to  stable  crack  growth  occurs,  loading  and  unloading 
problem  are  necessarily  considered  in  simulating  the 
stable  crack  growth. 

The  yielding  equation  for  a  homogenous,  orthotropic 
material  can  be  expressed  in  terms  of  the  effective 
stress 


2g(  a  u 


2 

h>  =  —  (F.+C.+H.)  a  2-hz=  0 
3 


(2-22) 


By  substituting  (2-14)  into  (2-9),  one  can  find 


[d a  1*=  [da  3*+(D]*[dr J* 

(2-15) 

in  which 

[do  3»=  [d a  )o-(Dlp(d £ Is 

(2-16) 

and 

[da  ]'=  [C«  Cu  Cm  Cis  Cislepdco 

(2-17) 

According  to  the  formulas  (2-15),  vc  know,  if  the 

(da  Jo  are  regarded  as  original  strcsscs.thcn  the 
mateeial-nonlincar  problem  is  translated  into  the 
material  linear  problem  possessing  the  original 
stresses  [dolo[14].  It  can  be  seen  from  formulas 


where  what  individual  symbols  in  (2-22)  mean  can 
refer  to  the  Ref  (12). 

Introducing  the  following  symbols: 

3 

f(«u,  h')= - g(ou,  h)  (2-23) 

Fo+Go*Ho 

in  which 

* 

h‘ 

h'  = - 

2 

— (Fo*G„*H») 

3 

then  the  yielding  equation  can  be  expressed  as 

£(oij,  h')=  o!-b  J50  (2-24) 


882 


.  is 

(2-25) 

The  following  relations  for  a  homogeneous  isotropic 
material  exist: 

3Fo  =  3G„  =  3H0  =  L0 = Mo  =  No  (2-26  ) 

and 

•Fo=  1/  (2<r ») 


a  plane  strain  problem,  are  substituted  by  new 
appropriate  constants,  these  equations=wi 11  become 
the  equilibrium  equations  of  a  plane  stress  problem. 
Thus,  a  quasi-three  dimension  finite  element  program 
can  be  used  to  analyze  not  only  a  quasi-three- dimen¬ 
sion  problem, if  the  appropriate  limitations  to  boun¬ 
dary  displacement  conditions  of  a  quasi-three  dimen¬ 
sion  problem:  are  made,  but  also  a  plane  problem. 

SI .  NUMERICAL  SIMULATION  OF  STABLE 
PLANE  CRACK  GROWTH 


where  the  original  value  of  h’.h’, 

h..JZEZZ. 

'i  2(Fo+Go+Ho) 


where  oy  is  the  original  yielding  stress.  and 
equation  (2-25)  can  be  translated  into 

h'o=oy  (2-27) 

At  this  moment,  the  equation  (2-24)  is  the  original 
yielding  equation  for  a  homogeneous, isotropic 
material . 

Generally,  the  total  strain  increments  arc  classi¬ 
fied  into  elastic  strain  increments  and  plastic 
strain  increments,  i.e. 

[de  ]=[de  J.+  [dE  J„  (2-28) 


Here,  the  material-nonlinear  finite  element  program 
developed  by  the  authors  will  be  used  to  simulate 
the  stable  crack  growth  process  of  a  plane  crack151 . 
A  rectangular  plate,  made  of  2024-T3  aluminum  alloy, 
with  a  centered  line  crack, is  subjected  to  monotoni- 
cally  and  slowly  increased  loading  up  to  the  onset 
of  fast  fracture.  The  geometric  configuration  and 
the  loading  condition  of  the  center-cracked  specimen 
is  shown  in  Fig. 2. 

The  geometrical  parameters,  i.e..  length  21.  width 
2W, thickness  B.  initial  Crack  size  2a<>  are  listed  as 
follows: 


.  j-  i  ...  *\t\  »«.  i  j-  .  2L=27in.  2W=12in.. 

According  to  the  equation  (2-24),  the  unloading  cri-  (3-1) 

terion  can  be  expressed  as  B=0.062in..  2a0=6in. 


f(cr  u,  h’)<0  or  d5<0  (2-29)  The  material  property  parameters, i.e.. Young’s 

modulus,  poission's  ratio,  yield  stress  and  linear 
At  this  moment,  we  have  hardening  modulus  arc 


td£  ]?=  [Sj[d3  1*  (2-30) 

and 

[de]J=0  (2-31) 

in  which 

[SJ=(B);‘ 

And  the  loading  criterion  can  be  expressed  as 

f<ajj,  h’)=0  or  da  >0  (2-32) 

At  this  moment,  elastic  strain  increments  [de  )' 
arc  still  determined  by  (2-30),  while  how  plastic 
strain  increments  (dc  1 l  are  determined  can  be 
referred  to  the  Ref  [12], 

P.ON  TREATMENT  OF  PUNE  PROBLEMS 

A  material-nonlinear  finite  element  program  of  the 
quasi-three  dimension  problem  developed  by  the  au¬ 
thors  can  be  used  to  analyze  plane  problems. 
Displacement  expressions  for  a  plane  strain  problem 
arc 

o=0 

v=V(y,z>  (2-33) 

w=W(y,z) 

It  can  be  seen  that  if  the  limitations  U(y.z)*0  and 
c«"0  to  the  displacement  expressions  (2-1)  arc  made, 
then-displacemcnt  expressions  (2-1)  become  the  dis¬ 
placement  expressions  (2  33).  Further,  that  the 
appropriate  limitations  to  material  constants,  in¬ 
cluding  the  clastic  constants  and  strength  constants, 
of  homogeneous,  orthotropic  continua.  arc  made  will 
cause  these  continua  to  become  homogeneous. isotropic 
continua.  And  it  is  noted  that  if  the  constants  in 
equilibrium  equations,  expressed  by  displacements. of 


E=l0324Ksi.  v  =0.33, 

(3-2) 

a  y=54.20Ksi.  H'  =  259.74Ksi 

The  finite  element  mesh  and  two  paths  for  the 
evaluation  of  J-integral  arc  referred  to  the  Reft  12). 

Here,  the  load-crack  size  curve  measured  by  experi¬ 
ment.  as  shown  in  Fig. 3(a).  is  taken  as  the  input 
data  which  is  used  the  govening  equation .The  com- 
parision  of  the  experimental  lead-displacement  curve 
with  the  numerical  load-displacement  data,  shown  in 
Eig. 3(b)  proved  that  the  numerical  results  here  arc 
correct. 

A.  J-INTEGRAL 

Fig. 4  showed  that  J-integral  varied  with  crack  size. 
It  can  be  seen  that  the  values  of  J-integral  along 
the  two  paths  arc  almost  the  same  with  the  maximum 
difference  being  ±^Z.T%  -This  result  was  in  agree 
ment  with  that  reported  in  [1.3J.  Refs  [1.3]  point¬ 
ed  out  that  J-integral  is  still  conservative  in  the 
condition  of  small  amount  of  crack  growth.  Reffl] 
reported  that  J-integral  of  far  field  for  a  compact 
tension  specimen  is  in  agreement  with  Jintcgral  of 
near  field  in  the  condition  of  (a'a«)/(W-a»)<0.06. 
Here.  (ne-3o>/ (U-ao)=0.03.  Moreover,  it  can  be 
seen  that  J-integral  is  proportional  to  the  amount 
of-  crack  growth  in  the  origin  of  the  stable  crack 
growth.  This  result  proved  the  two  parameter  charac 
tcrization  of  fracture  toughness  properties  proposed 
by  Shih.ct  alllj. 

B.  CRACK  OPENING  ANGLE 

The  two  definitions  of  crack  opening  angle  arc.  one 
is  the  average  crack,  opening  angle,  denoted  by  COA 
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or  a  o ,  which  is  def  ined  as  the  ratio  of  the  crack 
opening  displacement  at  the  original  crack  tip  to 
the  total  amount  of  crack  growth  that  has  occurred, 
while  the  other  is  the  crack  tip  opening  angle,  de¬ 
noted  by-CTOA  or  aj,  which  is  defined  as  the  ratio 
between  crack  opening  displacement  at  a  short  and 
fixed  distance  A  behind  the  current  crack  tip  and  A  . 
In  this  work,  A  is  taken  to  be  the  spacing  between 
•nodes  located  along  the -path  of  crack  growth.  The 
results  of  COA  and  CTOA  are  plotted  in  Fig. 5.  It  can 
be  seen  that  COA  and. CTOA  are  both  varied  with  the 
stable  crack  growth,  but  the  range  of  the  variation 
of  CTOA  is  smaller  than  that  of  COA.  From  numerical 
values,  the  data  of  COA  snd  CTOA  reported  here  were 
almost  the  same  as  those  reported  in  Ref  [7]. 

C.  CRACK  TIP  FORCE 

The  technique  of  releasing  the  crack  tip  forces  is 
often  used  in  the  numerical  simulation  of  stable 
crack  growth.  The  result  of  crack  tip  force  Fc  is 
shown  in  Fig. 6.  It  can  be  seen  that  Fc  is  basically 
constant  with  the  stable  crack  growth.  This  result 
proved  the  mixed  criterion  of  Jci  and  Fc  proposed  by 
Kannunen,  et,al[2]. 

IV.  CONCLUSION' 

In  this  paper,  a  material-nonlinear  finite  element 
program  of  the  quasi-three  dimension  problem  deve-  - 
loped. by  the  authors  is  described  from  a  few  respe¬ 
cts.  Further.it  is  illustrated  how  this  program  is 
used  to  analyze  plane  problems.  Finally,  a  finite 
element  analysis  of  the  process  of  slow  crack  growth 
is  made  for  a  center-cracked  specimen  subjected  to 
monotonies 1 ly  increased  load  until  the  point  of  fast 
fracture  is  reached.  Numerical  results  and  experi¬ 
mental  results  are  compared.  Variation  laws  of  some 
fracture  mechanics  parameters  are  given  with  the 
stable  crack  growth. 
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Fig.l  Schematic  illustration  of  geometrical  configuration 
(a)  and  simplified  code  (b)  of  th~  quasi-three 
dimension  problem 


z 


Fig.2  Geometrical  configuration  and  loading 
conditions  of  a  ccnlcr-c racked  plate 
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(a) 


(b) 


Fifi.3  Cocparision  of  experincnt.il  load-displacccent 
curve  with  numerical  load-displaceoent  data 
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Fig.5  The  variations  of  CTOA  and  COA  with  the 
stable  crack  growth 
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Fig. 6  The  variation  of  the  crack  Up  node  force  F. 
with  the  stable  crack  growth 
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Abstract — It  has  proven  quite  difficult  to  employ  exact  clastodynamic 
theory  to  describe  the  behavior  of  clastic  vibrations  on  aroitrary  bounded 
shells.  In  addition,  exact  theories  preclude  direct  interpretation  of  particular 
features  observed  due  to  the  excitation  c*  clastic  shell  surfaces.  A  rather 
interesting  approach  to  describe  surface  vibrations  may  be  obtained  by 
constructing  a  Hamiltonian  in  some  approximate  form  that  assumes  some 
correlation  of  motion  of  Utc  outer  and  inner-shell  surface.  The  class  of 
theories  that  allow  for  this  approach  arc  referred  to  in  applied  mechanics 
as  shell  theories.  The  interesting  feature  of  this  Hamiltonian  approach  is 
that  one  can  add  various  physical  mechanisms  to  the  Hamiltonian  such  as 
cxtcnsional  motion,  rotary  inertia,  shear  distortion,  fluid  loading,  etc.,  and 
thereby  study  the  individual  contributions  to  rcsonancc  patterns  while 
adding  physical  insight  to  Utc  fundamental  processes  that  occur  on  shell 
surfaces.  We  develop  shell  theories  in  this  manner  and  examine  various 
contributions  via  Hamilton’s  principle.  We  believe  that  fluid  loading  has 
by  and  large  not  been  treated  adequately  in  the  past,  and  we  place  particu¬ 
lar  emphasis  on  the  treatment  of  that  contribution  to  tins  work. 

I.  INTRODUCTION 

The  usual  assumptions  in  shell  theory  (due  to  A.  E.  H.  Love2)  arc: 

(1)  The  thickness  of  astall  is  small  compared  with  the  smallest  radius  oi 
curvature  of  the  shell;  (2)  The  displacement  is  small  m  companson  with  the 
shell  thickness;  (3)  .The  transverse  normal  stress  acting  on  planes  parallel  to  the 
shell  middle  surface  is  negligible;  (4)  Fibers  of  the  shell  normal  to  the  middle 
surface  remain  so  after  deformation  and  arc  themselves  not  subject  to  elongation. 

We  shall  use  these  assumptions  in  the  development  of  a  shell  theory  in  the 
style  of  a  Timoshenko-Mindlin  type  plate  theory. 

II.  DERIVATION  OF  EQUATIONS  OF  MOTION 

For  spherical  stalls,  membrane  stresses  (proportional  to  p)  predominate  over 
flexural  stresses  (proportional  to  /J2)  where 


We  differ  from  the  standard  derivation  for  the  sphere  (due  to  lunger  and  Feit3) 
by  retaining  all  terms  of  order  p2  in  both  die  kinetic  and  potcnUal  energy  pans 
of  the  Lagrangian.  We  note  dial  this  level  approximation  will  allow  us  to 
include  die  effects  of  rotary  inertia  and  shear  distortion  in  our  shell  dicory,  as 
well  as  the  usual  cxtcnsional  morion  of  die  shell.  The  new  derivation  is  as 
follows:  let  a  u,  v,  w  axis  system  be  set  up  on  a  spherical  shell  of  radius  a 
(measured  to  mid-shell)  with  diickncss  h,  as  shown  in  Fig.  1. 

Then  the  new  Lagrangian  (wliich  is  equivalent  to  a  Timoshenko-Mindlin 
dicory  as  applied  to  a  spherical  stall)  is  L  =  T  -  V  +  W,  where  die  kinetic 
energy  is 

T  =  jpJo  TO?  +  sin  edxdOd*,  (1) 

with  die  surface  displacements  assumed  linear  in  Timoshenko-Mindlin  fashion: 


1  We  wish  to  thank  the  Office  of  Naval  Research,  the  Office  of  Naval 
Technology,  and  NOARL  Management  including  Drs.  Clun-Bing,  Franchi, 
and  Moseley  for  support  of  this  work.  Dr.  Dean  is  at  NOARL  on  an  ONT 
Fellowship.  This  work  was  funded  by  NOARL  Program  Element  61 153N, 
H.  Morris,  Program  Manager,  NOARL  contribution  PR91:068:221. 

2  A.  E,  H.  Love,  A  Treatise  on  the  Mathematical  Theory  of  Elasticity  (New 
York:  Dover,  1944),  Ch.  XXIV. 

3  M.  C.  Jungcr  and  D.  Feit,  Sound,  Structures,  and  Their  Interaction,  2nd 

cd.  (Cambridge,  MA:  MIT  Press,  1986),  p.  228  ff. 


Fig.  1.  Spherical  shell  showing  coordinate  systems  used. 

,  X. .  x  d\v  .  , , 

u,  =  (1  +  -)« - r-,  w,  =  w.  (2a,  b) 

a  a  da 

There  is  no  movement  in  the  v-dirccrion  since  the  ensonifying  field  can  be 
taken  to  be  toreionlcss.  By  substitution,  the  kinetic  energy  becomes 

„  f*  .  flr.  h 5  /i3  .  2.  It 5  h\.dtv 

r=  >-2W+7 )UTS 

,/A _ .  /*  ,  ,ll  ,  7. ,o\ 


^+^W+^+ha2)^m 


or  finally, 


T  =  npJta2j'ompi  +  6p2  +  l)u2-Q.6pi+6p2)u-^ 

+(1.8j34  +  P2){~f  +  (p2  +  l)iv2]sin  6d6. 
ad 

which  to  order  P2  is 

T  » itptha2j*[(}  +  6p2)u2-6p2u^+p2(~)2 
+(l+ p2)w2]s\n  6d9. 

In  a  similar  fashion  the  potential  energy  is 

v  =  X*  +  °)2  sin  OdxdOdtp, 

1  tit  e2rt  fh/2  -  E  1  „  x.du  xd2wi  l2 

=  jU.  u- 

+(coi«((l+i)«-~l+».lI(l+i)^-~+H’M 

a  add  a  ad  a  ad 

(x  +  a)2  sin  ddxddd<j>. 


= + (H,+,ico!  6)2 

+2  v(w  +  ^)(»v  +  «cot  0)  +  j82[(|^  - 1^)2 

+cot2  6 {it  - +  2 vcot  6(ti  - -  ~y)])si"  0d6,  t6c) 
ad  ad  ad  ad 
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where  the  nonvanishing  strain  components  arc 

and 


1  fdu  ,  } ,  x  fdu 

=«U+t?U“^7  (a) 


ett  =  — (cot0»+w)+ 
a 

The  nonzero  stress  components  arc 


?co4-f} 


°W  -  J  __  v2  +  vefA  =  J  _  y2  (£*t  +  V£m)- 

The  work  done  by  the  surrounding  fluid  on  the  sphere  is 
W  =  2na2  J*pJW'sin  Odd. 


(7b) 


(8  a,b) 


(9) 


Since  the  integration  along  the  polar  angle  is  intrinsic  to  the  problem,  the 
solution  must  be  found  using  a  Lagrangian  density: 

L,  =  Jtp,ha2[(\  +  6p2)u2  -  6p2u^ + p2^)2 

+(1 +/)2)tv2]sin  6  -  +  (vu + it  cot  0)2 

1-v2  90 

+2  v(w + |^)(vv + u  cot  0} .+ /32[(-~  - 1^)2 
+cot2  0(u  -  ^-)2  +  2vcot  0{u  4^)])  sin  0 


50 

+2  7ta2ppv  sin  0, 
with  differential  equations 


50 ''59  502 


5 L,  d  (9l,  d  5 L| 
5u  dO  5ug  dt  du, 


and. 


din  £  dh ,  d  <?L,  _  q 

5w  dO  dwg  dt  5w, 


(10) 


(Ha) 


(lib) 


By  substitution  we  have 

(1  +  /32)| 


0+col9^.(v+co,.«,Bj -psgt 


d\v 


}52w 
50 2 


-p2 cot  0~~  +  [(1+  v)  +  p2(v  +  cot2  0)] 


50 


~[(l  +  6/32)«-3/32|j]  =  0, 
c;  50 


(12a) 


and 


j320  +  2/)2cot0^-[(l+v)(l  +  /32)  +  /)2cot20)]^ 


I*. 

502 


du 

50 


+cot  0[(2  -  v+ cot2  0)p2  -  (1  +  v)]u-  P2  Ip2  cot  6>|^- 

+P2(  1  +  v + cot2  6)  -  P2  cot  0(2  -  v + cot2  0) ~ 

<70 


fl'~  „  0-vV 


-2(1  +  v)w  — -r(l +P2)w  =  -pa 


Eh 


(12b) 


where  rj  =  cos  0  and  Pa(t])  arc  die  Legendre  polynomials  of  die  first  kind  of 
order  n.  Tito  diffcrcntialcquations  of  motion  (12a, b)  arc  satisfied  if  tile  expansion 
coefficients  U„  and  lV^  satisfy  a  homogeneous  system  of  linear  equations 
whose  determinant  yields  a  frequency  equation  of  the  form 

o = n4  (1 + /„)  -  n2[(i + P2)  IC(1 + /„) + 2(1 + v)+ p2KXn] 

+[2(1+  v)+/52jcA,1](1  +  /)2)k'-[/)2k'+(1  +  v)]2A„,  (14) 

where  K  =  V+ A„  - 1  and  A„  =  n(n  + 1).  The  fluid  loading  is  including  by 
the  term  /„,  which  uses  the  exact  volume  equation  of  a  sphere  to  include  the 
influence  ofthc  exterior  spherical  shell  of  fluid  that- influences  the  motion  of 
the  vibrating  spherical  shell.  This  is  done  in  a  manner  analogous  to  that  for  the 
fluid  loaded  plate:  for  a  plate,  fluid  loaded  on  one  side,  of  mass  per  unit  area 
psh,  the  appropnatc  norxkmcnsional  measure  of  fluid-loading  at  any  frequency 
to  is  pc/cop,A.  The  surface  pressure  for  a  sphere  in  terms  of  modal  specific 
acoustic  impedances  z„  is 


where 


Let 


Then 


Similarly 


P(a, 0,$)=  £  £z„W,m,P„’’(cos0)cosmp, 


.  K(kn) 

2.  BtpC— - 

n  K(ka) 


zn*rn-icomA. 


r„  =  pcRc 


i7i„(Aa)1 

.«(*»)  J 


m,=pelm 


\ih.m 

L  Km 


(15) 


(16a) 


(16b) 


(17a) 


(17b) 


The  fluctuating  pressure  on  the  surface  of  the  sphere  constitutes  the  radiation 
loading.  In  Jungcr  and  Feit’s  derivation  ofthc  fluid  loading. 


but  we  use 


/,= 


f  -  m " 

J  n  ~  t* 

P,h 


3  amn 

p,[a2-(a-i>yy 


(18) 


(19) 


which  has  the  advantage  of  an  exact  volume  difference  for  the  amount  of  fluid 
affecting  the  vibrating  shell. 

III.  CONCLUSIONS 

We  expect  this  new  derivation  of  the  equations  of  motion  for  a  spherical 
shell  to  give  new  insight  into  the  types  of  waves  supported  by  a  fluid  loaded 
spherical  or  spheroidal  shell.  From  previous  work4  we  expect  the  effects  of 
fluid  loading  to  be  more  important  for  antisymmetric  titan  for  symmetric  modes 
of  vibrauon,  and  for  our  unproved  volume  measure  to  be  more  significant  for 
thicker  shells.  We  also  hope  to  see  an  improvement  in  the  asymptotic  behavior 
of  the  resonances  in  the  high  size  parameter  limit  for  the  antisymmetric  ease. 
That  is,  we  expect  the  results  to  go  to  the  Rayleigh  velocity  limit  as  the  relative 
radius  of  the  shell  goes  to  infinity. 


These  differential  equations  have  solutions  of  the  form 

M  ,10  M 

«(1?)  =  !(/„(! -1?V2 3 T>  h’(W  =  5XW  (13a, b) 


dri 


**0 


4  C.  E.  Dean  and  M.  F.  Werby,  "Comparison  of  backscattcrcd  echoes 
predicted  from  exact  theory  and  from  thin-shell  theories,"  J.  Acoust.  Soc. 
Suppl.  88,  S15,  1990. 
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Abstract.-  In  this  paper,  a  dynamic  thermoelastic  model  (or  linear 
beams  is  obtained. by asymptotic:  analysis.  The  model  is  obtained  as  the 
weak  limit  of  a  rescaled  three-dimensional  model  after  a  change  of 
variable  to  a  fixed  domain.  As  well  as,  a  compatibility  condition  In  order 
to  obtain  strong  convergence  is  given. 

I.  SETTING  OF  THE  PROBLEM 

The  basic  ideas  of  the  asymptotic  expansion  method  introduced  by 
BERMUDEZ  -  VIANO  12]  and  TRABUCHO  -  VIANO  [8,9]  are  applied 
here  in  order  to  obtain  the  justification  of  an  evolution 
thermoelastic  model  for  linearized  rods.  We  study  the  case  of  an 
elastic  beam  0£  =  w£  x  (O.L) ,  s2  =  meas(w£),  clamped  at  both  ends 
l"Jj  =  co£  x  (0,L)  and  kept  at  them  to  an  uniform  reference 
temperature  T„.  The  beam  is  supposed  to  be  submitted  to  body 
forces  F£(  x£  )  in  0£  and  surface  forces  Gc(  x£)  on  T£=  3w£  x  (O.L) 
andito  Initial  conditions  In  displacement,  velocity  and  temperature 
( if,  V£,  0£  ).  We  assume  the  beam  0£  made  of  an  isotropic, 
homogeneous,  elastic  meterial  of  Saint  Venant  -  Kirchhoff,  with 
Ypung's  modulus'E.  Poisson's  ratio  v,  thermal  dilation  coefficient 
«,  heat  conductivity  coefficient  k  and  specific  heat  coefficient  (S, 
independent  of  e.  We  denote  by  p£  the  mass  density  and  we  assume 
thatp£=c2Q  with  q  independent  of  c  ([3], (71).  Then,  the  dynamic 
problem  corresponding  to  the  thermoelastic  behavior  of  the  beam 
0£  during  the  time  interval  [0,T]  is  governed  by  the  classical 
evolutive  system  of  equations  posed  as  a  function  of  the 
displacement  field  U£  and  the  temperature  increment  field  (f  = 


C€-T0  ([5]): 

p£ U£"  -  3£ Z£j  =  Ff  in  0£ x  (0,T)  ,  (I) 

P©£,=^  3j£(k  3,-©e)-— I;  ekk(U£')  in  0£x(0,T),  (2) 

U€  =  0  .  0£  =  0  on  Tq  x  (O.T)  ,  (3) 

E,£K  na  =  6(£  ,  k 3£0£  na  =  0  on  r£x(0,T)  ,  (4) 

U£  (0)  =  tf  ,  U£,(0)  =  V£  ,  0"'  (0)  =  0£  ,  (5 ) 

In  (1)-(5)  the  Piola  -  Kirchhoff  tensor  E£  is  given  by  the  linear 
thermoelastic  law : 

ee(U£)-oc  0£I=  -^E£-  -f  tr(E£)  I  ,  (6) 

E  E 

where  efj (U£ )  =  £  (af  U£  +  3/ uf  ) . 


In  a  classical  way  the  existence  and  uniqueness  of  solution  of  the 
three-dimensional  problem  (l)-(5)  with  the  followmg  regularity, 
Is  obtained  ([6])  : 

U£  e  C°(0,T;(H2(D£))3 )  fl  c'(0,T;  (h'(0£))3  )n 
fl  C2(0.T;(L2(0£))3)  , 

0£  e  C°(0;T;H2(Q£))  n  c'(0,T;L2(0£))  . 

II.  WEAK  CONVERGENCE 

Following  the  works  by  BLANCHARD  -  FRANCFORT  [3],  BERMUDEZ 
-  VIANO  !2]  and  TRABUCHO  -  VIANO  [8,9]  we  study  the  behavior  of 
the  three-dimensional  model  as  the  area  of  the  coss-section  of  the 
beam  tends  to  zero.  In  order  to  make  this  possible  we  consider  a 
variational  formulation  of  the  problem.  Then,  we  apply  the 
following  change  of  variable  and  scale,  which  allows  us  to  Work  on 
the  fixed  domain  D  =  u*  (0,L).  w  =  c"1  w£  : 

n£  :  x=(x,,  x2,  x3 )  f  0  -  n£(x)  =  x£=(ex, .  cx2 ,  x3 )  e  0£ ,  (7) 
ua(c)  =  e  U£  o  n£  ,  u^c)  =  U3  o  n£  ,  0(c)  =  ©£  o  n£  , 

=E  2  a«3^  =£  ^«30,t  >  ^33^)  =  ^33°  n  ' 

f^e)  =  c'1  F£  o  n£  ,  f3(c)  =  F^0it£  ,  (8) 

ga(c)  =  e"2  G£  o  n£  ,  93(c)  =  e”1  G3  o  it£  . 

We  denote  (u(e),  v(e),0(c))  the  element  obtained  from  (tT.V6,©^ 
by  the  transformation  (8)  and  e^tv)  =  |  (3fVj  +  3jVj )  for 

v<=(h'(0£))3. 

Theorem  .-  We  assume  the  following  weak  convergences  as  c  tends 
to  zero; 

u(c)  -  u  0  weakly  in  H  =  W3;  W=(  z  e  h'(0£)  ;  z  =0  on  T0  ) 
v#(e)  -  va°  ,  ,  0(e)  -  0°  , 

c-2ea5(u(e))~ -ejp  ,  c'1  e#3  (  u(c) )  -  e?3  , 

e33  ( u(c) )  -  e33  weakly  in  L2(0)  ,  (9) 

ffc)  -  f,°  ,  a3  f3(c)  -  33  f£  weakly  in  h'(0,T;  L2(0) ) , 
g,(e)  -  g?  ,  33  g3(c)  -  33  g3  weakly  in  h'(0,T;  L2(D  )  . 

Then,  for  the  sequence  (u(e),  0(c))  and,  at  least,  for  a  subsequence 
of  ( cr(e),  VO(c),  e(u(e)) ) ,  noted  in  the  same  way,  we  have  : 
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u(e)  -*-u° 

weak-*  in  Lw(0,T;H)  , 

utt(e)'  -  u®' , 

cu3(e)‘-0  ,  c2<xat(e)  -  cr®f  , 

£  ffa3(£)  "*‘q«3 

,  <J33(e)  -r  <J33  , 

s”2  eKp  (u(e))  - 

“f  *«®e  -  T  ,  V  K  °®  5«e  •  (,0) 

e"1  ea3  (u(e))  - 

-  <r®3  weak-*  in  L  (O.T;  L2(fl)), 

0(c)  -0°  weak-*  in  L"  (O.T;  L2(0) )  and  weakly  in  L2  (O.T;  W' 

c'1  3„0(c)  -  rj  weakly  in  L2(0,T;  L2(0)  )  . 

where: 

(i)  u°  is  a  Bernoulli-Navier  field,  u®  =  ( u®  ,u®  ,  'i®  -  xa  03u®  ), 
whose  components  are  determined  by  : 

a)  u®  e  L”(0,T;  Hq(0,D)  is  the  unique  solution  of  the  problem 

e  ua  -E  1*3333;^  =  lu'f®  +  g®  +  x«  f°  +  xa  g® ), 

«®(0)-«i  -  u2‘(0Mu  v*  ■  Ia=  fu(xa)2  .  (11) 

b)  (u®V  )e  L“(0,T;  Ho(0,L))  x  LM(0,T;  HqCO.L))  is  the 
unique  solution  of  the  coupled  system  : 

E  a33^  -  E  cc  a3o®  =  _  lw  f§  -Jyg®  . 

BO°'=-f  a33o®.  e«  a,u®'  ,  b  =  g  +  -2-E]-;^(Ux-  • 

,  (12) 
B  0®  (0)  =  g  fw  0®  +  ~~  lu  e-°  -  Ecc  Iw  a,u®(0) 

(ii)  o®| ,  r®  are  solutions,  respectively,  of  ; 

3a  0®j  =  0  in  w  ,  u^na  =  0  on  3w  .  (13) 

3a(kr®)=0  in  w  ,  k  r®  na  =  0  on  3w  .  (14) 

(iii)  The  stress  tensor  component  <r®3  is  given  by  : 

^33  “  ^  ^3^3  ”‘E  x«  ®33u«  -  E  a  0®  +  v  <r®a  .  (15) 

As  well  as.  the  bending  moments,  normal  stress  and  shear  forces 
verify,  respectively  : 

q3(e)  =  d33(e)  —  q3  =  E  83u3  -  E  a.  0  , 

=  X«  ff33k)  -  m«  =  "  E  l„  333U®  ,  (16) 

=  tf«3^  ~  qot  =  Xa  f3  +  Xa  q3  +  a3mK  • 


We  also  obtain  a  result  of  regularity  for  the  limit  problem.  Thus, 
under  mild  assumptions  on  the  initial  data  and  the  applied  loads,  we 
obtain  that  u®  and  0®  satisfy: 

u®  e  C®(0,T;h£(0,L))  Cl  c'(0,T;L2(0,L))  , 

ItS  e:C®(0,T;Ho(0,L)) ,  0®  e  C°(0,T:L2(0,L))  . 

ill.  STRONG  CONVERGENCE 

Following  the  technique  by  RAOULT  (7),  based  on  the  convergence 
of  the  norms  in  the  Hilbert  space  L2(0,T,L2(Q)),  we  can  prove  that 
the  convergences  of  (10)  are  strong  if  and  only  if  a  compatibility 
condition  over  initial  data  is  satisfied  ( ALVAREZ  [  1  ] ) . 

Finally,  the  same  method  can  be  applied,  with  slight  modifications, 
to  study  of  the  behavior  of  the  beam  under  different  boundary 
conditions  (beam  clamped  only  at  one  end,  heat  flux  over  the 
surface  of  the  beam...)  and/or  nonhomogeneous  material. 


This  research  was  partially  supported  by  European  Project  SCIENCE 
SCI*0473-C  (EDB)  and  by  Project  PB87-048 1  of  DG1CYT  of  Spain. 
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Abstract  This  work  is  concerned  with  the  deformation,  the  stress 
field  and  the  stress  concentration  in  a  thick  plate  with  a  cylindrical 
hole  or  inclusion  that  is  subject  to  a  pressure  at  the  opening  while 
all  other  boundaries  remain  traction-free.  The  equations  that  model 
such  a  deformation  are  highly  nonlinear  and  coupled.  We  seek:  a 
numerical  solution  and  develop  an  algorithm  based  on  a  Newton- 
Kantorovich  linearization.  The  equations  are  discretized  with 
fourth  order  compact  finite  differences  over  a  variable  grid.  The 
deformation,  the  stress  field  and  the  stress  concentration  are 
investigated  throughout  and  are  compared  with  results  of  linear 
elasticity  theory. 

A  large  class  of  elastomers,  synthetics  and  some  biological 
tissues  obey  the  theory  of  Finite  Elasticity.  The  set  of  partial 
differential  equations  that  models  such  materials  under  stress  are 
usuallymonlinear  and  coupled  and  few  exact  analytical  solutions 
are  known  so  far  [1],[2]. 

The  problem  we  are  concerned  here  belongs  to  a  group  of 
boundary  value  problems  involving  perturbations  about  large 
deformations  in  thick  plates  weakened  by  holes  or  inclusions.  The 
presence  of  holes,  notches  and  inclusions  results  in  a  stress 
concentration  around  the  opening  and  these  types  of  problems  are 
of  significant  interest  in  design. 

We  consider  firstly  that  the  plate  undergoes  a  large 
deformation  due  to  a  pressure  applied  at  the  opening.  The  body  is 
further  subject  to  some  perturbative  surface  tractions,  reaching  a 
final  state  of  equilibrium.  Two  types  of  problems  arise:  the 
problem  where  the  thickness  of  the  plate  is  prevented  from 
changing  this  is  a  two  dimensional  plane  strain  problem  -  and 
the  problem  where  the  thickness  is  allowed  to  change  and  we  deal 
with  a  thrce-dimensional  case. 

We  found  the  general  analytical  solution  [3]  for  a  class  of 
two-dimensional  boundary  value  problems:  it  applies  to 
incompressible  materials  with  strain-energy  function  of  Mooney- 
Rivlin  type,  although  the  method  of  solution  is  not  restricted  to  this 
particular  form  of  the  strain-energy.  A  typical  point  located  at 
(p,i},Q  in  the  unstrained  and  unstressed  state  moves  to  (r,0,z)  after 
the  large  deformation  takes  place.  The  body  is  then  subject  to  a 
certain  perturbation  which  is  viewed  as  a  perturbative  displacement 
field  of  components  eu(r,0)  and  ev(r,0)  in  the  r-  and  0-direction 
respectively.  The  small  parameter  e<<l  has  its  own  physical 
significance  in  each  specific  problem.  We  have  found  all  possible 
combinations  of  displacement  fields  (eu,ev)  that  can  be 
superimposed  on  the  initial  large  deformation  such  that  the 
equilibrium  can  be  maintained  without  body  forces,  by  surface 
tractions  alone.  The  solution  for  u(r,0)  and  v(r,0)  is  expressed  in 
terms  of  Fourier  series  where  the  coefficients  themselves  arc 
functions  of  r.  The  r-dependent  functions,  in  turn,  are  solutions  of 
a  fourth  order  ordinary  differential  equation  and  are  expressible  in 
series  form  with  logarithmic  contribution. 

The  general  solution  is  suitable  for  solving  a  large  class  of 
boundary  value  problems  [3], [4].  A  special  attention  is  devoted  to 
the  case  of  a  perturbative  uniaxial  tension  applied  at  great  distances 
from  the  opening.  The  section  passing  through  the  axis  of  the  hole 
and  which  is  perpendicular  to  the  line  of  stretch  is  the  most 
stressed  one.  If  the  body  is  subject  solely  to  the  perturbative 


uniaxial  loading  and;  no  previous  large  deformauons  occur,  the 
stress  at  the  edge  of  the  hole  is  three  times  the  stress  applied  at 
inifinity  -  a  result  obtained  within  the  linear  elasticity  theory  [5]. 
On  the  other  hand,  the  body  would  assume  a  certain  stress  field  if 
only  a  large  deformation  took  place.  Now,  we  consider  that  the 
uniaxial  tension  is  applied  on  the  existing  finite  deformauon.  We 
deal  here  with  nonlinearity  and  we  know  that  superposition  doesn’t 
bold.  The  stress  concentration  at  the  hole  could  be  magnified  or 
diminished;  We  have  found  a  definite  increase  in  stress 
concentration,  as  a  nonlinear  effect.  However,  the  highly  stressed 
region  is  very  localized  near  the  hole  and  the  stress  field 
approaches  very  rapidly  the  value  prescribed  at  infinity. 

The  analysis  for  the  three-dimensional  case  is  more 
involved.  Firstly,  we  consider  that  the  layer  is  subject  to  a  pressure 
applied  at  the  opening,  all  the  other  boundaries  remain  traction- 
free.  The  deformation  is  axially  symmetric  and  is  given  by  the 
mapping 

p  =/(r,0),  0=8,  C=«(r,0).  W 

While  the  differential  equation  that  describes  the 
corresponding  large  deformation  in  the  two-dimensic.iel  case  can 
easily  be  integrated  regardless  of  the  functional  form  of  the  strain- 
energy  function  to  obtain  p  =  (i2  -  k2)1'2,  the  set  of  partial 
differential  equations  here  are  nonlinear  and  strongly  coupled,  and 
to  find  the  analytical  solution  that  satisfies  completely  and 
rigorously  all  the  boundary  conditions  is  a  difficult  task. 

Some  progress  can  be  made  by  specifying  the  strain-energy 
function.  We  assume  a  Neo-Hookcan  matenal  where  W  =  C(I,-3j. 

The  equilibrium  equations  take  the  form 


_  lit  (KK+KMi 

2 C  dr  3r|  r2  \3zJ  \3zJ  j  dz  r 2  \3r3z  dr  d zj 

■\2  /a™\2 1  /  a/a™  a/  a™\2l 

=  0, 


_1_ 

2C 


'K)\  (M  .  [KK.  .  KM 
,3zj  l&J.  Idrdz  dzdrj 


K-ilt  \(K\\  fJEfll+ii  t  [f 

dz  3r|  r2  \3zJJJ  3z|  r2  ll l  dr, 


0) 


r3  \drdz  dr  dz) 


(3) 


where  p(r,0)  is  the  hydrostatic  pressure. 

The  incompressibility  condition  requires  that 


f(KM-Ki sUi.  (4) 

r  ^3r  dz  dz  dr) 
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Wc  have  found  a  solution  in  terms  of  Bessel  functions  using  a 
successive  approximation  method  [6].  However,  the  solution  is 
limited  to  moderately  large  deformations. 

In  order  to  cast  further  light  on  the  three-dimensional  stress 
concentration,  we  seek  a  numerical  soluUon  based  on  an  iterative 
procedure  between  f(r,0),  g(r,9)  andp(r,0). 

Tlie  formulation  for  f,  g  and  p.involves  two  coupled  second 
order  equations  in  f  and  g;  it  turns  out  that  tiie  nonlinearity  appears 
in  the  first  order  terms  only.  The  computational  aspects  are 
considerably  simplified  by  introducing  the  following  two 
transformations: 

-  the  first  transformation 


where  a  is  the  radius  of  the  cylinder  and  2/  is  the  pjate  thickness 
in  the  undefoimed  state,  maps  the  section  at  infinity  into  x  =  0, 

-  the  second  transformation  given  by 

F(x,y)  =  -/(p,Q,  G(x,y)  .-A  «(P.O.  <6> 

a  l 

removes  the  leading  asymptotic  behaviour  in  F. 

The  domain  of  computation  becomes 

D  :  { (x,y)  |  Osxsl  ,  Osysl  }  .  0) 

The  resulting  set  of  nonlinear  equations  and  the  boundary 
conditions  involve  the  aspect  ratio y  =  all  which, we  take  as  a 
parameter. 

Denote  the  1: lh  approximate  solution  by  Vk  s  [Fk,Gk,Pk]. 
We  impose  a  rectangular  grid  over  D  with  mesh  refinement  in  the 
vicinity  of  the  opening  to  accomodate  the  localized  stress 
concentration.  We  apply  a  Newton-Kantorovitch  linearization 

[7], [8]  and  discretise  the  linearized  equations  with  variable  grid 
fourth  order  compact  finite  differences  [9].  The  resulting  linear 
algebraic  system  of  equations  turns  out  to  be  sparse.  An  iterative 
sparse  matrix  solver  [10]  allows  us  to  obtain  F(x,y)  and  G(x,y).  As 
some  terms  in  the  expression  for  P(x,y)  become  singular  at  x=0,  we 
introduce  a  new  function  xF(.Y,y)  such  that 
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0P  =  3T  0P  =  _  0T  (8) 

ebe  dy  ’  dy  etc  ’ 

and  hence  V21?  =  0  in  D.  From  the  computation  of  vF(x,y)  new 
values  of  the  hydrostatic  pressure  and  its  gradient  are  obtained. 
This  completes  the  iteration  taking  Vk  into  VUI.  The  deformation, 
the  stress  field  and  the  stress  concentration  around  the  opening  is 
investigated  in  detail.  The  computadonal  results  are  presented 
graphically  and  nonlinear  effects  are  highlighted. 
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Abstract—  Two  new  regularization  formulaes 
for  evaluating  the  finite  part  of  the 
integrals  with  non-integrable  Jacobi  weight 
function  and  new  spectral  relationships  for 
orthogonal  with  non-integrable  weight  Jacobi 
polynomials  are  obtained.  A  new  approach  for 
solving  singular  integral  equations  with 
Cauchy's  kernel,  based  on  the  obtained 
spectral  relationships  abd  regularization 
formulaes,  is  proposed.  Such  approach  can  be 
used  for  the  characteristic  singular 
equation  as  well  as  for  the  complete  one. 


I. INTRODUCTION:  THE  SHORTEST  HISTORY 
OF  THE  PROBLEM 

1)  The  definition  of  the  finite  part  of  a 
divergent  integral  »;as  given  by  Hadamard 
til,  when  he  was  considering  the  integral 
b 

IOO  =  J  fCx>Cx-a:>Xdx 
a 

for  A.<—i.  He  obtained  and  used  first 
regularization  formulaes  for  the  divergent 
integtals  with  the  non-integrable  weight 
function. 

2>  The  authors  of  the  Bateman’s  project  C23 
noticed  that  the  majority  of  the 

relationships  for  Jacobi  polynomials  p“’^Cx> 

can  be  used  even  when  ct<-3  or  /X-l  or  both 
a<~ i  and  (i<~  1 . 

3>  First  application  of  such  Jacobi 
polynomials  was  found  by  Popov  and  Onishchuk 
Cal' .  They  reduced  a  problem  for  a  plate  with 
a  rigid  inclusion  to  the  Integral  equation 
with  so  called  smooth  kernel,  for  which 

Jacobi  polynomials  Pn  3//2Cx>,as  they 

proved,  are  the  eigenfunctions.  It  allowed 
them  to  obtain  the  solution  of  the  integral 
equation  in  the  form  of  Fourier-Jacobi 
series. 


1 1 .  REGULARIZATION  FORMULAES 

Lemma_l.  if  f<x>cCX f-1,11,  a<l,  /Xl ,  then 
1  _  1 

r  fCtJP  «“l*“0-lCt>dt  1  r  f'Ct>P-<:i;“^Ct>dt 

J  - 2 - £7  J - ari - 

-i  a-t>c<+1ci+o^+1  -l  ci-t>aci-> 


Lemma  5.  if  f CxleC1 t-i , 1 1 ,  «<1,  /XI,  then 
1 

I 


fCt>dt 


-1 


Cl-O^Ci+t)^1 


1  r  t 


I 


f  ’  Ct>dt  + 


Ci-t>aCl+t),J 


Ca+/5>Ca+/?-l>  r  fCOdt 


4aft 


I 


-1 


Cl-O^Cl-JtJ^ 


Some  particular  cases  of  Lemma  2  are  listed 
below: 

i  1 

fCxidx  r  xf ' Cx>dx 


j 

-S 

1 


f  fCxidx  r  xf  Cx> 

J  ~  23/2  =  “  J  ~  27 

J  Cl— x  5  J  Cl-x  > 


1/2 


p  fCx>dv  1  r  f'C: 


f 'Cx>dx 


CA-x>“+1Cl+x> 


—1 

1 


2a  J  Cl— x3  Cl+x) 
-1 


rcx>ax 


a 

1  K2a-l-x)f 'Cx>dx 

4af1  -n't  J  C-i  -v->aC1  +v'>i_0< 


’  Cl-x>a+iCl+x>2_c<  4aCl-a>  J  Ci-x^Cl+x!)-* 


-1 


-1 


COCaCO 


I I I. SPECTRAL  RELATIONSHIPS 


Lemma, ^3.  if  a  not  integer,  then 
1 


.  m+a, k-a,  .  .  m+a,  k-a,, . 

1  r  q  ’  Cr>dr  q  ’  Ct> 
1  ~  m _ 


t  f  qn 
.  J  t  — 


tgCarO 


C— 15m  P~Z~Zi  k+C<Ci-?-t> 
_ n+m+k _ 


sinCarrJ 

where  qa’^CT>  =  rC<Ci-T>^PCl'^Cl-2r>, 


n  n 

n=0,a>  ;  k=0,oo  ;  m+n+kSO  . 


If  a  is  not  integer,  uhen 


,  -«+k,,  .ci+m-,  -o+k;.,  .^a+m 

1  c  r  <1-t}  dr  t  <i-t} 


1  r  r  Cl— T} 
n  "  t  —  t 


tg<c«} 


<-l}k+1Pa~k'  a_mCl-2t> 
_ m+k  _ 


sinCcd} 


where  m+k>0 


IV.  THE  SOLUTION  OF  THE  CHARACTERISTIC 
SINGULAR  INTEGRAL  EQUATION 

The  use  of  the  previous  results  i  -• 
iliustrated  on  the  example  of  the 
characteristic  singular  integral  equation  of 
the  first  kind: 

1 

1-  r  pCOdt 

-  =  f<x},  x  eC— 1,1-}  <1} 

n  J  -t  —  x 
--1 

Using  143,  we  look  for  the  solution  in  tf.e 
following  form: 


AiwJLCt>+Cl-t2>3/2  ^ 


t^ft)=  !»3<-t)=a-o“1/2<i+t)3/2 

w2<t>-  w4<-t>=Cl-t>1/2Cl+03/2. 

The  constants  <p n  Cn=0,  oa>  independently  on 

the  class  of  solutions  are  given  by  the 
following  expressions: 

f  1  f<x}P-®^3,-3^Cx} 

*’  8P"«;  ""'-I  a-S>~* 


A  -  f  fr,-3/2,-3/2  I2..  2. -3/2.  _ 

pn+3"  J  lPn+3  <x>J  Ci_x  5  dx= 


2  5 

F^Ck  +  p 


4<2k+3}k! <k+3} ! 


<n=0,oo} 


The  constants  A^  ci=l, 4}  are  dependent  on 
the  class  of  solutions: 

a>  Tor  the  unbounded  at  the  ends  of  <— 1,1} 
solution  under  the  condition 
i 

-  [  f>Ct>dt  =  1  <S> 


garanting  the  unique  solution  wo  obtai,  : 

1  7  3f„ 

A  =  -  ~  +  f  +  -  f  -f  +  — 

2  °  4  1  2  128p- 


a2=  -  +  -  f  +  -  f - 

4  2  8  25<5p 


a.  =  i-fn —  r  +r, - 

0  2  1  2  64p„ 


a4=  -  +  “  V  “  fi - 

*4  2  °  8  1  2S6p3 

b>  Fo'  the  solution  unbounded  at  the  left 
end  and  bounded  at  the  right  end  of  01,1} 
we  obtain: 

V0'  A2=cf0+2W'4’ 


=cVt0>/2, 


V  <-3f0+2fi+f2>/4 


'  ar  the  solution  bounded  at  both  ends 
*.'<  0.^4.  A2=<f1+f0>/2,  A4=Cf1-f0>/2, 

i  r  fCx>x -dx 

V  ~  J  '  €fc,a0'*'2> 

n  J  Cl-x  } 

-1 

j  We  csv  find  also  the  solution  of  the 
•  tior.  Ci,}  i,t  some  untraditional  classes, 
r  examj  le,  for  the  solution  with  the 
hounded  at  both  ends  derivative  we  recej  ve 

A1=A2=A3=A4=° ’ 

if  the  existence  conditions  are  fulfilled 
153:' 

fk=0,  k-0,1,2. 


V.  CONCLUSIVE  REMARKS 


The  proposed  approach  can  be  used 
also  for  solving  characteristic  singular 
equations  of  the  secohd  kind  and  for  solving 
complete  singular  equa.,.<ons  of  the  first  and 
the  second  kinds  with  Cauchy’s  kernel.  In 
the  comparison  with  the  famous  methods  the 
proposed  one  has  some  advantages  uhich  are 
stipulated  by  the  common  form  of  the 
solution  <2> 

Finally,  If  fCx56C1t-l,lJ,  then  the 
series  <2>  uniformly  converges  on 

-*1/V 

I-l+e,i+c3,  0<e<l,  and  +>_=OCn  },  n  — *  co. 
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ABSTRACT-  A  finite  differcs.e  solution  is  obtained  for  the 
time  dependent  viscous  incompressible  2-dt:riens;o.'ialflow  past  a 
longitudinally  oscillating  circular  cylinder. A  Navrei-Stuses  equa¬ 
tion  of  finite  difference  form  s  solved  by  moving  gnu  system, based 
on  a  time-dependent  coordinate  transformaiion.Tho  solution  de¬ 
scribes  the  development  of  the  vortex  street  developed  bemud 
the  cylinder  when  cylinder  remains  stationary.The  time  depen¬ 
dent  lift  and  drag  coefficients  are  obiained.The  power  spectra 
of  the  drag, lift  and  displacement  is  also  reported.Thc  computer 
results  predict  the  lock-in  phenomenon  which  occurs  when  os¬ 
cillation  frequency  is  around  double  the  natural  vortex  sh  -Iding 
frequency. 

INTRODUCTION 

The  understanding  of  the  characteristics  of  vibiations  induced 
by  vortex  sitedding  is  of  great  importance  ir  (he  design  of 
structures  such  as  heai  exchangers, offshore  platforms, power  ca¬ 
bles,  etc.The  determination  of  the  forces  acting  on  a  cylinder 
undergoing  harmonic  in-line  oscillations  is  of  special  interest  in 
acroelaslicity  as  well  as  for  a  basic  understanding  of  the  fluid  me¬ 
chanics.  Information,  about  the  in-line  oscillations  of  a  cylinder 
m  uniform  flow  has  not  been  studied  extensively.IIowever.only  a 
few  studies  have  been  made  for  a  circular  cylinder  oscillating  in 
a  uniform  flow[l-4]. 

Tiie  numerical  simulation  of  steady  flow  past  a  circular  cylinder 
undergoing  in-line  and/or  transverse  oscillations  through  the  use 
of  two-dimensional  unsteady  Navier-Stohes  equations  was  taken 
by  [5]  for  relatively  small  amplituoes.*l.cccntly, numerical  solutions 
of  unsteady  flow  about  stationary  and  oscillate  cylinder  ha* 

been  obtaincd[6-9]. 

THE  GOVERNING  EQUATIONS  AND  NUMERICAL 
MEPHOD 

The  non  dimensional  governing  Navicr  Stokes  equations,  writ¬ 
ten  in  non  conservative  form  and  expressed  m  the  dimensionalless 
quantities, are 

divV  =  0  (1) 

+  (V  •  V)  V  =  — gradp  +  ~  AV  (2) 

where  V  =  ic,  v)  is  the  velocity, and  p  the  pressure.  Rc  de¬ 
notes  the  Reynolds  number  based  on  the  velocity  of  tln  ii-uioim 
flow,  U,  and  the  diameter,  d,  of  the  circular  c_,..i  „o;.J  no  refer¬ 
ence  scales  for  non-dimcnsionalization  were  d,  U,  d/6’,  pU‘  for  the 
length, velocity, time  and  pressure, respectively. 

The  numerical  techniques  adopted  here  are  based  on  the  well- 
known  Marker  and  Cell(MAt^method, which  was  developed  by 
[10].T!ic  Poisson  equation  for  the  pressure, derived  by  taking  the 
divergence  of  (2).  All  the  spatial  derivatives  except  those  of  the 
convection  terms  are  approximated  by  second-order  central  dif¬ 
ferencing  schcmc.Thc  non-Iincar  terms  arc  represented  by  means 
of  a  third  order  upwind  schcmc[ll], 

in'il\  -  -  2/'*>  +  v.  -  10/.-«  +  (f.  >  0) 

1  0zh  -  U,{- 2/,+J  +  I0/1+l  -  9/,  +  2 -  f-J/Gh  {C,  <  0) 

P) 


where  h  is  grid  scale.The  Poisson  equation  for  the  pressure  is 
solved  itcrativcly  by  employ  ...0  ..  .tiodifed  SOR  method.  For  the 
mar  Jiir.g  Navier  Stokes  equation,  the  semi  implicit  scheme  which 
is  equivalent  to  the  Euler  ’.awkward  schemc-is  used  to  integrate 
temporally. 

In  this  paper, the  followii  ,  co-ord..,ate  transformations,  which 
includes  the  time  variable  are  introduced 

?  =  S(x,y,t) ,  rj  =  T){x,y,t>  ,  r  =  r{x,y,t),  (4) 

here  x  and  y  are  the  Cartesian  co-i  ..mates  and  iqs  the  time  in 
the  physical  domain,  £  and  rj  are  the  space  co-ordinates  acd  r  the 
time  in  the  computational  domain. 

The  transformation  of  ‘he  cooidinate  derivatives  arc  given  by 


\0X] 

'  Sr  Rx  rx  ' 

r*i 

o„ 

- 

&  %  n 

9, 

o, 

.  6  Rt  Tt  . 

[9, 

where  subscripts  denote  the  partial  derivative*. The  time  variable 
is  treated  as 

r  =  t ,  tt  =  ln  =  0  (6) 

Substituting  equation(6)  into  equation(5),one  can  obtain 


[9x1 

O 

1 

£ 

[9(1 

J 

-xn  xt  0 

9, 

9,  J 

.  XnVr  -  V(Xr  V(XT  -  xi’Jr  j  . 

.  Or  . 

where  (s,,jr)  denotes  the  vcloeity  'actor  of  a  grid  point  and 
J  is  the  Jacobian  for  the  space  co-ordinate  transformation.  The 
convective  terms  in  the  Navici  equations  will  be  expressed 

as; 

9(  +  udz  +  v0y  =  9r  +  j[{(u  — VT  ft;  - 

+{(y  -  Vr)X(  -  («  -  (8) 

the  transformations  given,  by  the  equalion(S)  implies  th’*  :’.t 
moving  boundaries  in  the  physical  domain  become  stalioi  » 
the  computational  domain. 

RESULTS  AND  DISCUSSION 

The  entire  compulation  were  run  on  a  Fujit.u  FACOM  VP200 
Super  Computer  fox  the  Reynolds  number, Rt-  1000.  The  re¬ 
sults  of  the  stationary  circular  cylinder  arc  presented  first  to  al¬ 
low  comparison  with  the  experimental  visualization. The  result* 
of  the  unsteady  flow  for  a  cylinder  oscillates  in  the  longitudinal 
direction  arc  then  presented.  Figure  1(a)  tcpicsenl*  lilt  Jcvel 
opment  of  the  flow  pattern  computed  for  a  statiunaiy  cylinder 
at  time  t=100.Thc  dev  lopmcn!  of  the  vurtex  si  ending  is  clearly 
oCcn.Two  secondary  vortices  arc  formed,  foil  ...wed  ...  a  smaller  sin 
glc  down  stream  of  tiie  separation  pwinl.As  the  void.es  grow  *ym 
mctrically.the  shear  layer  joining  the  separatioii  p  d..t  to  one  of 
the  vortices  begins  to  develop  instabilities  and  is  drawn  across  the 
wake  in  response  to  the  base  pressure  reduced  by  the  action  of 
the  vortex  growing  across  the  v.ake.The  stretching, diffusion, and 
dissipation  of  vorlicily  break  up  tile  deform. ,rg  turbulent  sheet 
and  thereby  the  further  supply  of  circulation  to  the  vorie,<  whose 
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rateof  growth  has  already  been  reduced  to  its  minimum.Thc  vor¬ 
tex  across  the  wake  still  continues  to  grow  and  entrains  part  of 
the  oppositely  signed  vorticity.The  shedding  process  for  the  sec¬ 
ond*  vortex  does  not  commence  until  the  circulation  in  its  feed¬ 
ing  sheet  decreases  touts  minimum, making  the  sheet  most  sus¬ 
ceptible  to  rapid  diffusion.Thc  eddies  that  develop  in  the  near 
wake  during  a  given  period  undergo  successive  interactions  among 
themselves.This  configuration  agrees  with  the  experimental  and 
numerical  resulls.The  unsteady  lift  coefficient  oscillates  periodi- 
cally.The  perodic  properties  of  the  flow  are  clearly  shown  by  the 
time  dependent  evolution  of  the  lift  coefficient  as  shown  in  figure 
1(b). 

The  numerical  solutions  of  longitudinal  oscillations  of  circu¬ 
lar  cylinder  was  performed.These  results  are  for  the  case  of 
the  reduced  velocity  Vr  =3.0,5.0j5.25,7.2.Here)  VT  is  defkrd  as 
V,  =  U j fcd,  U  —  Um  where  17m  is  the  maximum  velocity  oi  he 
oscillating  cylinder, fc  the  cylinder  frequency.  The  amplitude  ot 
oscillation  was  set  to  be  A(x/d)  =  0.14, 0.17, 0.2, 0.26..where  x 
refers  to  the  displacement  in  x-direction.Figure  1(c)  explains  the 
flow  visulization  of  the  wake  of  oscillating  cylinder  reveals  differ¬ 
ent  patterns  than  the  usual  alternate  Karman  vortex  strcet.In 
the  lock-in  range  the  influence  of  the  flow  oscillation  is  very 
strong.During  one  period  of  the  flow  oscillation, the  vortex  re¬ 
mains  close  to  the  cylinder  as  it  forms  and  grows, even  close  in  fact 
than  before  lo;idng-on.The  interesting  feature  of  the  phenomenon 
is  the  cylinder  moves  down  stream  from  its  mid, paction, the  rel¬ 
ative  velocity  about  the  cylinder  increases  from  zero  '.o  U.Ai  vae 
cylinder  reverses  its  direction, the  relative  velocity  m/ leases  and 
reaches  a  value  oL2U  at  the  mid  position  of  oscillath  n.-The  vor¬ 
tices  move  away  from  the  cylinder  under  the  influence  of  the 
uniform  flow, symmetrically  at  first  and  then  becoming  gradu¬ 
ally  asymmetrical.  The  resulting  pattern  is  very  complex  .The 
streamwise  interval  of  the  vortices  becomes  large.Accordingly  the 
value  of  lift  is  changing  temporally  and  becomes  complicated  with 
including  disturbances  and  different  from  the  simple  sinusoidal 
curve  and  are  shown  in  figure  l(b)and  2.The  mean  inline  force 
and  its  amplitude  of  oscillation  were  found  to  increase  with  in- 
ci  asing  amplitude.The  power  spectra  of  the  drag, lift  and  dis¬ 
placement  is  illustrated  in  figure  3.  Synchronization  can  be  seen 
when  the  driving  frequency  approaches  in  a  range  around  double 
the  Strouhal  frequency. 
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Abstract  r  The  paper  deals  with  flow  and  heat  transfer  induced  by  a 
rotating  circular  disk  when  it  is  subjected  to  a  mixed  thermal 
boundaty  condition.  By  similarity  analysis  the  governing  equations  are 
reduced  to  a  system  of  ordinary  differential  equations.  A 
transformation  group  has  been  found  under  which  the  reduced 
governing  equations  and  the  homogeneous  boundary  conditions  arc 
invariant.  The  thermal  boundary  condition  is  characterized  by  a 
nonnegative  parameter  m;  m=0,l,»  correspond  to  the  eases  of 
prescribed  temperature,  prescribed  heat  flux  and  prescribed  heat 
transfer  coefficient  (radiation  boundary  condition)  respectively.  If  one 
wants  to  find  solutions  for  different  values  of  m,  there  is  no  need  to 
compute  solution  for  each  value  of  m.  If  we  know  the  solution  for  any 
particular  value  of  m,  then  this  solution  can  be  used  to  find  the 
solution  for  any  value  of  m  by  a  simple. method  with  the  .mlmf  the 
transformation  group. 

1.  INTRODUCTION 

The  free  convection  and  mixed  convection  on  healed 
horizontal  plates  has  received  a  great  deal  of  attention  (1-6J.  These 
studies  assume  that  the  temperature  at  the  plate  is  prescribed  or  the 
heat  flux  across  the  plate  is  prescribed.  The  study  of  convection 
problem  when  the  plate  is  subjected  to  a  mixed  thermal  boundary 
condition  [7]  has  not  received  sufficient  attention.  The  axisymmctric 
forced  convection  due  to  a  rotating  disk  %vas  studied  first  by  Von 
Karman  [Sj  and  later  Cochran  (9)  improved  the  numerical  solution. 
In  this  paper  we  present  an  analysis  of  the  convection  problem 
induced  by  a  rotating  disk  which  is  subjected  to  a  mixed  thermal 
boundary  condition. 

II.  ANALYSIS 

The  convection  over  a  rotating  horizontal  disk  subjected  to  a 
mixed  thermal  boundary  condition  is  governed  by  the  boundary  layer 
equations, 

Sj.  M  *  4-  M  '  0  (1> 

dr  a  z 


3  u  3  u 
u  ~  +  w  _ 
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with  the  boundary  conditions, 
ii  -  0,  v  =  rw.  tv  =  0  at  z  =  0 
u  -»  0,  v  -<■  0,  p  -*  p„,  T  *»  T„  as  z  -*  » 


(T-rj 


o,  r2  at  z  0 


where RV  and  iv  arc  the  velocity  components  in  the  radial,  azimuthal 
and  axial  directions  respectively,  T  Is  the  temperature,  p  is  the 
pressure,  p_,  T_,  pm  are  the  ambient  pressure,  temperature  and 
density  respectively,  w  is  the  angular  velocity  of  the  rotating  disk. 


The  symbols  y,g,B,c  and  Pr  denote  me  kinematic  viscosity, 
gravitational  accleralion,  coefficient  of  thermal  expansion,  specific 
heat  and  Prandtl  number  respectively,  a„,  at  2  0,  a2  2  0  arc 
prescribed  constants. 

Let  us  introduce  the  similarity  transformation 

n  -  zIL,  u-YL  Pin),  v-iLL  C[rj),  m 

(9) 

p  p.  ■  H(o),  t  r.-.iij  e(n) 

where  A  -  gB.y’  and  L  is  of  dimension  length  to  be  Jeietmined  from 
the  thermal  boundary  condition  (8)  in  the  manor  as  explained  a  little 
later.  The  equations  (1)  to  (8)  become 

F“  +  2FF  -  F2  +  G2  -f  2H  =  0  (10) 

G“  -f  2  (FG’-FG)  =  0  (11) 

H*  +  0  =  0  (12) 

6"  +  2P.  (FO'-FO)  +  Pr  E  (G-!+F!)=0  (13) 

F(0)  =  F(0)=0.  G(0)  =  n  (14) 

F(eo)  =  G(o°)  =  H(t»)  =  0(«)  =  0  (15) 

(1-m)  0(0)  -  m0’(O)  =  1  (16) 

where  the  primes  denote  differentiation  with  respect  to  /?, 

0  =  idV/yis  the  rotation  parameter  (17) 

E  =  ALyVe  is  the  Eckert  number  (18) 

L  is  the  positive  root  of  the  equation, 

ay!L‘  -  a.L  -  a,  =  0  (19) 

and  m  =  a,/(a,+La0). 

The  equation  (19)  has  a  unique  positive  root  by  Descartes  rule  of  sign 
for  a,  >  0.  a,  2  0.  The  solution  of  the  boundary  value  problem 
(10)-(16)can  be  obtained  by  shooting  method,  for  any  value  of  m  2: 
0.  It  is  interesting  to  note  that  the  solutions  corresponding  to  different 
values  of  m  arc  dependent  as  stated  in  the  following  properties  ; 

Properly  I  :  The  equations  (I0)-(I5)  arc  invarient  under  the 
transformation. 

n  =  An.  n*  =  n/A2,  E'  =  e/a 

F(/j‘,Q',E")  =  F(/j,Q,E)/A,  G'fa'.fi'.E’)  =  G(/j,O.E)/A2  (20) 

H'(0'.fi'.E')  =  H(/7.Q.E)A,t  0\n'W)  =  0(/?.O.E)/As 
where  A  is  any  positive  real  number. 

Properly  2  :  If  F(/7,0.E).  G(/7,0.E),  H(/).fl,E)  and  0(/7,O,E)  is  the 
solution  or  the  boundary  value  problem  (I0}-(16)  for  any  particular 
valuc.of  m,  say  mt,  then  the  solution  for  any  value  of  m  is  given  by 
eqns.  (20)  provided  A  is  the  positive  root  of  the  equation, 

A‘  -  (l-m)  A  0(O.O.E)  +  m  0-(O.O.E)  =0  (21) 

Property  3  ;  If  the  solution  of  the  boundary  value  problem  (10)-(16) 
Is  same  for  any  two  distinct  values  of  m,  then  the  solution  is  same  for 
all  values  of  m. 

III.  DISCUSSION  AND  CONCLUSION 
The  study  of  convection  over  a  horizontal  rotating  disk 
subjected  to  a  mixed  thermal  boundary  condition  has  been  reduced 
to  solving  the  boundary  value  problem  (10).(lf>).  The  boundary 
condition  (16)  includes  the  following  as  special  cases  : 

(1)  Prescribed  temperature  (PT) 

Here  a,  >  0.  a,  =  0,  a.  >  0 

Hence  L  =  (a.Maj)'  \  m=f)  and  equation  (16)  becomes 

0(0)  =  I  (I6n) 

(2)  Prescribed  heat  llux  (PI IF) 

Here  a„  =  0,  a,  >  0.  a.  >  0 

Hence  L  =  (.ii'/Li,)'*.  m— I  and  equation  (16)  becomes 

0'(O)  *  -I  ‘  (16b) 
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(3)  Prcscribcd  hcat  transfer  coefficient  (PHTC) 

Hcrca.  <  0,  a|  >  0,  a t  =  0. 

Hence  L  —  m  =  «>  and  equation  (16)  bu>.umt.s 
0(0)  +  0'(O)  =0 

The  local  Nussclt  number  Nu„  denned  by 

N"'_  I  co  becomes 


Nu, 


r  0  (0) 

'r  tm 

(Aaja^  r  (-0  (0)] 
(AaJaJ'*  MO) 


r!al 


for  PT 
for  PHF 
for  PHTC 


(16c) 


The  numerical  results  for  different  values  of  the  parameters 
fl,E,m  and  Pr=0.72,  arc  given  in  Tables  I  and  II.  All  the  quantities  of 
interest  increase  with  m.  The  temperature  profiles  arc  shown  in 
Figures  1(a)  1(c).  It  is  found  that  in  the  absence  of  dissipation, 
increase  in  rotation  (fi)  decreases  the  temperature,  whereas  increase 
in  dissipation  (E)  increases  the  temperature  near  the  disk  and  it  is 
more  pronounced  with  £1.  Increase  in  m  increases  the  temperature 
largely,  and  decreases  the  thermal  boundary  layer  thickness.  Table  III 
gives  the  values  of  A  needed  for  transition  from  one  ease  to  the  other 
witinthc  aid  of  equation  (20).  The  following  example  illustrates  the 
transition. 

For  PT  with  £1=1,  E  =  0.1 

0'(O)  =  -0.7451,  F(0)  =  1.3722 
G’(0)  =  -0.9284,  H(0)  =  0.973S 
which  gives 

A  =  0.9521,  £1  =  1.1031.  E  =  0.1050 
6(0)  =  1.2779,  F(0)  =  1.5S97 
G'(0)  =  -1.0755,  H(0)  =  I.IS4S 

A  =  0.7451,  £1  =  1.8012.  E  =  0.1342 
0(0)  =  4.3544,  F(0)  =  3.3172 
G'(0)  =  -22444,  H(0)  =  3.1595 


for  PHF 

for  PHTC 


Table  II 

Values  of  F(O),  -  G’(0)  and  IH0)  for  various  values  of  £l,Eand  m 


£2 

E 

m 

F(0) 

-G’(0) 

11(0) 

0 

1.0966 

0 

0.9933 

0.0 

0.5 

1.1778 

0 

1.0927 

1 

1.2603 

0 

1.1958 

0.0 

00 

2.5273 

0 

3.0241 

0.9976 

0 

1.1023 

0 

0.1 

0.5 

1.1898 

0 

1.1046 

1 

1.2795 

0 

1.2171 

00 

2.6611 

0 

3.2329 

0 

1.0992 

O.OS78 

0.9929 

0.0 

0.5 

1.1  S03 

0.0S99 

1.0921 

1 

1.2625 

0.0919 

1.1951 

0.1 

CO 

2.52S0 

0.1159 

3.0216 

0 

1.1051 

0.0380 

0.9973 

0.1 

0.5 

1.1924 

0.0903 

1.1043 

1 

1.2821 

0.0925 

1.2168 

oo 

2.6626 

0.1180 

3.2317 

Table  III 

Values  of  A  for  Transition 


IT' 

PHF 

piitc  I 

PT 

1 

[-0'(O,£),E)P 

-©•(O.n.E) 

PHF 

|0(O,£1,E)|"5 

1 

i/0(o.n,E) 

PHTC 

[0(O,O.E)||!S 

(0(O,fi.E)] ,K 

i  | 

Table  IV 

Critical  Values  of  I’r  for  E  =  0 


£1 

F(0) 

-C.’(0) 

11(0) 

Pr 

0.0 

0.6570 

0.0000 

0.7100 

2.4372 

0.1 

0.6616 

0.0669 

0.7101 

2.4215 

0.5 

0.7653 

0.3552 

0.7138 

2.1213 

1.0 

1.04S1 

0.8004 

0.7252 

1.6273 

It  is  interesting  to  know  that  the  solution  is  independent  of  m  for 
certain  values  of  Pr,  £1  and  E  Table  IV  shows  the  values  of  Pr  for 
E=0;  for  which  the  solution  is  independent  of  m. 
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Table  I 


Values  of  0(0),  -0’(O),  -0'(O)/0(O)  for  various  values  of  £1,E  and  m 
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ni 
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■39 

-0'(O)/0(O) 
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1.0000 
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0.0 

0.5 
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0.8734 

1 
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Bil 
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CO 
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Fig. I  The  temperature  profiles  for  (a)  IT  (b)-I’IIF  tej  I’llTC 

( - £1  =  0, - £1=1) 
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TIME  AND  SPACE  SELF-ADAPTIVE  NUMERICAL  METHODS 
FOR  CHEMICALLY  REACTING  FLOWS 
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Abstract  Self  adaptive  numerical  solution  methods  for  com¬ 
bustion  problems  are  developed  arid  results  are  presented  for 
physically  idealized  situations.  First,  the  treatment  of  the 
time-dependence  is  discussed  separately,  as  is  the  development 
and  implementation  of  spatial  adaptive  gridding  techniques, 
representative  numerical  results  based  these  two  major  ingre¬ 
dients  of  any  numerical  technique  for  the  simulation  of  ignition 
problems  arc  presented.  Secondly,  time-dependence  and  spa¬ 
tially  two-dimensional  variations  arc  treated  simultaneously; 
as  a  representative  example  self-ignition  in  a  premixed. reac¬ 
tive  mixture  is  numerically  simulated. 

1.  INTRODUCTION 

In  combustion  and  related  areas  numerical  techniques  arc  need¬ 
ed  which  arc  able  to  produce  high  spatial  arid  temporal  reso¬ 
lution  of  flame  structures  and  evolutions:  only  such  ability  will 
provide  enhanced  insight  into  the  many  modes  and  ingredients 
of  combustion  processes.  The  use  of  adaptive  methods,  i.e.,  of 
methods  that  “automatically”  adapt  the  computational  mesh 
in  some  “optimal”  way  to  the  specific  problem  under  consid¬ 
eration,  is  the  desirable-numerical  approach  to  all  engineering 
problems;  it  is  a  must,  however,  for  the  computation  of  re¬ 
active  flows.  The  physical  reason  for  this  is  the  heat  release 
associated  with  any  combustion  process.  As  a  consequence  of 
the  heat  release,  profiles  of  quantities  involved  in  combustion 
processes  typically  exhibit  steep  gradients  and  strong  curva¬ 
ture,  thus  necessitating  the  use  of  adaptive  methods  in  order 
to  control  both  the  temporal  arid  spatial  discretization  errors. 
For  time  independent  steady  problems  in  combustion,  adap¬ 
tive  methods  have  proven  useful  and  arc  being  used,  sec  c.g. 
/ 1  3/.  Apart  from  notable  exceptions  /4.o/,  little  attention 
has  been  given  to  time  dependent,  two-dimensional  combus¬ 
tion  problems.  Therefore,  in  the  present  paper  wc  outline  pos¬ 
sible  approaches  to  fully  implicit  adaptive  algorithms  suitable 
for  successfully  tackling  the  numeric!  simulation  of  unsteady, 
spatially  two-dimensional  reactive  flows. 

Firstly,  wc  consider  briefly  techniques  suitable  for  tackling 
the  timc-dcpcndcncc  of  combustion  phenomena  and  present 
two  spatially  one-dimensional  examples,  viz.,  a  pulsating  flame 
and  a  self  ignition  process  taking  place  in  a  non  prernixed  flow. 
Secondly,  we  consider  spatially  two  dimensional,  steady  prob¬ 
lems  focusing  attention  on  the  development  of  self  adaptive 
meshing  procedures.  As  a  representive  example,  numerical 
results  are  presented  for  a  laminar  flame  propagating  in  a 


strained  mixing  layer.  Thirdly,  wc  combine  the  scpcratciy  de¬ 
veloped  ingredients  for  the  simulation  of  time-dependent  and 
spatial  effects,  arid  consider  truly  time-dependent  combustion 
in  two  space  dimensions.  For  the  latter  case,  hot-spot-like  self- 
ignition  taking  place  in  an  originally  cold,  reactive  mixture 
provides  the  physical  basis  for  a  numerical  example. 

2.  FORMULATION 
2.1  Differential  equations 

The  general  class  of  differential  equations  to  be  considered 
herein  can  be  written  in  the  form 

=  f(x,  y,  1,  u,  ux,  uy,  uXIurr,  ury)  for  (x,y)  6  ft,  i>  0, 
r(x,  V,  t,  u(x,  y,  f),  u-(x,  y,  1),  u,(x,  y,  t))  =  0 

for  (x,y)  6  t  >  0, 

u(x,  y,  0)  =  v(x,  y)  for  (x,  y)  g  ft  U  3D, 

(1) 

where  u,  f,  r  and  v  arc  jY-vcctors,  x  and  y  arc  the  carte¬ 
sian  space  coordinates  and  t  the  time;  Si  denotes  a  rectangu¬ 
lar  domain  of  integration  and  dSl  its  boundary.  Equation  (1) 
represents  a  nonlinear  parabolic  mixed  initial  boundary  value 
problem  for  the  Ar  dependent  variables  represented  by  u. 

2.2  Difference  equations 

The  integration  of  system  (1  j  with  respect  to  time  is  performed 
in  steps  starting  with  specified  profiles  [  which,  in  general, 
should  satisfy  the  governing  equations  J  at  time  level  n  =  0 
wiih  t  -  t°  =.  0.  Solutions  to  (I)  arc  sought  at  the  subsequent 
time  levels  (n  —  1,1  —  1*},  (n  —  2,  t  —  t'),  and  so  on,  with 
0  ss  t°  <  t1  <{*<  --•<  t°  <  where  here  and  below 
the  superscript  n  is  used  to  identify  quantities  at  time  level 
n,  n  —  0,1,2,  .  The  integration  of  (1)  is  considered  com¬ 

plete  if  cithei  a  specified  level  nmax  oi  a  specified  time  fm»i  b 
readied.  With  respect  to  the  space  variables  x  and  y,  system 
(b  is  discretized  on  a  mesh  M"  of  grid  points, 

M"  =  (2) 

Note  that  the  mesh  may  oi  may  not  be  a  simple  tensor -product 
gnd.  In  fact,  for  the  simulation  of  combustion  problems  it 
regular  grids  arc  desirable  which  locally  and  instantaneously 
concentrate  grid  points  where  they  arc  needed,  namely  in  re¬ 
gions  or  spots  of  high  spatial  and  temporal  activity.  A  suit- 
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able  adaptive-meshing  strategy  is  outlined  below.  If  the  spa¬ 
tial  domain- of  integration  is  infinitely  large  with  respect  to 
one  or  both  coordinate  directions,  for  example  extending  from 
■E  —  — oo  to  x  —  +oo,  then  —  a,  and  at  are  chosen  as  positive 
and  sufficiently  large  to  ensure  that  the  conditions  at  cither 
boundary  can  asymptotically  be  satisfied  /G /,  an  infinite  do¬ 
main  of  integration  with  respect  to  y  is  treated  similarly. 

3.  NUMERICAL  METHODS 

Subsequently  the  symbols  U  and  F  will  be  used  to  denote 
the  m  x  iV-vectors  which  result  from  the  spatial  discretiza¬ 
tion  of  the  iV-vectors  u  and  f,  respectively.  For  the  solution 
of  time-dependent  problems  at  each  time  step,  or  steady-state 
problems  (not  considered  herein),  Newton’s  method  can  be  ap¬ 
plied  to  thesystem  of  nonlinear  equations,  F(U),  which  results 
from  the  discretization  of  the  governing  equations.  Note  that 
both  U  and  F  depend  on  thc-particular  time  level  n  under 
consideration.  Thus,  the  linear  system 

J(Ufc)(Ufc+1-Ufc)  =  -ui*F(Ui),  Jt=0,l,...  ,  (4) 

is  solved  where  U*  denotes  the  solution  after  k  Newton  it¬ 
erations,  and  w*  and  J( Ufc)  arc  the  damping  parameter  and 
the  Jacobian  matrix,  respectively,  based  on  13*.  The  damping 
strategy  /7.S/  allows  the  Jacobian,  which  is  generated  numer¬ 
ically,  to  be  re-cvcJuatcd  only  periodically  /S/. 

Upon  discrctising  the  governing  equations  only  with  re¬ 
spect  to  space,  one  is  left  with  a  large  systems  of  DAEs  (differen¬ 
tial-algebraic  equations).  In  recent  years  various  algorithms 
have  been  developed  for  the  solution  of  such  systems  as  well 
as  complete  software  packages.  Examples  for  the  latter  arc 
DASSL  /9 /  and  LIMEX  /10,11/  developed  at  the  Sandia  Na¬ 
tional  Labs.,  USA.  and  at  the  University  of  Heidelberg,  West 
Germany,  respectively.  DASSL  uses  backward-differentiation 
formulas,  LIMEX  a  newly-  developed  extrapolation  method 
particularly  designed  to  deal  with  stiff  systems.  Since,  in  a 
sense,  software  packages  arc  multi-purpose  codes,  they  arc  not 
optinvzcd  with  regard  to  a  specific  problem  under  considera¬ 
tion.  Therefore,  we  have  developed  a  new  code  particularly 
designed  for  the  solution  of  systems  of  DAEs  that  arise  in  or.e- 
dimensional  combustion  problems  which,  however,  uses  some 
of  the  basic  elements  of  LIMEX. 

Regardless  whether  Newton's  method  or  the  method  of 
lines  is  employed,  the  solution  of  system  (1)  at  time  level  n 
depends  on  the  solution  at  level  n  —  I  taken  at  the  grid  points 
of  mesh  M“.  Since  in  general  the  grids  at  levels  n  -  I  and  n 
are  not  the  same,  the  solution  obtained  at  level  n  —  1  on  grid 
Mn_1  must  be  interpolated  onto  grid  M"  which,  regardless 
of  the  interpolation  procedure,  introduces  an  additional  spa¬ 
tial  discretization  error  into  the  algorithm.  Wc  use  piecewise 
monotonic  cubic  Hcrmite  interpolation  /12/. 


4.  ADAPTIVE  SELECTION  OF  GRID  POINTS 

The  procedures  and  criteria  for  the  adaptive  selection  of 
grid  points  arc  of  critical  importance  to  the  efficiency  of  the 
algorithms  that  are  used  for  the  solution  of  combustion  prob¬ 
lems,  In  particular,  strategies  arc  required  that  place  the 


gnJ  points  where  they  are  needed  in  order  iw  luuinl  iL  lout! 
space  discretization  error.  In  generalization  of  pioculutcs  out 
lined  previously  for  the  adaptive  computation  of  steady  one 
dimensional  combustion  problems,  for  any  fixed  lime  level  n 
vve  cquidistribute  the  mesh  M”  on  intervals  k" ,  k ”  with  re 
spcct  to  a  non  negative  weight  function  IF”  and  a  constant 
C".  Here  the  intervals  in  the  i  and  y  direction,  A"  and  are 
of  lengths  characteristic  of  the  local  and  instantaneous  spacing 
of  mesh  points  in  the  vicinity  of  point  (x",t/").  For  instance, 
for  the  x  direction  IF’1  is  selected  such  that 

f  \Vndx  =  C\  (5) 

A r 

where  m  =  mn.  Specifically,  the  weight  function  IF”  is  chosen 
as 

IF"  =  max  W£,  (M 

where 


.  iy_jl  I  <-k  <  jY 

yn|maxw*  — 

,n _ 

iV+t  c”[max(3t'jb/3x)  -  min(3t'*/3x)j  ’ 

1  <  k  <  X, 


(6.6) 

(G.c) 


and 

(M 

In  Eqs.  (G.b)  and  (G.c)  “min”  and  “max”  stand  for  the  min¬ 
imum  and  maximum  value  in  the  interval  a,  <  x  <  ac  of  the 
respective  quantity,  and  g"  and  c"  arc  positive  scaling  factors; 
their  numerical  values  arc  less  than  unity  if  in  Eq.  (5)  Ca  =  1 
is  employed.  In  Eq.  (G.d),  (Pisa  positive  constant  which  rep¬ 
resents  the  maximum  size  of  any  interval  ht.  To  prevent  the 
size  of  adjacent  mesh  intervals  from  varying  too  iar*;41y,  we 
require  that  at  any  time  level  n  the  mesh  be  locally  bounded 
.viz., 

R~l  <  h,/hj-i  <  It,  (7) 

where  it  is  a  constant  greater  than  one.  The  cquidistribution 
procedure  with  respect  to  the  y  direction  is  performed  analo¬ 
gously.  The  adaptive  gnddmg  procedure  to  be  carried  out  at 
each  time  level  n  essentially  consists  iff  7  steps  which,  because 
space  is  restricted  in  the  present  volume,  can  It  presented  only 
in  the  full-length  verson  of  the  paper. 


5  EXAMPLES.  RESULTS  AND  DISCUSSION 

As  a  first  example  wc  consider  a  problem,  the  so-called  test 
problem  A,  proposed  for  a  GAMM  Workshop  at  Technical  Uni¬ 
versity  Aachen.  Wot  Germany,  viz.,  an  unsteadily  propagat¬ 
ing  flame  with  one-step  chemistry  and  Lewis  number  different 
from  unity  /13 /.  The  governing  equations  are 


or 

m 

Of 
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where  T  and  1*  denote  a  normali.ted  temperature  and  mass 
fraction,  respectively,  and  where 


£_ 
2  Le 


Yexp(- 


l-a(l-T) 


)• 


(10) 


Time  t  and  space  variable  x  are  suitably  nondimensionalized. 
In  the  rate  expression  (10),  a  and  0  denote  a  nondimensional 
heat-release  parameter  and  a  nondimensional  activation  en¬ 
ergy,  respectively.  The  initial  conditions  are  given  by 


T  =  exp(x),  x  <  0,  (ll.a) 

Y  =  1  —  exp(£e  x),  x  <  0,  (11.6) 


and 


T  =  l,  x  >0, 

(ll.c) 

r  =  o,  x  >  o, 

(11-0 

the  boundary  conditions  by 

T  =  Y  —  1  =  0  as  x  -+  —oo, 

(ll.e) 

dT/dx  =  dY/dx  =  0  as  x  -t  +co. 

(11  •/) 

In  all  calculations  a  =  0.8  is  adopted;  0  and  Le  are  taken  as 
I  variable  parameters. 

As  one  example,  shown  in  Fig.  1  is  the  computed  propaga¬ 
tion  velocity  op  of  the  flame  as  a  function  of  time  for  Le  =  1.45 
and  0  =  32.  It  is  seen  that  after  a  short  initial  period  a  con¬ 
tinuous  limiting  cycle  results.  To  accurately  resolve  the  spatial 
structure  of  this  pulsating  flame  the  adaptive  meshing  proce¬ 
dure  outlined  above  requires  80  to  100  grid  points;  to  obtain 
comparable  resolution  with  an  equidistant  grid  as  many  as  800 
to  1000  grid  points  would  be  required.w 

As  a  second  example  we  consider  auto-ignition  in  a  non- 
prcmixed  flow  generated  by  directing  a  hot  air  stream  (T  ■=■ 
800A')  and  a  cold  fuel  stream  (T  =  300A")  towards  each  other. 


*  »  »  50  <o  »  «  , 


i 

Figure  1:  Oscillating  flame  velocity  vp  as  a  function  of  time  f. 


The  governing  equations  are  the  conservation  equations  of  over 
all  mass,  species  mass,  momentum  and. energy,  space  limita¬ 
tions  do  not  allow  to  present  these  equations  here.  Chem¬ 
istry  is  assumed  to  occur  via  the  overall  one-step  reaction 
p  j.  i ,02  — i  P.  For  a  detailed  discussion  of  appropriate  ini¬ 


tial  and  boundary  conditions,  and  the  physical  background  ref. 
/14/  should  be  consulted. 

As  a  representative  result,  Fig.  2  shows  temperature  pro¬ 
files  during  the  ignition  process.  It  isseen  that  a  continuous 
transition  takes  place  from  inert  mixing  at  initial  time  <  =  0  to 
a  steadily  burning  diffusion  flame.  The  steadily  burning  state 
is  reached  after  roughly  10  microseconds. 


Figure  2*.  Temperature  profiles  during  a  truly  time-dependent 
auto-ignition  process.  Data:  a  —  53.7  s  1 ,  p  —  40 
bars,  steady-state  ignition  point  at  a=58  7s  1  The 
frozen  initial  profiles  pertain  to  t-0,  the  other  pro¬ 


files  to 

t=1.01  10-9s,  3.82  10-9  s,  6.87  l(T9s,  1.57  10"8 
s,  3.43  10"8s,  7.66  1(T8s,  1.71  1(T7s,  3.86  10“7  s, 
9.01 10~7s,  2.25  10~G  s,  6.25  l(T6s. 


As  a  third  example  we  consider  a  flame  propagating  in 
a  strained  mixing  layer  Such  flames  can  be  generated,  for 
instance,  in  a  Tsuji  like  counterflow. geometry.  The  governing 
equations  for  this  problem  were  derived  by  Linen  /12/,  viz., 


DZ  dz  d2Z  d2Z 

UF  dx  V  dy  dx2  +  dxf-  ’ 


Tf-T0 


=  1  -Yf-Y0, 


z  =  S^F  jl  1  ~* 

5  +  1  1 


with -the  boundary  conditions 


y  -oo  :Yf  =  Z  =  0, 
y  ->  +co  :  YP  =  Z  =  1, 

*  _CC  :  ^  =  \  TYpTr^Yb^^’ 

X  ->  +00  :  zero  x  gradients  for  all  dependcnt  variables. 


(15) 


The  unknowns  in  this  problem  are  the  (constant)  burning-rate 
eigenvalue  up,  the  temperature  T,  and  the  mass  fiactions  of 
fuel  and  oxidiser,  Y[.  and  Y0,  respectively.  The  Damkdhler 
number  6  and  the  nondimensional  activation  energy  0  are  vari¬ 
able  parameters  to  be  specified,  for  the  results  presented  herein 
we  have  selected  5  =  0.5  and  0  —  5. 
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Shown  in  Fig.  3  is  the  computational  mesh  on  which  the 
final  solution  has  been  obtained  for  the  above  problem.  It  is 


y 


Figure  3:  Adaptively  generated,  converged  computational  mesh 
for  Example  3. 

T 


0 


y 

Figured  Surface  plot  of  temperature  for  Example  3. 

seen  tnat  the  mesh  has  a  tree-like  structure  due  to  the  gener¬ 
ation  of  individual  mesh  .elements  at  successive  levels  i  of  the 
adaptive  meshing  procedure.  As  one  example,  shown  in  Fig. 
if  is  a  surface  plot  of  temperature.  Notice  that  mesh  points  are 
concentrated  in  regions  where  the  temperature  exhibits  steep 
gradients,  and  where  the  surfaces  of  both  temperature  and  fuel 
mass  fraction  have  strong  curvature. 

6.  CONCLUSIONS 

We  have  developed  and  discussed  numerical  approaches 
having  all  the  ingredients  ncccessary  for  successfully  tackling 
problems  typically  arising  in  combustion.  Specifically,  empha¬ 
sis  has  been  laid  on  self-adaptive  gridding  procedures  appli¬ 
cable  to  time-dependent  two-dimensional  reactive  flows.  As 
examples  pulsating  flame  propagation,  auto-ignition  in  a  non- 
premixed  flow,  flame  propagation  in  a  strained  mixing  layer 
and  hot-spot-like  self-ignition  have  been  considered. 
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ABSTRACT  -  An  adaptive,  block-bidiagonal  finite  difference 
method  is  used  to  study  the  response  of  annular  liquid  jets  to  the 
injection  of  mass  into  the  volume  enclosed  by  the  annular  jet.  It  is 
shown  that  the  annular  jet’s  response  is  characterized  by  damped  os¬ 
cillations  in  both  the  convergence  length  and  the  pressure  of  the  gases 
enclosed  by  the  jet,  and  that  the  amplitude  and  number  of  these  oscil- 
lations  increase  as  the  initial  pressure  ratio  across  the  annular  jot  and 
the  pressure  of  the  gases  surrounding  the  jet  are  increased. 

I  INTRODUCTION 

Annular  liquid  jets  may  form  enclosed  volumes  if  the  pressure 
difference  between  the  gases  enclosed  by  and  surrounding  them 
is  overcome  by  surface  tension,  and  can  be  used  to  measure  the 
dynamic  surface  tension  of  liquids  and  burn  toxic  wastes  in  the 
volume  enclosed  by  the  annular  jet  [1]. 

The- equations  which  govern  the  fluid  dynamics  of  inviscid, 
isothermal,  annular  liquid  jets  were  derived  in  Reference  [2]. 
These. equations  are  asymptotic  to  terms  proportional  to  the  an¬ 
nular  jet’s  thickness-to-radius  ratio  at  tile  nozzle  exit  and  are  valid 
for  steady  and  unsteady  jets.  In  this  paper,  an  adaptive  block- 
bidiagonal  finite  difference  technique  is  used  to  study  the  dynamic 
response  of  annular  liquid  jets  to  the  injection  of  mass  into  the 
volume: enclosed  by  the  annular  jet  as  a  function  of  the  initial 
pressure  difference  between  the  gases  enclosed  by  and  surround¬ 
ing  the  jet,  and  pressure  of  the  gases  surrounding  the  annular 
jet. 


II  FLUID  DYNAMICS  EQUATIONS 

The  nondimensional  equations  governing  the  fluid  dynamics  of 
inviscid,  isothermal,  annular  liquid  jets  can  be  written  as  [1] 


<9U  ,  5F£U 
0t  +  8XJ  dz 
where 


(1) 


U  =  [m,  mR ,  mu,  mu]T,  F  =  [mu,  mRu,  mmi,  muv]^  (2) 

L  _  m  .  1  /dJ  „  „dR\  1 


U(t,0)  =  [1,1,1,  tan  0o)T 

Ft  =  u02/o  R^,  m  =  mju;2/ 2<7  RJ 

Cpn  -  CplVr,  CP  =  (p-  -  Pi)  R?/m-0u? 


iT 

w)\ 

(3) 

W 

(5) 

(6) 

(?) 

If  the  gases  enclosed  by  the  annular  liquid  jet  arc  ideal  and 
isothermal,  the  liquid  docs  not  absorb  the  gases  that  it  encloses, 
and  mass  is  injected  into  the  volume  enclosed  by  the  jet  at  a  rate 
a  and  during  a  time  <,„j,  then 


p?(0 

Pi 

,{  )  V(t)  pi 

(8) 

m,(t) 

_«?(n  . . 

m?(0) 

0  <<<ti,g 

19) 

m,(<) 

=  !-{“  at\ nj, 

^  ^  Unj 

(10) 

Substitution  of  Eq.  (8)  into 

Eq.  (6)  yields 

■P 

3 

II 

^  L^mp*(o) 

Cpn,Ml  ‘(  )  V(t)  Pi 

(11) 

where 

Cpmtix 

=  PlRZ/2cr,  V(t)  = 

l  R2{t,z)dz 

(12) 

V  —  V'I^Rq3,  and  L(t)  is  the  axial  distance  at  which  the  annular 
jet’s  inner  interface  radius  is  zero,  i.e., 


p<t,m) =o 


and 


b  -  in 
“  R  F'n 


R,=  R-  6/2 


(13) 

(14) 


III  DOMAIN-ADAPTIVE  TECHNIQUE 

The  annular  liquid  jet  geometry  is  curvilinear  and  tin  — dependent 
and  has  an  unknown,  time-dependent,  downstream  boundary,  i.e., 
the  convergence  point.  This  geometry  can  be  transformed  into  a 
unit  interval  by  means  of  the  mapping 


(f,z)-»(r,v),  r  =  t,  J]  =  z/L  (15) 

The  Jacobian  of  this  mapping  is  L(t)  which  is  a  function  of  time. 
Substitution  of  Eq.  (15)  into  Eq.  (1)  yields 


wliereT  is  the  unit  matrix.  Equation  (16)  can  be  discretized  in  an 
equally  spaced  grid  such  that  t] i  =  0  and  17/  =  1  where  I  denotes 
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the  number  of  grid  points,  by  means  of  backward  differences  for 
the  advection  term,  and  central  differences  for  G,  and  the  result¬ 
ing  0(Ar,  Aj/)-accurate  finite  difference  equation  can  be  written 
as 


-C?+1U?ii1  +  (I  +  C?+1)U?+1  =  At  G?+1  +  U?  (17) 

where  i  =  2, 3, —  1,  and 

C  =  HAt/Aj?  (18) 

Since  both  H  and  C  depend  on  dL/dr  and  L,  an  equation  must 
be  obtained  for  the  convergence  length.  Such  an  equation  can  be 
obtained  as;  follows.  At  the  convergence  point  (cf.  Eqs.  (13)  and 

(14)) 

R:{t,  z  =  L(t))  =  0,  b{t,  z  =  !(£))  =  2 R{1,  z  ~  L{t))  (19) 

Therefore,  the  following  algebraic  equation  must  be  satisfied  at 
the  convergence  point  (cf.  Eq.(14)) 

2  R\l,z  =  !(£))  =  b-0m(t ,  * -=  L(t))/R$.  (20) 

Differentiation  of  Eq.  (20)  with  respect  to  t,  and  use  of  Eqs.  (1) 
and  (15)  yield 


.  dR  b'0  0  .  , 

4K(^  „£)  („) 


at  i\  =  1 


dL  dl  “'“dr,  iW  ;  ,n  . 

*■-*- — : ■■  at’-1  (21) 
dr,  Rt  di, 

which  is  an  ordinary  differential  equation  for  L  and  which  can  be 
discretized,  in  an  equally-spaced  grid,  as 

AR[(Ul  ULlUb}. -ylL)  _ 

dr  ,  n  Ri-Ri- 1  "  '  ' 

,R’— - 

The  values  of  «,  R,  v  and  m  at  i  =  7  can  be  calculated  by  linear 
extrapolation  as 

U/  =  2U/_i  -  U;_2  (23) 


IV  PRESENTATION  OF  RESULTS 

Figures  2  and  3  illustrate  the  effects  of  the  initial  pressure  ra¬ 
tio  across  the  annular  liquid  membrane  on  both  the  convergence 
length  and  the  pressure  coefficient.  These  figures  correspond  to 
nonpressurized  and  overpressurized  annular  membranes,  respec¬ 
tively,  and  indicate  that  the  initial  pressure  ratio  across  the  mem¬ 
brane  has  a  great  effect  on  its  dynamic  response.  In  particular, 
Figures  2  and  3  clearly  indicate  that  the  time  required  to  reach 
asymptotic,  steady  state  after  the  end  of  mass  loading  increases 
as  the  initial  pressure  ratio  across  the  membrane  is  increased, 
and  that  overpressurized  membranes  exhibit  damped  oscillations 
analogous  to  those  of  a  mass-spring-dashpot  system. 

Figures  2  and  4  illustrate  the  effects  of  Cp lnax  on  the  response 
of  annular  membranes  subject  to  mass  loading,  and  indicates 
that  the  maximum  values  of  both  the  pressure  coefficient  and  the 
convergence  length,  and  the  time  required  to  reach  asymptotic, 
steady  state  after  the  end  of  mass  injection  increase  as  is 
increased.  Figure  4  also  shows  that  the  critical  pressure  coef¬ 
ficient  of  unity  determined  from  the  solution  of  the  steady  stale 
governing  equations  [2)  can  be  exceeded  without  affecting  the  sta¬ 
bility  of  the  annular  membrane,  and  that  the  initial  response  of 
the  pressure  coefficient  is  nearly  linear. 

V  CONCLUSIONS 

The  dynamic  response  of  annular  liquid  jets  to  mass  loading  has 
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been  analyzed  by  means  of  an  adaptive  finite  difference  method 
that  transforms  the  unknown,  time-dependent,  curvilinear  geom¬ 
etry  of  the  annular  jet  into  a  unit  interval,  and  that  yields  a 
differential  equation  for  the  convergence  length,  i.e.,  for  the  axial 
distance  at  which  the  annular  jet  merges  on  the  symmetry  axis  to 
form  a  solid  jet.  A  block-bidiagonal  technique  has  been  used  to 
determine  the  annular  jet  mean  radius,  mass  per  unit  length,  and 
axial  and  radial  velocity  components  of  the  liquid  in  an  iterative 
manner. 

It  has  been  shown  that  the  pressure  coefficient  and  the  pressure 
of  the  gases  enclosed  by  the  annular  liquid  jet  respond  instanta¬ 
neously  to  the  mass  injection,  whereas  there  is  a  lag  m  the  re¬ 
sponse  of  the  convergence  length.  This  lag  is  due  to  the  inertia  of 
the  jet  and  the  assumption  that  the  gases  enclosed  by  the  jet  arc 
isothermal,  and  decreases  as  the  injection  duration  is  increased. 
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ABSTRACT: 

Diffusion  of  charge  carrriers  would  become  a 
prominent  physical  phenomena  in  case  of  short  mm-wave 
DDRs  due  to  narrow  depletion  zone  and  high  carrier 
concentration  gradient.  An  economical  numerical  simu- 
-lation  method  to  compute  the  diffusion  current  and 
the  magnitude  of  diode  negative  resistance  of  Si  DDRs 
due  to  diffusion  current  density  is  presented  which 
provides  a  realistic  picture  of  the  effect  of  carrier 
diffusion  in  IMPATT  devices  for  mm-wave  operation. 

INTRODUCTION: 

Ultrathin  depletion  layer  and  high  mobile  space 
charge  concentration  in  IMPATT  diodes  operating  in  mm- 
wave  and  short  mm-wave  regions  would  push  the  earner 
diffusion  current  to  comparable  limit  of  drift  curre- 
-nt  and  both  drift  and  di fusion  currents  would  contr- 
-ibute  to  microwave  negative  resistance  generated  in 
the  device.  The  inclusion  of  diffusion  current  to  the 
mathematical  analysis  of  the  device  physics  is  often 
neglected  due  to  complexities  that  may  be  involved  in 
the  analysis.  The  authors  have  devised  a  comparative- 
-ly  low  cost  numerical  simulation  method  to  solve 
IMPATT  device  equations  under  high  frequency  small 
signal  conditions  by  considering  both  drift  and  drift 
currents.  Our  analysis  also  can  give  the  microwave 
resistance  contributed  by  diffusion  current  only  whi- 
-ch  in  turn  can  indicate  a  clear  picture  as  regards 
role  of  diffusion  current  in  the  device  performance. 
The  method  has  been  applied  to  several  mm-wave  DDRs 
designed  to  operate  upto  220  GHZ<  The  deteriorating 

effect  of  carrier  diffusion  is  marked  at  frequencies 
beyond  150  GHz.. 


DEVICE  ANALYSIS: 

Inclusion  of  diffusion  current  into  the  analysis 
of  framing  the  device  equations  of  semiconductor  devi- 
-ces,  can  be  realised  in  a  simple  way  by  defining  the 
operators  for  the  effective  velogities  of  electron  and 

hole  in  the  form,  Vn  p=t3n  p(  1+j~~l(''  J> )  and  sum  velo¬ 
city  v+  =  ( tv-  i  +  K.®a  -%)/( V  ) 

where  -y  are  the  drift  velocities  and  D„  are  the 
n,p  n,p 

diffusion  coefficients  of  electrons  and  holes  respect- 

-ively  and  D=  S/ax.  The  electron  and  hole  current  den- 

-sities  3  and  J  now,  take  the  usual  form  J  :qy»  W 
n  p  n,p  1 

Where  is  the  electronic  charge  and  n  and  p  are  res- 
-pectively  the  electron  and  hole  concentrations.  The 
velocity  operators  have  their  corresponding  inverses. 


The  basic  equations  for  an  IMPATT 
combined  carrier  continuity  equation 


diode  are  the 


combined  carrier  continuity  equation 

JqjCR+K-)  ~^z!k  CT^-Tp)  +  2-(<CnVn  n+  <if>Vp  (A) 

and  the  Poisson's  equation  (for  mouile  space  charge) 


<--">  =  11 t  w 

Where  <£n,p  are  respectively  the  ionisation  coefficients 
of  electrons  and  holes. The  total  current  density, which 
is  the  sum  of  conduction  current  and  displacement  curr- 
-ent,  is  constant  and  is  given  by 


J  =  Jn  +  Jp 


r  ^ Em- 


Jp  and  Jn  can  be  eliminated  using  Equs  ( 1 ) , ( 3)  and  (A) 

to  obtain  expressions  for  p  and  n  [1]. These  expressions 
for  p  and  n  can  be  substituted  into  Equs  '  and  on 


simplification  one  can  obtain  the  following  fourth 
order  differential  equation, 


C-  DaD4  ♦  0  0J  +  (  1  +  D+  k  -  /0  )  D2  + 

+  zrk)i)+  2Zk-  k2j  EM  =-L  (2^-k)  J  (5) 

Where  the  symbols  have  usual  meaning  [1], 

Equ  (5)  is  linearized  to  get  the  small  signal  device 
equation  on  the  device  impedence  z.  as 

[>  Bn  0*+ »!?+-( 1  +3>+k  -Zj)  )  £z+ 

+2rk)D  +  2*k-kz+  (Zn-^)X>  EmH25J/t?e) 

_  D2EmJ  Z  =  (  V^i)(2Z-k)  & 

Where  the  primes  denote  the  field  derivatives  of  the 
corresponding  quantities.  The  boundary  conditions  are 
obtained  by  assuming  the  electron  and  hole  concentra- 
-tions  to  be  negligible  respectively  at  the  p-side  and 
n-side  boundaries  of  the  diode.  These  are  given  by 


(.  -f  W-iy  =  0 


at  the  n-side  boundary  and, 
at  the  p-side  boundary. 


=o 

(7) 

(8) 

Vp 

Assuming  that  the  diffusion  current  is  a  small 
perturbation  on  the  drift  component,  Equ  (6)  can  be 
written  as  (L  +  xi' )  Z  =  F  (9) 


Where  L*  contains  all  the  terms  involving  D  on  the 

n,p 

on  the  L.H.S.  of  Equ  (6)  and  F  is  the  R.H.S.  of  Equ(6). 
Expressing  Z  as  the  sum  of  the  unperturbed  solution  ZQ 
and  various  orders  of  pertubation  corrections  Z.Q=1, 
2,5....)  one  can  write  Equ  (9)  as 

(L+  *L')  (Zo  +  'XZ,  +  )\2Zz+  •  ■  )  »-F 

Equating  coefficients  of  various  powers  of  A  a  senes 
of  differential  equation  is  obtained  as 


LZq  =  F  (10) 

and  LZi  =  -  LZjL_1,  i  =  1,  2,  5  .  (11) 


After  separating  into  real  and  imaginary  parts, Equ( 10) 
is  first  solved  and  then  Equ  (11)  are  solved  progress¬ 
ively  for  l  =  1,  Z,  3  .  etc.  using  the  numerical 

technique  described  as  follows. 


COMPUTER  METHOD: 

Equ  (10)  is  solved  by  a  modified  Runge-Kutta  algo- 
-ritbm  following  an  iterative  procedure. Ihe  iterations 
over  tne  initial  values  of  resistance  Rq  (  I^ZQ  )  and 

reactance  XQ  (ImZQ)  at  one  edge  of  the  diode  are  per- 

-formed  till  the  boundary  conditions  at  the  other  edge 
are  satisfied.  A  Tour  fold  logic  is  framed  in  perfor- 
-ming  the  iterations.  The  initial  values  of  RQ  and  XQ 

may  be  varied  in  the  four  possible  ways  i.e.  RQ  R0*AR, 

and  X  X  *AX  .  The  logic  in  which  the  initial  valu- 
ooo 

es  of  R  and  X  is  to  be  varied  to  obtain  the  required 
boundary  conditions  3t  the  other  edge  depends  on  the 
structure  of  the  diode  as  well  as  on  the  frequency  of 
operation.  The  programme  software  has  been  designed  in 
such  a  way  that  the  variations  in  the  initial  values 
or  Rq  and  XQ  automatically  switch  over  to  the  converg¬ 
ing  truck  very  swiftly. Ihe  software  is  thus  free  from 
numerical  instability.  The  accuracy  limit  is  set  at 
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Fig.1  Microwave  diode  resistance  contributed  by  ditiusion  current  in 
Silicon  ODRs. 


0.02$  .  After  the  solution  of  Lqu  (10)  the  quantities 
on  R.H.S.  of  the  Equ  (11) for  i:l  are  obtained  from  the 
knowledge  of  Rq  and  XQ  at  each  space  point.  The  third 

and  fourth  order  derivatives  of  RQ  and  Xo  are  obtained 

numerically  following  Sterling's  formula.  Then  Equ(11) 
is  solved  for  i-1  following  the  same  Runge-Kutta  app- 
-roach  to  get  the  first  order  diffusion  correction. The 
different  order  of  diffusion  corrections  may  be  obtai- 
-ned  by  progressively  solving  Equ  (11)  for  i=2,  3,  4.. 
etc.  which  gives  the  diffusion  contribution  to  the  ne- 
-gative  resistance  of  the  diode. 

RESUMS: 

Elat  profile  Si  DDRs  Tor  operation  in  V,  T,  0,  G 
and  Y  bands  with  centre  frequencies  respectively  at  60 
94,  140,  170  and  220  GIU,  are  designed  following  a  sta- 
-tic  analysis  [21 .  The  small  signal  mm-wavc  properties 
like  diode  negative  conductance  (G)  and  diode  negative 

resistance  Z^,  which  are  determined  following  our  me- 

-thod  are  presented  in  Table-1  for  the  cases  (l)  when 
diffusion  is  neglected  and  (ii)  when  diffusion  is  con- 
-sidered.  It  is  seen  that  the  effect  of  carrier  diffu- 
-sion  on  the  device  characteristics  remains  marginal 
for  diodes  with  frequency  of  operation  below  100  GH^. 

further  it  is  observed  that  diffusion  current  enhances 
the  device  negative  resistance  for  diodes  designed  to 
operate  below  150  GH^.  The  degrading  effect  of  earner 

diffusion  starts  with  diodes  designed  to  operate  above 
150  GHZ  and  it  substantially  reduces  the  device  nega- 

-tive  resistance  for  Y-band  operation.  The  device  neg¬ 
ative  conductance  also  records  a  progressive  deter  10- 
-ration  due  to  carrier  diffusion  as  one  goes  from  low 


frequency  V-band  to  high  frequency  Y-band.  The  distri- 
-butiuu  of  resistance,  contributed  by  diffusion  curr- 
-ent,  in  the  depletion  layers  of  different  diodes  are 
shown  in  fig.1  .  The  curves  show  that  the  diffusion 
contribution  to  diode  resistance  becomes  positive  for 
G  and  Y  band  diodes  giving  rise  to  decrease  in  the 
device  negative  resistance  for  high  frequency  mm-wave 
bands  leading  to  fall  m  the  power  output  and  effici- 
-ency  of  IMPATT  devices  for  short  mm-wave  operation. 


Table-1 


Band  Optimum 
frequency 
GHZ 

D  : 
-G,  n,p 

X106S/m5 

:0 

-ZR’ 

X10"?n.m5 

-G>P' 

X106S/roJ 

0 

-ZR» 

X10"9.n.m5 

V 

60 

7.8 

7.6 

8.1 

8.3 

r 

105 

38.1 

6.4 

37.2 

7.6 

D 

130 

56.8 

2.3 

54.4 

3.1 

G 

170 

99.1 

1.4 

85.6 

1.3 

Y 

220 

192 

1.0 

42.0 

0.3 
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Abstract  The  equations  governing  linear  nave 
propagation  in  viscoelastic  media,  ei thcr 
single-phase  or  multiphase,  can  be  Hritten  as 
a  single  first  order  matricial  di f fcrent.al 
equation  in  time.  The  formal  solution  is  the 
evolution  operator  c.M*  acting  on  the  initial 
condition  vector,  where  M  is  a  linear  operator 
matrix ^containing  the  spatial  derivatives  and 
medium  properties,  and  T  is  the  time  variable. 
The  problem  is  solved  numerically  approximating 
the  evolution  operator  by  an  optimal  polynomial 
expansion  depending  on  the  location  of  the 
eigenvalues  of  M  in  Hie  complex  frequency 
plane.  The  eigenvalue  analysis  is  carried  out 
for  the  anisotropic-viscoelastic  and  porous 
viscoacoustic  constitutive  relations  and 
respective  limiting  rheologies.  For  each  case 
an  optimal  expansion  of  the  evolution  operator 
is  identified,  which  provides  highly  accurate 
solutions  and  fast  convergence  compared  to 
Taylor  expansion  or  temporal  differencing. 

I.  INTRODUCTION 

Linear  viscoelasticity  provides  a  general 
framework  for  describing  the  anclastic  effects 
in  wave  propagation,  i.e.,  the  conversion  of 
part  of  the  energy  into  heat;  and  the 
dispersion  of  the  wave  field  Fourier  components 
with  increasing  time.  A  dissipation  model  which 
is  consistent  with  real  materials  is  the 
general  standard  linear  solid  which  is  based 
on  a  spectrum  of  relaxation  mechanisms. 
However,  implementation  of  this  rheology  in  the 
time  domain  is  not  straightforward  due  to  the 
presence  of  convolutional  kernels  CBolztmann's 
superposition  principle).  To  avoid  the  time 
convolutions,  it  is  necessary  to  introduce  into 
the  formulation  additional  variables,  called 
memory  -variables  in  virtue  of  their  nature 
Cl]-  [5]  .  The  wave  equation  of  the  medium  can 
be  written  os  a  first-order  differential 
equation  in  time  os 

U  «  MU  +  F.  (1) 

where  U  is  a  vector  whose  components  arc  the 
unknown  variables,  M  is  an  operator  matrix 
containing  the  spatial  derivatives  and  material 
properties,  and  F  is  the  body  force  vector. 


x  This  work  was  supported  in  port  by  the 
Commission  of  the  European  Communities  under 
project  EOS  1  (Exploration  Oriented  Seismic 
Modelling  and  Inversion),  Contract  N. 
JOUF-0033,  part  of  the  GEOSCIENCE  project 
ni  thin  the  framework  of  the  JOULE  R  E  I) 
Programme  (Section  3.1.1.b). 


In  (1)  and  elsewhere,  time  differentiation  is 
indicated  with  the  dot  convention.  The 
differential:  equation  (1)  correctly  describes 
the  anelastic  effects  in  wave  propagation 
w.tliin  the  framework  of  linear  response  theory. 

The  solution  of  (1)  subject  to  the 
initial  condition 

V(t  =  0)  =  U0  (2) 

is  formally  given  by 

U(t)  =  e*  MU0  +  f  eT  11  F(t  -  r)  dr .  (3) 

J0 

In  equation  (3),  e* 11  is  called  the  evolution 
operator  of  the  system.  Solving  (3)  requires 
a  suitable  approximation  for  the  spatial 
derivatives,  which  is  achieved  by  the  Fourier 
pseudospectral  -method  [7]  .  Thus,  equations 

Cl),  (2)  and  (3)  should  be  replaced  by  the 
discretized  equivalent  equations. 

The  numerical-  solution  is  obtained  by  an 
optimal  expansion  of  the  evolution  operator  as 
polynomials,  whose  region  of  convergence 

depends  on  the  spatial  matrix  M,  particularly 
on  the  location  of  its  eigenvalues  in  the 
complex  frequency  plane.  The  form  of  M  depends 
on  the  rheology  and  the  unknown  variables. 

Let  a  plane  Have  solution  to  equation  Cl) 
be  of  the  form 

U^oe^C-t-*'*),  (4) 

where  x  is  the  position  variable,  is  the 

complex  frequency,  and  k  is  the  real  wavenumber 
vector.  Substituting  (4)  into  CJL),  and 

considering  constant  material  properties  and 
zero  body  forces,  yields  an  eigenvalue  equation 
for  the  eigenvalues  .1  =  i «ic .  The  determinant 
of  the  system  must  be  zero  in  order  for  U0  to 
have  a  non-zero  value.  The. ef ore, 

dot[H  —  ^1]  =>  0,  (5) 

where  M  is  the  spatial  Fourier  transform  of  M 
,  and  1  is  the  identity  matrix.  Hereafter,  the 
complex  plane  of  the  eigenvalues  is  called  the 
z  -plane.  Equation  (5)  determines  the 

eigenvalues  of  M  in  the  Fourier  method 

approximation.  Actually,  the  discretized 
equation  should  lie  used,  but  C5)  represents  a 
relatively  good  approximation. 

The  eigenvalues  arc  analyzed  in  Section 
2  for  tiic  following  rheologies: 

-  ANISOTROPIC- VISCOELASTIC 

-  Isotropic-vjscoolastio 
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-  Anisotropic-elastic 

-  Isotropic-elastic 

-  POROUS  I SOTKOP 1 C— V I  SCO  ACOUST.I  C 

-  Biot-acoustic 

-  Isotropic-viscoacoustic 

The  eigenvalue  distribution  defines  the 
domain  where  the  evolution  operator  is 
approximated  by  a  suitable  (rapidly  converging) 
polynomial  expansion.  For  each  case,  a  brief 
review  of  the  numerical  integration  techniques 
is  given  in  Section  3.  The  methods  are  the 
fol loHing: 

-  Taylor  expansion 

-  Chebychev  Spectral  method 

-  Rapid  expansion  method 

-  Polynomial  interpolation 
through -conformal  mapping 

-  Polynomial  interpolation 
by  residum  minimization 

IT.  HAVE  EQUATIONS  AND  EIGENVALUES  OF  M 

Anisotropic-viscoelastic  rheology 
In  order  to  implement  Boltzmann's  principle  in 
the  generalized  Hooke's  law,  tHo  relaxation 
functions  based  on  the  standard  linear  solid 
rheology  are  considered.  One  relaxation 
function  describes  the  anelastiv.  properties  of 
the  quasi-di latational  mode,  and  the  other  is 
related  to  the  quasi-shear  mode-  This  can  be 
done  by  forcing  the  mean  stress  to  depend  on 
the  first  relaxation  function,  and  the 
deviatoric  components  on  the  second  (in  this 
case,  at  least  for  some  coordinate  system,  and 
usually  along  symmetry  axes  of  the  material). 
Moreover,  the  resulting  rheological  relation 
gives  Hooke's  Ioh  in  the  anisotropic-elastic 
limit,  and  the  isotropic-viscoelastic  rheology 
in  the  isotropic-anelastic  limit  [3],  [5].  The 
equation  of  motion  of  a  two-d  i  meiisi  onal 
anisotropic-viscoelastic  medium  is  formed  with 
the  following  equations  [1]: 

i)  The  equation  of  momentum  conservation: 


to  the  Lv  mechanisms  which  desert  fcj  the 
aneiastic  characteristics  ot  the 

quasi  Tilatational  mode  (v  =  l),  and  quasi  shear 
modes  tv  =  2);  and  Ajj  and  A (fy  are  functions  of 
the  elasticities  Cjj,  T,J  =  JL,...,6  of  the 

hy 

medium.  Final  ly,  Muv  =  [1  -  £  (1  -  where 

ana  are  material  relaxation  times. 

Implicit  summation  over  repeated  indices  is 
assumed. 


ii  )  th„  memory  variable  equations: 

=  s3^‘  l  ~  *  1=1,..  .,LV,  (8) 

where  =  (I  -  . 


Equations  (6),  (7)  and  (8)  are  the  basis 
for  the  numerical  solution  algorithm.  For 
simplicity,  a  two-dimensional 

transvcrsely-isotropic  medium  with  symmetry 
axis  parallel  to  the  z-axis  is  considered. 
Then,  c33,  cj3  and  C55  define  the  elastic 

characteristics  of  Die  medium.  Choosing  one 
relaxation  median ism  for  each  mode 
(Lj^  =  L2  =  l),  the  unknown  variable  vector  is 
given  by 


U  —  [lljji  iljj#  Gj]» 


(9) 


where  e)=  cW  +  oyi'  e2  ~  °¥l  °£}‘  and 

03  =  0$,  in  terms  of  the  memory  variables.  The 
spatial  operator  is 


0  0  1 
0  0  0 


M31  m32  0 
11 A 1  MA2  0 
M51  M52  0 
M61  m62  0 
M71  m72  0 


0  0  0  0 

10  0  0 

0  M35  H36  M37 
0  «AS  lfA6  11 A 7  * 

0  Mqq  0  0 

0  0  1I66  0 

00  0  M 77 


(10) 


with 


31  “  */*X  t(cll  "  »)  +  (»  -  eS5,Mia  +  c55MII2]  3/3x  -I- 
3/<)z  (cS5Mu2)  3/3z, 


V  ■  T  =  pu  +  f ,  (6) 

where  rT  =  [Tj,  T2,  T3,  T,,.  T5,  T6]  s 

^xx#  ayy  ayz.‘  ^xz*  oXy3  : s  the  stress 

vector,  with  0  jj,  i,j=l,...,3  tile  stress 
components.  Defining  the  position  vector  by 
x  =  (x,  y,  z),  u(x»  t)  and  f(x»  t)  denote  the 
displacement  and  body  force  vectors, 
respectively;  p(x)  is  tlie  density,  and  V  *  is  a 
divergence  operator  defined  by 


TJ 


3/3x  0  0  0  3/3 z  3/3y 

0  3/5y  0  3/3z  0  3/3x 
0  0  3/3 z  3/3 y  3/3x  0 


pM32  =  3/3x  [(c13  +  2c55  -  D)  +  (D  -  css)M,u  -  Or>5M„2] 
3/3z -|.  3/3z  (c55Mu2)  3/3x, 

/»m35  =  <?/'5x  (D-c55)'  /,m36  =  ,7/'7x  c55'  /’M37  - 

3/3z  c55, 

P* A1  =  t(°13  1  2c55  -  »)  c5.ri)"uJ  cb.1»u2] 

3/3x  +  3/3x  (c55H,|2)  3/3z , 

P” A2  =  Wz  t(c33  -  D)  +  (D  -  c55)M,a  I  oS5Mll2]  3/3z  I 
3/3x  (o55Mu2)  3/3x, 


ii)  The  stress-strain  relations: 

*'V 

Ti  =  C*ij  +  4viHuv3sJ  +  Yj  ’ 


1=1 

1 , j  =  1, . .  ,6, 

;>2>  S3,  s0.  Sj,  S6]  3 


and 


whore 

sT-[*_ 

[cxx,  Cyy,  £ZZ»  2«yz,  2CXZ,  2ZXy]  iS 


vector,  with 


components;  o^  "ore  memory  variables  related 


i , )  —  1, ... ,3 


the 

the 


(7) 

v  -  1,2. 

.strain 

strain 


pH  a  5  =  3/3z  (I)  -  c5r>),  pH  a  6  =  -  3/3z  055, 
pHr,  7  =  3/3x  C55, 


HS1  =  ‘/’l  ,1/3x , 
M Wx. 
M71  =  i/>2 


M52='/’l  W7"  «55  -  '  ]lT0l)’ 

H62  ’  “  '/’R  W7-’  1*66 - 1 ’ 


n  4*2  ,  M  y  y 


'i&- 
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where  D  =  (cn  +  033^2 .  The  subindex  1  denoting 
r.  physical  mechanism  has  been  omitted  tor 
simplicity.  In  the  anisotropic-elastic  limit, 
i.e.,  when  and  the  memory  variables 

vanish,  equation  C2.2D  become  Hooke's  law.  In 
the  isotropic-viscoelastic  limit,  ejj.  , 
c 33  “*  }■  + 2ft  ,  cjl3  -*  A  and  C55  -»/«,  Hith  X  and  p 
the  Lame  constants,  and  C7)  becomes  tlto 
i'sotropic-viscoelas  tic  rheology  [5]. 


Isolropic-elaslic 


z-plone  (Hz) 


-500 


pi. 200 

11 

o 

•0 


The  eigenvalues  of  -H  are  obtained  from 
equation  (5),  where  the  following  substitution: 
d/dx  ->  ikx,  and  d/dz  -»  ikz,  Hith  kx  and  kz 

the  wavenumber  components,  gives  M  from  fl. 
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Fig.  1.  Eigenvalue  distribution  of  the  spatial 

matrix  M  in  the  complex  frequency  plane  for  ihe 
different  rheologies  of  a  single-phase  solid. 


The  eigenvalue  distribution  for  the  different 
rheologies  is  displayed  in  Fig.  1.  The  material 
is  a  clayshalo  having 

T^1)  =  42)=  0.0030  S-1,  #)=  0.0027  s-1  and 

rj2)  -  0 . 0  025  s--*-,  which  give  highest  dissipation 
around  f  =  50  Hz  [1).  The  eigenvalues 

corresponds  to  kx  =  kz  =  0 . 16  m"1 .  The  negat  ive 
real  part  of  the  propagating  modes  is  a 
consequence  of  the  anelastici ty,  stronger  for 
the  shear  modes.  The  static  modes  arise  from 
the  fact  that  the  formulation  was  done  in  the 
time  domain;  they  are-  grouped  approximately 
around  -1/r^1)  and  -l/r^2).  The  differences  are 
mainly  due  to  anelastieity  which  introduces  the 
static  modes,  since  anisotropy  only  produces  a 
shift  of  the  Have  mode  eigenvalues  in  the 
vertical  direction.  Section  3  analyzes  the 
appropriate  methods  for  each  rheology. 


Porous _ i  sotropi  c-vi  scoacous  t  i  c _ Theo  1  ogy 

Invoking  the  correspondence  principle,  IJiol 
formally  obtained  a  viscoelastic  equation  of 
motion  Hhioh  includes  all  possible  dissipation 
mechanisms.  The  approach  involves  the  presence 
of  convolutional  integrals  which  arise  from  the 
replacement  of  the  elastic  coefficients  by  lime 
operators.  When  standard  linear  solid  kernels 
are  considered  for  the  time  operators,  the 
equation  of  motion  of  the 
'solropic-viscoocoustic  porous  medium  is  given 
by  the  following  equations  [2]: 


i)  Hi  of  equations: 


4-«H"  4-  !]♦[.* 


an 


where  p  and  p [  are  the  pressure  fields  of  the 
matrix-fluid  system  and  f=iuid,  respect  ivoly;  u 
is  the  displacement  of  the  solid;  w  is  a  voolor 
representing  the  flow  of  the  fluid  relative  to 
the  solid,  and  s  and  Sf  arc  body  force  vectors. 
The  material  properties  ore:  p  ,  the  composite 
density;  ps,  the  solid  density;  p f  ,  the  fluid 
density;  m,  the  tortuosity;  the  fluid 
viscosity;  and  K,  the  giobnl  pormeob i I i I y . 
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4T)  The  s+ress-strain  relations: 


Kliere  e  and  £  are  the  dilatation  tields  of  the 
solid  matrix,  and  fluid  relative  to  the  solid, 
respectively;  and  ejj ,  e2j ,  ?21 '  and  C35  are 
memory  variables.  V'l  =  -  (A  R  +  2Q).  + 

and  ^3  =  R//?2,  Kitero  A,  K,  and  Q  arc  tlie 
classical  Biot  elastic  coefficients,  and  /!  is 
the  porosity. 


iii)  The  memory  variable  equations: 

feB11  40-t^u4(4-  a3“’ 

40- 

for  1  =  1,...  ,L,  where 

</’r  I  =- -  ifafrfc })!*$>  r  =  1,5,  with  r^rj> 
and  relaxation  limes. 

In  the  one-dimensional  case  with  L  =  l,  tlie 
unknoHn  vector  U  has  nine  components. 


with  A  =  <J2/dx2  and  >  -  pf  -  pm  .  Diot  poroelastic 
equations  are  obtained  by  taking 
4r)  =  4r)*  f  =  l»3-  Then,  tlie  memory  variables 
vanish  and  the  unknown  vector  becomes 
UT=[e,  C»  e,  £,  — w]  .  The  aquation  for  a 
viscoacoustic  single-phase  solid  is  obtained 
with  p. f  =  0  and  </>2  =  0  3=0?  only  one  set  of 
relaxation  times  remains,  corresponding  to  the 
solid  phase  1$^).  The  unknown  vector  in  this 
case  is  UT  =  [o,  6,  o^j  . 


UT  =  [e»  £,  e,  £,  —  w,  e^,  £3,  e2f£2],  (!/•) 

The  spatial  matrix  II  for  constant  material 
properties  is  given  by 


0  0  1 
000 
M31  »32  0 

H-U  mA2  0 

11=  MS1  HS2  0 

Hi  0  0 


h92  0 


Ceq.  C15J0,  where 


000  0  0  0 

1  0  0  0  0  0 

0  h35  m36  %7  m38  %9 

0  MAS  M06  mC,7  M,)8  ligg 

0  h55  m56  m57  mS8  m59  » 

0  0  H6&  0  0  0 

00  0  M77  0  0 

0000  w68  0 

0  0  0  0  b  Mno 


»9vj 


>■  k31  =  Cm^l  +  Pi $2)  y  M32  =  Cm -  Pft/zj]  A, 

y  »3s  =  (/>f>;/K)a/3x, 


V  m38  ~  -  P {  &> 


y  m36  =  m  A,  yM37=~/)f  A,  vM38  =  -/jfA, 
y  M39  Ay 

y  =  [PflJ'x  +  P'W  y  Hr, 2  =  Cf'f '1>Z  -  P’l'sl  b’ 

y  mas  =  (p>iIk)  dlSx> 

yHr)&  =  /)f  A,  y  Hrl7  =  -  />  A,  yHrl8^-pA,  yHr,9=pfA, 
y  MS1  -'[Pifii  +  OjBx,  y  MS2  =  [/i.j-1^2  -  pi^3]  ft/, lx, 
y«ss  =  w/K, 


yH 5t  =  ))f  3/(lx,  y  h57  =  -  p  3/flx,  y  M58  =  -  P  f)/0x. 


y  H59  =■  pf  a/ax, 

H61=-"^l,  H88  =  — 1/r^'  H72  =  $3,  H77  =  -  l/r^, 

H81«-^2,  H88  =  -l/r^),  ff92  =  -,/.2,  H99--J/4Z), 


Fi9-  2.  Eigenvalue  distribution  of  fi  in  the 
complex  frequency  plane  for  a  porous 
visconcoustjc  medium  and  limiting  rheologies. 
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Substitution  of  5/3x  by  ik  gives  the 

transformed  matrix  M.  Fig.  2  shoiis  the 
eigenvalue  distribution.  One  of  them  is  zero 
Cnot  plotted )  since  the  fourth  and  fifth  rows 

of  M  are  linearly  dependent.  The  slow  modes 
present  a  quite  diffusive  behaviour  due  to  the 
Biot  mechanism.  They  are  not  present  in  the 
single-phase  medium,  whose  attenuation 
characteristics  are  viscoelastic. 

III.  NUMERICAL  INTEGRATION  METHODS 

To  illustrate  the  different  techniques,  a  zero 
source  term  is  considered  for  simplicity  in 
equation  (1).  A  detailed  formulation  with 
source  can  be  found  in  the  respective 
references.  The  formal  solution  to  the  system 
is  then  given  by 


Rapid  expansion  method  In  the  elastic  case 
where  no  first  time  derivatives  of  the 
displacements  and  memory  variables  ore  present, 
the  wave  equation  of  the  system  can  be 
expressed  as 

u  =  -L2u  +  f,  (22) 

where  u  is  the  displacement  vector,  f  is  the 
body  force  vector,  and  -  L2  is  a  linear  matrix 
operator  similar  to  M  [9].  For  zero  body  forces 
the  formal  solution  to  (22)  is 

u(t)  =  cos  Lt  u(0)  +  JLiJ}_kLu(o) .  (23) 

Adding  solutions  (23)  for  times  t  and  -L,  the 
displacement  time  derivative  can  be  eliminated, 
and  the  displacement  at  time  t  becomes 

u(:t)  =  -  u(  -t)  +  2  cos(L  l)  u(0).  (26) 


U(t)  =  et  MU0, 

(16) 

The  numerical 

sol u lion 

for 

general 

inhomogeneous  media  requires  a  polynomial^ 
representation  of  the  evolution  operator.  The 
different  methods  are: 


Taylor  expansion  A  Taylor  expansion  of  the 
evolution  operator  up  to  the  second  order  is 


o*M=  I  +  Mt  +-|-M2t2. 

Replacing  (17)  into 
U(  — t )  from  U(t)  gives 

U(t)  =  U(  -t)  +  2 1  MUq  . 


(17) 

(16),  and  subs  tract i ng 

(18) 


This  formula  basically  gives  the  equations  for 
second-order  temporal  differencing  valid  for 
small  t  [7].  Although  the  region  of  convergence 
of  the  Taylor  expansion  is  the  whole  z-plane, 
in  order  to  have  high  accuracy,  the  lime  step 
should  be  very  small;  more  precisely, 
At=0(N~2),  using  finite-order  explicit  schemes, 
where  N  is  the  number  of  grid  points. 


Chebyclioy  spectral  method  This  technique  makes 
use  of  the  following  expansion  of  e7-  |tij: 

K 

£  CkJk(tWk[-j|-],  (19) 

k=o 

where  IzlStR,  and  z  lies  close  to  the 
imaginary  axis.  C0  *  .1  and  Ck  -  2  for  k  a  1.  Jk 
is  the  Bessel  function  of  order  k  ,  and  Qk  are 
modified  Chebychcv  polynomials  which  satisfy 
the  recurrence  relation 

Qk+l(s)  ~  2«Qk(s)  +  Qk_i(s).  Qo  =  1 .  Qi  -  s.  (20) 

Substituting  tM  for  z  in  (19),  equation  (16) 
becomes 

K 

«(t>-  2ckJk(tR)<?k[-£]u0,  ,21) 

k=rl 


The  method  uses  the  following  expaision: 

K/2 

cos  Lt  *  J  C2kJ2k(tR)Q2k[-^-],  (2S) 

k=0 

This  expansion  represents  an  improvement  over 
the  Chebycliev  spectral  method  since  ft  contains 
only  even  order  functions  Q2k»  however,  it  can 
be  used  only  for  elastic  problems  [8j. 

Polynomial  interpolation  through  conformal 
mapp i ng  As  shown  in  the  previous  section,  in  a 
single  phase  anelastic  solid,  the  eigenvalues 
of  H  lie  on  a  T-shaped  domain  D  which  includes 
the  negative  real  axis  and  the  imaginary  axis. 
This  approach  is  based  on  a  polynomial 
interpolation  of  the  exponential  function  in 
the  complex  domain  D,  on  a  set  of  points  which 
is  known  to  have  maximal  properties.  This  set, 
known  as  Fejer  points,  is  found  through  a 
conformal  mapping  between  the  unit  disc  and  the 
domain  of  the  eigenvalues  D.  In  this  way,  the 
interpolating  polynomial  is  "almost  best" 

cio]. 

Getting  the  Fejer  points  is  as  follows:  Let 

X(u)  be  a  conformal  mapping  from  the  u  plane  to 
z-space,  which  maps  the  complement  of  a  disc 
of  radius  5  to  the  complement  of  D,  where  $  is 
the  logarithmic  capacity  of  D,  given  by  the 
limit  5 =  lx'(eo)|  ,  the  prime  denoting  derivative 
with  respect  to  the  argument.  The  analytic 
expression  for  x(u)  corresponding  to  the  domain 
D  can  be  found  in  [TO].  The  same  function  y(uiS) 
maps  the  complement  of  the  unit  disc  to  the 
complement  of  the  domain  D. 

Then,  the  Fejer  points  arc 

zj  =  x(Uj),  j  =  0,  — ,  m -i  where  uj  are  the  m 
roots  of  the  equation  um  =  «5  ,  with  m  the  degree 
of  the  polynomial.  The  set 

[zj],  j  =  0,...,m  J  has  maximal  properties  of 
convergence.  Then,  the  sequence  of  polynomials 
Pm(z)  of  degree  m  found  by  in  lerpolo Lion  to  an 
arbitrary  function  f(z),  analytic  on  D  at  the 
points  zj ,  converge  maximally  to  f(z)  on  D.  The 
interpolating  polynomial  in  Newton  form  is 


The  scries  has  a  rapid  convergence  for  K  -  tR, 
with  K = 0(N)  .  The  value  of  R  should  be  chosen 
larger  than  the  range  of  the  eigenvalues  of 
tM.  Since  this  expansion  converges  for  the 

imaginary  axis  of  the  zplane,  it  is 

appropriate  for  the  elastic  case  [7j.  Anelastic 
problems  can  be  solved  with  less  efficiency 
using  a  slight  modification  [A] . 


l’m(z)  =  an  1  a j(z  -  z0)  i  a2(z  z0)(z  zj)  t  ... 

+  ®m(K  -  7'0).  •  •(*  -  zm-l),  (26) 

where  aj  =  f[z0,  . . . ,  zj],  j  -  0,  . . . ,  m  -  j .  arc 
the  divided  differences.  The  app r  ,x ima ting 
polynomial  is  given  by  I*m(Mt)  with  Ur.)  c7-. 
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Polynomial'  interpolation  bv 

res i dum 

minimization  The  preceding  method  requires  a 
conformal  mapping  from  the  unit  disc  to  the 
domain  of  the  eigenvalues  of  M  to  find  the 
interpolating  points.  This  new  technique  avoids 
the  conformal  mapping  by  finding  the 
interpolating  points  automatically  in  an 
optimal  way  [12].  Therefore,  the  method  can 
be  applied  for  any  general  matrix  M,  no  matter 
what  the  domain  D. 

The  idea  is  to  find  the  interpolating  points 
by  minimizing  the  1.2  -norm  of  the  error.  It 
is  well  known  that  the  error  of  the 
interpolation  is 

fOD(s) 

Em(z)  p(z)  pm(z)  mi  Rm* 

(27a) 

with 

m  m-1 

Rm(z)=  HO— «>-  £  akzk  +  ^ 

i=l  k=o 

(27  b) 

and  s  tho  value  for  which  f (s)  -  P~(s)  -  Em(s)  =  0 . 
The  super  index  (m)  denotes  the  (m)**1  derivative. 
Substituting  Mt  for  z  in  (27a)  and  using  (16), 
the  error  of  the  algorithm  is 

fCOfsi 

Rm  mj  ^m*  where  £m  _  Km(Mt)Uo . 

(28a  -  b) 

Minimizing  the  L2_norm  |pmi!2  =  (£m 

achieved  by  solving  the  following 
linear  equations: 

,  2-m)  * s 

set  of  m 

=  0*  i  =  0, . rn—J.. 

00c  j 

(29) 

This  is  equivalent  to  solve  the 
system: 

following 

DA  =  B,  A  =  [«0,  .  .  •  “m-l]T* 

(30) 

where 

»ij  =((Ht)i_1U0,  (Htjj-X), 

(3la) 

Bj  =-((Mt)i-1U0,  (Mt)mU0),  l-£i,j£RI. 

(31b) 

After  solving  for  A,  the  interpolating  points 
are  obtained  from  the  roots  of  Rm(z).  The 
approximating  polynomial  is  given  by  (26)  with 
f(z)  =  oz.  Further  research  is  required  to 

determine  whether  this  technique  improves  the 
efficiency  when  solving  anolastic  wave 
propagation  problems. 

IV.  CONCLUSIONS 

This  work  briefly  reviews  some  of  the  theories 
and  algorithms  for  solving  wave  propagation 
problems  in  linear  viscoelastic  media.  The 
methods  use  spectral  techniques  and  solve  the 
wave  equation  in  the  lime-domain.  A  consistent 
introduction  of  Boltzmann's  after-effect 
principle  in  the  time-domain,  for  anisotropic 
and  porous  media,  is  achieved  by  the 
introduction  of  memory  variables.  Some 
additional  assumptions  are  required  in  _the 
anisotropic  case  for  the  determination  of  tho 
constitutive  relations.  The  eigenvalue 
analysis  for  each  rheology  indicates  that 
spectral  Chcbychcv  methods  arc  suitable  for 
clastic  problems,  and  that  polynomial 
interpolation  techniques  are  required  when  the 
medium  is  anolastic. 
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ON  THE  SOLUTION  OF  SOHE  HEAT  TRANSFER  PROBLEMS  WITH  JUHPS  IN  FLUXES 
ARISING  FROM  BUILDING  PHYSICS 
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Comenius  University 

84  215  Bratislava,  CSR 

Abstract  -  This  paper  deals  with  a  new  method  for  some 
heat  transfer  problems  through  a  system  of  walls  and 
caves  in  buildings,  the  caves  being  ventilated  and 
heated.  From  an  energy  balance  argument  in  the  caves, 
these  problems  may  be  reduced  to  heat  transfer  pro¬ 
blems  through  multicomponent  media  with  Jumps  in  both 
the  fluxes  and  the  temperatures  at  the  interfaces  of 
the  subregions.  The  ventilation  and  heating  lead  to 
non  standard  transition  conditions  involving  Volterra 
operators,  acting  on  the  traces  of  the  temperature 
from  both  sides  of  the  interfaces. 

Crucial  in  the  analysis  is  a  non  standard  variatio¬ 
nal  formulation  of  the  problem,  taking  into  account 
the  non  perfect  thermal  contact  conditions  in  an 
appropriate  way.  By  the  method  of  discretization  in 
time,  see  e.g.  [1],  the  existence  of  a  unique,  stable 
weak  solution  may  be  shown.  The  resulting  recurrent 
system  of  elliptic  problems  at  each  subsequent  time 
point  Is  approximated  by  a  FEM.  Both  the  convergence 
and  the  error  estimates  for  the  semi-discrete  and  ful¬ 
ly  discrete  approximation  scheme  are  stated.  In  a 
simple  case  the  numerical  results  show  a  good  agree¬ 
ment  between  the  exact  and  the  approximate  solution. 

1.  INTRODUCTION. 

To  avoid  distracting  technicalities,  we  confine  our¬ 
selves  to  a  ID-model  problem  with  practical  relevance 
viz.  the  simple  cavity  structure  of  Fig.  1.,  see  e.g. 
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Fig.  1.  Cross  section  of  a  simple  cavity  structure 

The  air  space,  assumed  to  be  homogeneously  at  tempera¬ 
ture  T(t),  is  contained  between  two  walls  (with  con¬ 
ductivities  k1  and  diffusivities  K1),  being  at  tempera¬ 
tures  u‘ ,  1  s  1,2.  At  *  »  (  and  x  =  heat  Is  trans¬ 
ferred  by  convection  between  the  wall  surfaces  and  the 

air,  with  respective  transmission  coefficients  hI,z 
2  1 

and  h  ’  .  The  radiative  heat  transfer  between  these 
surfaces  is  linearized,  with  coefficients  H1’2  =  H2,1. 

The  walls  consist  of  two  parallel  Isotropic  slabs, 
assumed  to  conduct  heat  only  In  one  direction,  ortho¬ 
gonal  to  the  surfaces.  As  we  focus  on  the  contact  pro¬ 
blem,  we  take  the  surfaces  x  =  0  and  x  =  to  be  in¬ 
sulated,  for  simplicity  In  the  formulation.  However 
Inhomogeneous  Neumann  and  Dirlchlet  or  Robin  condi¬ 
tions  can  be  covered  as  well  by  the  present  approach. 

The  cave  Is  heated  homogeneously  at  a  rate  q(t). 
Finally  the  cave  Is  ventilated,  both  directly  by  in¬ 
coming  air  with  velocity  v(t)  and  temperature  To< t) , 

and  Indirectly  by  a  change  of  air  with  rate  K  per  unit 
time  Interval  per  unit  temperature  difference,  the 
outdoor  air  temperature  being  0(t).  In  modelling  the 
ventilation  we  assume  that  : 
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-  the  Incoming  air  is  mixed  very  quickly  with  the  air 
in  the  cave 

-  the  mass  of  the  incoming  air  equals  to  the  mass  of 
the  outgoing  air  at  every  time 

-  the  temperature  and  convective  transfer  are  uniform 

over  the  wall  surfaces  x  =  l  and  x  =  t  . 

1  2 

2.  MATHEMATICAL  MODEL 

Under  standard  assumptions  the  mathematical  problem  of 
the  heat  transfer  through  the  cavity  structure  is  : 

determine  u’(x,t),  x  e  ,  t  >  0,  1  s  i  s  2,  or 

either  T(t),  t  >  0,  which  obey  the  respective  heat 

equations,  with  w1  =  k’/Kl, 

fr-lc  (k,(x>t)-5T)  =  °*  t>0- 

(2.1) 

together  with  the  boundary  conditions 

|u_(°,t)  _  Q  t  >  o  ;  !y_(Vt5  =  0  .  t  >  0  (2.2) 

Sx  ’  0X 

as  well  as  with  the  transition  conditions 

-  kl-|HiKl,t)  =  h,,2*(u1ttl,t)  -  T(t)) 

+  H1,2-(u1«1,t)  -  u2U2,t)),  t  >  0  (2.3) 

kz.|iL(Vt)  =  h2,X-Cu2(l .  ,t)  -  T(t)) 
ox  2 

+  H2,'-(u2(t2,t)  -  u^g.t)).  t  >  0  (2.4) 


and  the  Initial  conditions 


u‘(x,0)  =  u‘(x) 


x  e  nt  ,  t  >  0 


Here,  expressing  the  heat  energy  balance  in  the  cave, 
the  tmperature  T(t)  of  the  inside  air  is  readily  seen 
to  evolve  from  the  initial  value  T(0)  according  to 

cp-  =  g1-(h,,2-(u‘«i,t)  -  Tf t) ) 

+  h2,1-(u2«2,t)  -  T(t))l  -  K-[T(t)  -  0(t)J 

+  g2-v(t)-cp(T0(t)  -  T(t)J  +  q(t),  t  >  0 

v  (2.6) 

where 

c  =  thermal  capacity  of  the  air  In  the  volume  V 
P  between  two  cross  sections  of  the  cave 

g^  =  Sj/V,  where  is  the  area  of  the  wall  surfaces 

between  these  two  cross  sections 

g  =  S  /V,  where  S  is  the  area  of  a  cross  section  of 
2  2  2 

the  cave. 

Consequently, 

t/,i  —  I)  .rlnl  1  .c"K^J  .J-  . 


T(t)  =  C 


T(0)  + 


(gj'lh'^-u’ttj.s)  +  h2,,-u2«2,s)] 

♦  K-O(s)  +  g2'Cp-v(s)'To(s)  +  q(s))'ds 


GCu’.u2)  (t) 
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ie(t)  =  S  [(gVcp)-(h1,s  +  h2’1)  +■  ga-v  +  K/cp]-ds. 

Substituting  this  expression  in  the  transition  con¬ 
ditions  (2.3>-(2.4)  and  translating  the  interval 
(yy  to  (yL),  with  L  =  t*  tj-  1 2>  we  arrive  at  a 

parabolic  problem  for  the  functions  u’(x,t),  x  e  Q  , 

t  >  0,  i  =  1,2,  of  the  type  mentioned  above.  This  is  a 
problem  in  a  two-coaponent  aediua  with  a  juap  both  in 
the  flux  and  in  the  teaperature  at  the  interface  x  =  t 
of  the  2  subregions. 

Remark  2.1.  In  practice,  when  T(t)  varies  slowly  in 
time,  the  left  hand  side  of  (2.6)  may  be  neglected,  cp 

being  saall  (in  popular  models,  even  c  =  0,  (4J).  Then 

12  ^ 

T(t)  a  G(u  ,u  )(t)  takes  a  particular  staple  form. 

The  analysis  nay  easily  be  extended  to  a  structure 
with  M  parallel  wails  and  M-l  enclosed  caves  (H  >  2). 

3.  VARIATIONAL  FORMULATION 


3.1.  Notations  and  assumptions 

Let  H^fl  )  be  the  usual  first  order  Sobolev  space  on 
fl  ,  with  nora  B.B  ,  1  3  i  3  2.  He  set 

V  =  {u  =  (ul,u2)|u‘  e  H* (n4 ) .  1  i  i  s  2) 
and  we  identify  u  e  V  with  the  scalar  function  u  :  £2  -» 
R  for  which  uln  =  ul  on  £1*.  1  s  i  s  2.  Sinllarly  we 


deal  with  the  product  space  H  =  L^Q^ )  x  L^y.  Denote 

2  2 
(u,v)H  =  £  S  u'-v'-dx  ;  b(t;u,v)  =  £  J  w,*u,*v,*dx 

l*i  fl  t=i  £1 


IulH  =  (u,u) 


1/2 


a(t;u,v)  =J  Jk 


Vu.v  e  H 
2 


(3.1) 


-  Q  ‘  §F'5T  dx  *  BvB=^  SvV/2 

1=1  ()t  i»s 

Vu.v  €  V 


Let  T  >  0  be  a  given  number  and  set  I  =  (O.T).  He 
use  the  standard  functional  spaces  C(I,X).  L2(I,X), 

L  (I,X),  etc.,  where  X  is  a  Banach  space. 

00 

Throughout  we  sake  the  assumptions 

w’.k1  €  LIp(I,L  (11,));  w^k'  t  p  >  0  in  Ox  I 

00  I  I 

(p  constant),  1  a  1  s  2 
h1’2.  h2’1  and  H1’2  =  H2’1  €  LipII.R*) 
v(t),  0(t),  To(t).  q(l)  S  Llp(I.R) 
uQ  €  Hl(Qt)  .  15  13  2. 


3.2.  Variational  problca 

Definition  3.1.  A  function  u  :  I  -»  K,  with  u  e  L  (I,V) 

OS 

and  3tu  e  L2(I,H),  is  a  variational  solution  of  (2.11- 
(2.5),  (2.7),  In  the  time  Interval  T.  iff 
b(t;  3tu(t),p)  +■  a(t;  u(t),p) 

+  h,*2-[u,(fj.t)  -  G(u*.iix}(LHV(y 
+  h2,1*  [u2(y  t)  -  G(u'.u2mi)-f  (^ 

+  H,,2-(u*«s,t)-  u2«t.t)]-lp‘(ft)  -  f2«tU  =  0 

Vp  €  V  .  a.e.  In  I  (3.2) 

u(0)  =  u  (3.3) 

O 


From  the  smoothness  of  the  data  and  the  required  regu¬ 
larity  of  u,  all  integrals  In  (3.2)  exist. 

The  relation  (3.2)  is  obtained  from  (2.1)-{2.4)  by 

1  2 

first  dealing  with  the  problems  for  u  and  u  in  the 
usual  way  and  by  next  adding  the  resulting  variational 
equations,  taking  into  account  the  notations  (3.1). 
The  formal  equivalence  of  the  classical  and  the  weak 
variational  problem  can  readily  be  proved. 

4.  DISCRETIZATION  IN  TIKE 

Consider  n  e  N,  a  time  step  At  =  T/n  and  time  points 
tj  =  j*At,  0  3  j  s  n.  He  define  u^  e  V,  Intended  to  be 

an  approximation  of  u(x,tj),  1  s  J  s  n,  by  the  linear 
recurrent  system 

b(tj;  SUj.p)  +  a(tj;  Uj.p) 

*hj2-i“j“.)-c(=;^.1)(tj,]V«1) 

♦  Hj"2- (UjK^)  -  Ujtyj'l^w,)  -  F2U,)1  =  0 

Vj>  e  V,  isj;n  (4.1) 

where 

6Uj  =  (Uj-  Uj  jJ/At  ,  h’'2  =  h,,2(tj).  etc. 

,  u  for  t  e  (t  .t  ).  lsrij-l 

v(t)  =  { 

J  ^  Uj  t  for  t  e  (tj_j.T) 

By  the  Lax-Mllgraa  lemma  it  can  be  shown  that  the 
(elliptic)  problca  (4.1)  for  Uj  e  V  has  a  unique  solu¬ 
tion  In  terns  of  u^ . Uj  ^  1  s  j  3  n. 

Definition  4.1.  The  Rothc  function  ufnl  :  I  ->  V,  In¬ 
tended  to  be  an  approximation  of  u,  is  Introduced  by 

U<n,(t)  =  Uj  t+  5Uj- (t  -  ^  s),  tj  *  t  3  tj.  1  3  j  3  n. 

(4.2r 

From  here  on  C  >  0  is  a  generic  constant  neither 
depending  on  At  nor  (in  §  5)  on  A. 

Proceeding  to  some  extent  similarly  as  In  (2)-l3J, 
we  say  prove 

TKE0REH  4.1.  There  exists  a  function  u  €  C(I,H)  n 
L  (I.V),  with  3,u  e  L_(I,H)  (u  Is  differentiable  a.e. 

Z  v  2 

In  I)  such  that  u<n’  4  u  in  C(I.H)  n  L2(I,V)  and 
3tu,n>-i  3j.u  in  L  (I.H)  for  n  4  *».  Korcovcr 

Bu  -  U"”SC(I.K)  *  Bu  "  u,B>iL2(I.V)  *  C’i/VS  {4-3) 
Finally  u  is  the  solution  In  the  sense  of  Defin.  1.1. 

Remark  4.1.  Hhen  the  lnital  function  u  €  V  satisfies 

o 

a  ’compatibility  condition',  viz.  when  there  exists 

zq  €  H.  to  be  Interpreted  as  3up.  such  that  (4.1) 

holds  for  J  =  0  loo,  then  the  estimate  (C.3'  can  be 
Improved  to  OU/n).  Moreover,  then  u  €  LipJ/2lI,V)  and 

3.U  e  L  (I.V)  n  L  (I.H). 

L  i  C3 

5.  FULL  DISCRETIZATION 
5.1.  Abstract  error  estimate 

Consider  a  family  of  (rinitc  clement)  sub¬ 

spaces  of  ¥,  Introduce  u^  c  V^.  the  Galerkln  approxi¬ 
mation  of  Uj,  0  3  j  3  n.  by  a  similar  recurrent  system 
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to  (4.1),  where  now  <p  e  V.  and  where  u  is  replaced  by 
A  -i  9 

a  suitably  choosen  approximation  u  sV., 

0  A 

Put  a  =  (At, A).  The  discrete  Rothe  function  ul  ;  is 
defined  by  a  similar  relation  to  (4.2).  To  obtain  the 
counterpart  of  Theorem  4.1,  we  assume 


u  4  u  in  V  if 
0  0 


A  4  0 


(5.1) 


For  any  z  e  L  (I , V)  there  exists  z.  e  .  L  ( I ,  V., )  such 

2  A2A 


that  2.  •>  z  in  L  (I,V)  if  X  4  0 

A  2 


(5.2) 


For  finite  element  choices  of  c  V,  (5.2)  is  implied 

by  an  inequality  of  the  type  (5.5)  below. 

THEOREM  5.1.  Under  the  additional  assumptions  (5.1-)- 
(5.2)  the  convergences,  mentioned  in  Theorem  4.1,  are 

valid  for  u<ct>  if  a  4  0.  Moreover, 
llu<0t>~  ullC(I,H)  +  llu'a)"  UllL2(T,V) 

s  C'[At  +  >V  Uo!H  +  "U  _  wllL  (r.H)  +  "U  "  w"l  (I.V) 

2  2 


Vw  e  L  (I ,  V, ) 
2  X 


(5.3) 


Remark  5.1.  This  estimate  can  be  improved,  viz.  At  may 
2  A 

be  replaced  by  (At)  ,  when  uq  satisfies  a  ’compatibi¬ 
lity  relation’.  More  precisely  zA  e  V. ,  defined  by  a 

0  A 

similar  relation  to  (4.1)  with  J  =  0  ,  p*e  V\  ,  and  u 

A  X  A  O 

replaced  by  u  ,  has  to  obey  |z  |„  <  C  if  A. 4  0. 

0  On 


5.2.  Rate  of  convergence  in  the  mesh  parameter 
Let  a  regular  family  of  partitions  of 

131*2,  with  global  mesh  parameter  X.  Introduce 


x*  =  {  v‘  e  c0(nA) I  v‘|K  e  Pt(K) 


VKsx'  > 


(5.4) 


VA  =  {  v  =  (v*,v2)  |  v‘  e  X^  ,  1  3  i  s  2  >  c  V 

For  the  Lagrange  finite  element  spaces  we  know 

|v‘  "  va'l  (n,)  +  A’llvl-  vami  *  c-a2-|IVV«v 

2  1  12  i 

Vv1  e  Hz(flj)  (5.5) 

where  v'  =  n!  v1  and  jt’  :  C°(f2. )  4  X*  is  the  standard 

A  A  A  1  A 

Lagrange  interpolator  or  it’s  Clement’s  generalization 
to  ^(Qj.),  1  s  i  5  2. 

Moreover,  taking  uA  =  (tl  u1,  n2  u2),  we  get 
lV  uj|„  *  C-X-lluoll. 

Combining  these  estimates  with  Theorem  5.1,  we  have 

THEOREM  5.2.  Assume  that  u1  €  L  (I,H2(n. )),  1  s  i  s  2, 
\  2  1 

Take  V,  c  V  and  u  e  V.  as  indicated  above,  then 
A  0  A 

UllC(I,H)  +  "u<a>-  ullL  (I.V)  =  °(At  +  ^ 

2  X 

If  the  compatibility  condition  on  uq,  mentioned  in 
Remark  5.1,  is  satisfied,  then  this  estimate  is  impro¬ 
ved  to  0( (At)2  +  X2). 


6.  NUMERICAL  EXAMPLE 

We  consider  a  simple  test  problem,  cfr.  Remark  2.1, 
the  exact  solution  of  which  is  known  : 

Determine  u1  in  (0,1)  and  u2  in  (1,2),  t  >  0,  obeying 

the  D.E.’s  (2.1),  where  k1  =  1,  k2  =  2,  w1  =  w2  =  1, 
together  with  the  B.C.’s  (2.2)  at  x  =  0  and  x  =  2 


respectively,  as  well  as  with  the  T.C.’s  at  x  =  1 
-  flu1  =  5-(u‘-  u2)  +  5,  2-axu2  =  5-(u2-  u1)  -  3  , 

and  the  I . C. ’ s 
u'tx.O)  =  cosOj-x), 

u2(x,0)  =  (-l/V^-sln^l/sinOj/V^-cosUBj/^Mx^)) 

Here  0  =  1.590724  is  the  first  positive  root  of 

cotg  0  +  (l/v'2)-cotg(0/v'2)  =  (3/5 

By  the  method  of  seperation  of  variables  the  analy¬ 
tical  solution  reads 

2  2 
u'fx.t)  =  e  V1-  u*(x),  u2(x,t)  =  e  ^1  u2(x)  +  x 

As  in  §  5.2  we  use  a  linear  FEM  with  nodes 

xi  =  5.  +  t-\,  0  5  (  i  I  £  N  .  1*1*2 

C  1-1,1  A  0 

As  error  characteristics  we  use  discrete  L  -  and  L  - 

1  CO 

norms  2  J/A 

e  (t)  =  £  £  |u(x‘,t)  -  u(a>(x‘.t)|-X 

1  ci  2=o 

2  l/X 

e,(t)X  =  100-e  (t)/  £  £  |u(x't)|-A 

1  1  1=1  0  1 

M(t)  =  max  max  |u(x^,t)  -  u(cc)(x^,t)| 

The  table  below  shows  accurate  results,  even  for  a 
coarse  mesh. 


t 

0.1 

0.2 

0.3 

0.4 

0.5 

102  -e  (t) 

I 

0.04 

0.09 

0.14 

0.19 

0.2 

II 

0.002 

0.0038 

0.0049 

0.005 

0.006 

102-e,  (t)54 

I 

6.9 

19 

40 

70 

112 

II 

0.449 

0.993 

1.65 

2.45 

3.43 

102-M(t) 

I 

0.09 

0.15 

0.18 

0.2 

0.2 

II 

0.001 

0.0025 

0.003 

0.0034 

0.0036 

Table.  Case  I  !  At  =  10"2,  X  =  1/4. 

Case  II  :  At  =  10  ,  X  =  1/32. 


Using  a  Crank-Nlcholson  modification  of  the  seml- 
dicrete  scheme  of  §  4,  the  results  may  be  Improved  by 
about  30  54.  This  and  other  generalizations,  e.g.  to  3D 
problems  including  non-linear  phenomena,  are  investi¬ 
gated  in  a  forthcoming  paper. 


REFERENCES 

[1]  Kacur  J.,  Method  of  Rothe  In  Evolution  equations, 
Teubner,  Leipzig  (1985). 

[2J  Ka6ur  J.,  Application  of  Rothe' s  method  to 
Integro-dlfferentlal  equations,  J.  Relne  Angew. 
Math.,  338,  73-105  (1988). 

(3)  Ka5ur  J. ,  Van  Keer  R.,  On  a  Rothe-Calerkln  finite 
element  method  for  a  parabolic  problem  with  a 
Volte rra  operator  In  the  boundary  condition,  in  : 
Whiteman  J.R. ,  The  Mathematics  of  Finite  Elements 
and  its  applications,  Academic  Press,  London, 
(1991)(to  appear). 

(4)  Pratt  A.W. ,  Heat  Transmission  in  Buildings,  J. 
Wiley,  Chichester  (1981). 


914 
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Abstract-A  linearised  cylindrical  wave  motion 
is  considered  for  a  fluid  of  finite  depth  in 
the  presence  of  an  impermeable  cylindrical  wall 
and  coaxial  porous  wall  immersed  vertically  in 
the  fluid.  The  motion  is  generated  once  by  the 
impermeable  wall  and  next  by  the  porous  wall. 

A  wave  trapping  phenomenon  is  investigated. 

1 .Introduction 

The  classical  problem  of  forced  two-dimension¬ 
al  wave  motion  with  outgoing  wave  at  infinity 
generated  by  a  harmonically  oscillating  vertic¬ 
al  wavemaker  immersed  in  water  was  solved  by 
Havelock  [l]’,Biesel  &  Suquet  [2]  and  Ursell, 

Dean  &  Tu  [3].  In  these  works, the  wavemaker 
was  represented  by  a  vertical  impermeable  plate 

ChWang  [A],Chwang  and  Li  [5],Chwang  and  Dong 
[6],Gorgui  and  Faltas[7]  treated  wave  motion 
problems  in  the  presence  of  porous  plates. 

In  the  present  paper  we  investigate  the  effect 
of  porosity  on  axisymmetric  wave  motion  in  flu¬ 
id  of  finite  dgpth.  The  wave  trapping  phenomen¬ 
on  is  discussed. 

2. Waves  generated  by  the  impermeable  wall 

We  are  concerned  with  the  irrotational  motion 
of  fluid  with  free  surface  which  is  assumed  to 
be  incompressible  and  inviscid  flow  under  the 
action  of  gravity.  The  motion  is  indued  by  an 
impermeable  vertical  cylindrical  wall  of  circu¬ 
lar  cross-section  of  radius  a.  The  wall  assumed 
to  perform  radial  harmonic  oscillations  normal 
to  its  axis,  let  its  velocity  at  time  t  be 
U(y)  exp(-iwt) , where  U(y)  is  a  complex  valued, 
and  suitably  limited.  A  coaxial  cylindrical  po¬ 
rous  wall  of  circular  cross-section  of  radius  b 
(>a)  is  fixed  in  the  fluid.  The  resulting  moti¬ 
on  is  therefore  axisymmetric  and  time  harmonic 
with  the  same  angular  frequency  u  as  that  of 
the  porous  wall. 

Let  (-.r,y)  be  cylindrical  polar  coordinates 
with  the  origin  0  in  the  undisturbed  free  surf¬ 
ace  such  that  Oy  pointing  down  into  the  fluid 
cinciding  with  the  axis  of  the  porous  wall. 

We  consider  the  case  when  the  fluid  is  of  fin¬ 
ite  depth.  Let  $  .  (r,  y ;  t  )  =  Re[  <*> .  ( r ,  y )  exp(-iwt) ] , 

J  J 

be  the  velocity  potentials  where  the  subscripts 


j  =  1 , 2  refere  to  the  regions  a<r<b,r>b 
and  the  functions  satisfy 

iff*  *  r  h  *  •  >>0  l2-1) 

K  =0,  on  y  =0,  K=w2/g  (2.2) 

=  U(y),  on  r=a  (2.3) 

fr^l  =  17^2  ’  on  r=b  (2. A) 

We  sail  assume  that  the  porous  wall  is  made  of 
material  with  very  fine  pores.  Thus  according 
to  Darcy's  low  [5,8],  we  have 

■gjdij  =  iG(<5^  -  4>2 )  j  on  r=b,  G=pwb/p  ,  (2.5) 

p  is  the  dynamic  viscosity, p  is  the  density  and 
b  is  a  coefficient  which  has  the  dimension  of 
length 

4>j  =°>  on  y  =h,  and  (2.6) 
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<*’2‘>C  ”o1)(Kr)  Cosh  as  r  +  ®  (2.7) 

yjhere  k  is  the  real  positive  root  of 
k  sinh  kh  -  K  cosh  kh  =0. 

3 .Solution  of  the  problem 
Using  the  method  of  separation  of  variables, 
solutions  of  (2.1)  satisfying  ( 2 . 2 ) , ( 2 . 6) , ( 2 . 7) 
can  be  written  in  the  form 

h=£=l[An  Ko(knr)]  C0S  kn(h'y) 

+  [ct  +  H^(icr)]  cosh  x(h-y)  (3.1) 

*2=LlCn  Ko(knr)  cos  kn(h"y)  + 

+y  Hg^(tcr)  cosh  x(h-y).  (3.2) 

From  (2. A), (2. 5)  and  (2. 3), we  get 

U(y)=ilfGknCnA(ikn)coS  kn(h"y) 

-jp  a(k)  cosh  (h-y)  in  which 


A (k )sG  H^1)(ka)+|k':b  H^l;  (kb)[ ^(kb)  -  J1(ka)x 
H{X)(kb)]. 

Since  the  eigenfunctions  cosh  ic(h-y)  and 
cos  krs(h-y)  are  orthogonal  over  (0,h)  we  have 


(D, 


n8Ga  cos  k  h 
„  n _ n_ 

'n  =  6n  A(ikn> 


AaGa  cosh  tch 
y  =  -  6 p  A(7)—^here 


o0  =  2xh  +  sinh  2tch  ,  =  2knh  +  sin  2knh 


_ i —  (h 

ncosh  Kh  J 


U ( y )  cosh  x(h-y)  dy 


7cosV"h  1  U(y)  cos  kn(h"y)  dy 


Consequently 

a  cos  k  h  ~ 

¥-8iLf7nn[knbKl(knb)Io(knb)-tiG-knb>( 

n  n 

^7ia  cosh  Kh 

I.(kb)K1(kb)}K(kr)]cos  k  (h-y)-  - 0 


oqA (k)  x 

[J5HK2b(H^1)(Kb))2Jo(Kr)-{G+^1iK2bH|1)(Kb)J1(Kb)} 

xH^)(Kr)  cosh  k ( h-y )  ,  (3.3) 

a  cos  k  h 

<^>2=  —  8Gfi= 1 6°  Alik  )  Ko(knr)  cos  kn(h_y) 


n  n 
4fiGa  cosh  Kh  , ,  * 

- -  Ho  Ukt)  cosh  k  ( h-y )  . 


(3. A) 


The  last  term  on  the  right  hand  side  of  equat¬ 
ion  (3. A)  represents  the  outgoing  wave  transmi¬ 
tted  through  the  porous  wall. 

When  the  porous  wall  is  completely  permeable, 
the  velocity  potential  in  the  region  r  >  a  is 
a  cos  k  h 

611  tr  5"K~Tir)'  Ko(knr)  cos  kn(h-y) 

n  i  n 


bn  a  cosh  Kh  /  *  v 

+  - - - — m -  H’  '(xr)  cos  x(h-y). 

0 


60  nj1)(Ka) 


For  an  impermeable  wall  (G=0) , (3 .3) , (3 . A) 
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reduce  to 


w  ancos  knh  K1(knb)I0tknr)-I1(knb)K0(knr) 

6n  h(knb)Vkna)-Vkna>K^knb) 


^71 


a  cosh  *ch 

o _ _  _  _ 


x  cos  k  (h-y) 

n  °0 
Y  ,.(xb ) 3  (xr)-3 . (xb) Y  (xr ) 

J1(Kb)Y1(Ka)-J1(Ka)Yr(tcb)  C0Sh  K(h_y)’ 

$2=0,  as  expected.  This  solution  is  valid  only 
when  the  quantity  3^(xb)Yj-(xa-)-3j(xa)-Y-j(xb)  is 

different  from  zero. However,  it  indicates  that 
when  this  quantity  vanishes, resonance  occurs 
arid  the  linearised  theory  can  not  be  applied. 

'  4. Waves  generated  by  the  porous  wall 
If  we  let  now  the  porous  wall  oscillate  radia¬ 
lly  about  r=b  with  velocity  U ( y )  exp(-iut)  whi¬ 
le  the  impermeable  wall  r=a  be  kept  fixed, then 
the  new  problem  is  the  same  as  stated  in  secti¬ 
on  2  except  that  (2.3), (2.5)  are  replaced  by 

(4-.1) 


g-pi-i  =  0,  on  r  =  a 

-  U(y.)  =  iG  ( jl  “  4> 2 } 

In  this  case  we  get 

bk2a_cos  k  h  K,(k  b) 


(4.2) 


h--BiZi 


n~n  ~n"  '1 

OTTO 


■CIo(knr)Kl(kna)H 


2u2x2ba  cosh  xh 
o 


6  QA  (  x  ) 


Ko(knr)I1(k(1a)]cos  kn(h-y)  + 
[Jo(Kr)Hj1)(Ka)-H^1)(xr)31(xa)]H}1)(xb)x 


cosh  x(h-y), 

k2ba  cos  khK(kr) 
~  n  n  non 


(4.3) 


<>2  =  8iS=l" 


6n  A(ikn) 


[K1(knb)I1(kna)- 


2n2x2ba  cosh  xh 
Il(-knb)Kl(kna)  cos  kn(h-y)+' - 57T7F -  * 

[31(xb)Yr(xa)-J1(xa)Y1(xb-)]Hj1)(Kr)cosh  x(h-y) 

(4.4) 

When  31(xb)YJ(xa)-JjL(xa)Y1(xb)  =  0, waves  are  tr¬ 
apped  in  the  bounded  region  between  the  two  cy¬ 
linders  a  <_  r  £  b  and  no  waves  radiate  away  fr¬ 
om  the  wall; liquid  simly  piles  up  around  the 
wal  l . 

5 .Wave  trapping 

y 

Let  C  cosh  x(h-y)H^  (xr)  incident  normally, 

proceeding  from  infinity,  the  porous  wall  at 
r=b  and  tne  impermeable  wall  at  r=a  are  both 
fixed. The  functions  $ .  are  harmonic  that  satis¬ 
fy  (2. 2), (2. 6)  and  J 


3r*l=3r*2::lG^*l-<'>2^  ’ 

on  r=b, 

(5.1,2) 

^^=0,  on  r=a, 

(5.3) 

§2+  C  cosh  x(h-y) 

H(Q2)(xr) 

+A  cosh  x(h-y) 

H^1)(xr) 

0 

(5.4) 

Consider  the  functions 
^j=  -  2CJQ(xr)  cosh  x(h-y) 

These  new  functions  are  harmonic  satisfying 
the  free  surface  conditions  and 
3  _  3 


17*1  =  37*2 


(5.5) 


=  iG(\Jij, -i^)  +  2C  3^(xb)  cosh  x(h-y),(5.6) 


3r -1 


Ui,=  2C  3 .  ( x3 )  cosh  x(h-y), 


(5.7) 


and  /  ■,  \ 

( A-C ) H ^  ^(xr)  cosh  x(h-y)  as  r+co  (5.8) 
Since  the  present  problem  is  linear , $2  can 

be  obtained  by  suitable  superposition  of  the 
results  (3.3),  (3. 4)  and  (4. 3), (4. 4)  respective¬ 
ly.  Hence 

*1  =  ^ (Ka)3Q(xr)  -  31(xa)H^  (xr)  ]x 

cosh  x(h-y) 


=  -C 


■A  ^  H^(xr)  cosh  x(h-y)  + 


A(x 

C  H^(xr)  cosh  x(h-y) 


where  A'(x)  =GH^  ^'(xa)+^ux2bH^  ^  (xb)  [  J  ^  (xb)  x 
H^^xa)  -  J1(xa)H[1)(xb)] 

The  coeficient  of  reflection  R  is  defined  as 
the  ratio  of  the  amplitude  of  the  reflected 
wave  to  the  amplitude  of  the  incident  wave 


R  = 


A  '  ( x  ) 

a2G2-2xM2G+B2x2M2j 

A  ( x ): 

a-G2  +  2xM2G+B‘!x‘:M2j 

(5.9) 


ct2=%nxb[3|(xa)+Y|:(xa)  ]  , 

6  2=%ti  xrb  [  3|(xb)+Y|(xb) ) 

M  =^nxb[3jL(xb)Y1(xa)  -  3j(xa)Y^(xb)  ] 

For  an  impermeable  wall, the  incident  wave  is 
totally  reflected  by  it. We  get  the  same  situat¬ 
ion  when  the  wall  is  completly  permeable  but 
now  the  wave  is  totally  reflected  at  the  imper¬ 
meable  wall  at  r=a.  We  note  also  that  when  M=0 
i.e.when  a  and  b  satisfy  the  eqation 
J1(xb)Y1(xa)  -  31(xa)Y1(xb)  =  0  , 

the  incident  wave  is  totally  reflected  irrespe¬ 
ctive  of  the  vale  of  G  .By  simple  differentiat¬ 
ion  of  (5.9),  we  note  that  the  value  of  R  for 
any  fixed  a  and  b  reduces  to  a  minimum 

r  -  [<*6  -  M 1^ 
min  ”  [ccB  +■  MJ  > 

when  —  =  — ,  this  minimum  value  vanishes  when 
x  a 

aB=M'  or  when  a  and  b  satisfy  the  equation 


Jj(xa)Jj(xb)  +  Yj(xa)Yj(xb)  =0  (5.10) 

in  this  case  ~=B?  Under  these  circumstances  the 
porous  wall  acts  as  an  efficient  wave  absorber 
or  eleminator  for  the  incident  waves,  i,e.  for 
the  values  of  G/x=B2and  where  a  and  b  satisfy 
equation  (5.10),  there  is  a  wave  trapping  phen¬ 
omenon  that  is, wave  will  be  trapped  inside  the 
region  a  <  r  <  b. 
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Abstract  -  Steady  plane  raagnetohydrodynamic  flow  of 
a  viscous  incompressible  fluid  of  infinite  electrical 
conductivity  is  governed  by 

div  _V  =  0  * 

p(V.grad)V  +  grad  p  =  u  V 2  V  +  p  (curl  1!)  x  H 
curl(V  x  H)  =  0, 
div  X1  =  0 

where  V  =  (u,  V)  denotes  the  velocity  vector, 

H  =  (Hp  H«)  the  magnetic  field  vector.,  p  the  pres¬ 
sure,  p  tfie  constant  fluid  density,  p  the  constant 
coefficient  of  viscosity  and  p  the  constant  magnetic 
permeability.  The  magnetic  field  vector  H  is  given 
by  the  solution  of 


V  .  11  ?  0  , 

V  x.Tl  =  A  K 

when  the  magnetic  field  is  orthogonal  to  the  velocity 
field.  Writing  the  governing  equations  in  x,  y  co¬ 
ordinates  and  recasting  these  in  new  independent 
variables  z  =  x  +  iy  and  z  =  x  -  iy,  we  find  that: 
‘If  ij/(z,  z)  is  the  streamfunction  of  the  flow, 
clfen  lfi(z,  z)  must __satisfy 

ik _ -  — Im{ »{/  -  iji  }- 

yzzzz  U  Yzzz-  z 


’  32p  fRe{[lm{(  , 

^z^z 


+  ^Im  {  (■ 
zz- 


TT>z  *z}} 

rA  ■ 


0 
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H  +  Re{(Ft-V*2}=0 

:zTz  rzTz 


We  have  studied  exact  integrals  for  four 
different  flow  geometries  and  Hamel's  problem  [1]  in 
this  work.  The  novelty  of  this  work  is  in  its 
approach  since  the  Hamel's  problem  that  has  been 
investigated  here  was  also  investigated  by  Chandna 
and  Toews  [2].  The  approaches  used  in  the  previously 
published  works  required  the  transformation  of  the 
flow  equations  to  curvilinear  coordinates  when  the 
streamlines  and  their  orthogonal  trajectories  formed 
the  coordinate  net.  No  such  transformation  is 
required  in  the  present  complex  variable  approach. 


The  streamlines  and  their  orthogonal  traject¬ 
ories  form  an  isometric  net  for  incompressible  and 
irrotational  steady  plane  flows.  G.  Hamel  invest¬ 
igated  those  steady  plane  rotational  fluid  motions 
for  which  the  streamlines  and  their  orthogonal 
trajectories  form  an  isometric  net.  This  problem 
is  called  Hamel's  problem.  Martin  [3]  gave  new 
formulation  of  the  Navier-Stokes  equations  and 
studied  Hamel's  problem  as  an  application  of  his 
approach.  His  method  also  required  the  transform¬ 
ation  of  the  flow  equations  to  the  streamline 
curvilinear  coordinates. 


Complex  variable  technique  employed  in  this 
paper  is  well  known  for  the  analysis  of  fluid 
dynamic  problem.  Wan-Lee  Yin  (4),  Ratip  Berker  [5] 
and  Stallybrass  [6)  have  employed  this  technique  in 
their  recent  researches. 
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ABSTRACT  -  This  paper  presents  an  analysis 
for  the  superharmonics  of  a  forced  nonlinear 
vibration  problem  involving  small  parame¬ 
ters,  using  a  generalized  harmonic  balance 
method.  A  nonlinear  ordinary  differential 
equation  with  several  nonlinear  terms  and  a 
periodic  forcing  function  is  considered.  For 
the  case  of  superharmonic  oscillations  of 
order  2,  the  key  equtions  for  the  obtaining 
the  information  on  the  superharmonics  will  be 
derived,  including  a  new,  nonlinear  ordinary 
differential  equation  of  a  slow  varying  func¬ 
tion  compared  with  the  original  dependent 
variable.  Using  these  equations,  the  steady 
state  solution  and  its  stability  behavior  can 
be  calculated.  Results  for  a  special  set  of 
parameters  are  obtained,  including  a  stable 
node  for  the  steady  state  solution  and  the 
associated  van  del  Pol  plane. 

1.  INTRODUCTION 

It  is  well  known  that  nonlinearities  can 
cause  sub-  and  super-harmonic  excitations  in 
vibratory  systems.  The  analytical  understand¬ 
ing  of  such  phenomena  is  often  difficult  to 
obtain.  It  has  been  shown  that  the  method  of 
multiple  scales  can  be  used  to  solve  such 
problems  as  demonstrated  in  several  papers  by 
Nayheh  (1,2]:.  However,  the  procedures  invol¬ 
ved  are  quite  complicated  and  requires  recur¬ 
sive  solution  of  differential  equations,  the 
elimination  of  secular  terms  and  reconstitu¬ 
tion,  all  of  which  are  nontrivial  procedures. 
More  recently,  in  a  paper  by  Noble  and  Hu¬ 
ssain  (3],  an  expansion  method  was  introduced 
together  with  suggestions  of  several  other 
approaches  which  may  be  used  as  alternatives 
to  obtain  pertinent  information.  One  of  these 
is  the  genralized  harmonic  balance  method 
( GHB )  (4,5,6].  This  variant  of  the  harmonic 
balance  method  consists  of  two  parts:  first, 
to  derive  the  form  of  solution  using  only  the 
basic  steps  of  multiple  scales,  and  then, 
solve  for  the  coefficients  of  various  har¬ 
monics.  In  this  approach,  the  elimination  of 
the  secular  terms  is  accomplished  implicitly, 
thus  avoiding  the  trouble  of  solving  recur¬ 
sive  differential  equations.  This  paper 
begins  with  a  general  nonlinear  ordinary 
differential  equation  with  several  nonlinear 
terms  and  a  periodic  forcing  function,  a 
specific  case  of  superharraonic  oscillations 
of  order  2  will  be  investigated.  Next,  the 
key  equations  are  derived,  from  them  the 
essential  information  on  the  superharmonics 
can  be  obtained.  Finally  Numerical  results 
are  presented  on  the  steady  solution  and  the 
stability  behavior  for  a  special  sets  of 
parameters . 

2.  DERIVATION  OF  THE  KEY  EQUATIONS 

We  shall  consider  the  following  rather 
general  differential  equation: 

d2  u/dt2  +u+2e//(du/dt)  +  ea,  u2  +e2  a3  u3 
+eot4  (du/dt)2+s2a5u(du/dt)2=2fcos(Qt)  (1) 

where  u(t)  is  the  unknown  function  /.•  and  ak , 
k=2,3,4,5  and  6,  are  given  constants,  e  is 


the  small  perturbation  parameter;  £  and  a 
pertain  to  the  magnitude  and  frequency  of  the 
forcing  function.  For  superharmoriics  of  order 
2,  one  has 

29  =  w=w0+ec  =  l  +  e<;  (2) 

where  w  is  the  "fundamental"  frequency  of  the 
nonlinear  vibration,  which  is  a  perturbation 
from  that  of  the  linearalized  system  w0 , 
taking  to  be  unity  in  (2)  without  a  loss  of 
generality. 

We  shall  derive  a  two-term  approximate 
solution  usUq+su!  for  equation  (1).  using  a 
procedure  described  previously  in  (4,5),  it 
can  be  shown  easily  that  that  the  final  form 
of  the  solution  u,  which  is  good  tc  the  order 
of  e  must  have  the  following  form: 

U=sU0+( (UjA+UjA2 )+e(U3A3+U4A4 )+cc  (3) 

where  cc  stands  for  the  complex  conjugate. 

The  following  symbals  has  been  introduced: 

A=exp( it/2 ) ,  S=exp( i ect/2 )  (4) 


Eq.  (1)  can  then  be  written  as 

d2  u/dt2  +u+2 ea( du/dt )+ea,  u2  +e2  a3  u3 
+  ca4  (du/dt ) 2  +e2  ocsu(du/dt  )2  °fSA2  +cc  (1'  ) 

Here  we  note  that  S  is  a  slow  varying  func¬ 
tion  compared  with  A  in  the  sense  that  while 
dA/dt  is  of  0(1),  ds/dt  is  of  0(e).  We  shall 
also  use  the  fact  that 

A  =  e-it/2  f  and  a  A  =  1  (5) 

where  an  overbar  denotes  the  complex  conju¬ 
gate.  The  procedure  here  is  to  substitute  (3) 
in  (1')  and  set  to  zero  the  coefficients  of 
Ak ,  k=0,l  and  2,  since  any  higher  harmonics 
will  be  of  0(e2)  or  higher  according  (4).  We 
first  obtain  the  following  approximate  ex¬ 
pressions  (in  other  words,  the  right  hand 
side  should  have  added  "+  terms  of  0(s3)  and 
higher"  in  each  of  these  equations): 

du/dt=(dU3/dt+iU3 )A 
+e[du0/dt+(du2/dt+2iu2 )A2 ]  +  cc  (6) 

d2  u/dt2  °ed2 U.  /dt2  +( d2  U3 /dt2  +2idU3 /dt-U3 ) A 
+e(d2U2/dt2+4idU2/dt-4Uj )A2  +  cc  (7) 

u2 =2U3 U3 +U3 2 A2 +2e ( U3 U2 +U0 U3 )A  +CC  (8) 

Since  u3  appears  with  a  coefficient  of  e2  in 
(1),  one  only  needs  to  keep  terms  of  0(1)  in 
the  expansion: 

u3  =3Uj 2 U3 A  +  cc  (9) 

Similarly,  one  keeps  0(e)  terms  in  (du/dt)2, 
but  only  0(1)  terms  in  u(du/dt)2 : 

(du/dt )2=  2Uj  U3 - ( U3  2  A2  +cc )  (10) 

u ( du/dt ) 2  =U3  2  U3  A  +  cc  (11) 
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We  now  substitute  (4)  and  (6)— (11)  in  (1'), 
collect  terms  of  like  power  of  Ak  ,  k=0,l  and 
2,  and  then  set  the  coefficients  to  zero.  The 
resulting  equations,  for  the  coefficients  of 
A0,  A1  and  A2  respectively,  are: 

e  [  U0  +2  (  a2  +a4  )  Uj  U,  +  ( 1/2 )  (4a2+oc4  )U2U2  )=0 

(12) 

3Uj  /4-f S+idUj  /dt+i  e/yUj  +  e  ( 2a2  +a4  )U4  U2  =0 

(13) 

2i(dU2/dt+e//U2  )+e(4a2-a4  )U3 2 /4+d2 U2 /dt2 
+  e  ( 2/zdU2  /dt+i  a4  U2  dU3  /dt 
+  e2  (2a2U0U2  +  (2a2+3cc4/2)U1U3+2(a2+2a4  )U2U4 
+  (  3a} +a5  )U2  2  U2 +  (  6a3 +a5 /2  )U2  Uj  U2_)  ]  =  0 

(14) 

-5eU3/4+e( 2a2 -a4 )U4 U2  =  0  (15) 

-3eU4+e(a2-a4  )U22  =0  (16) 

From  (12),  (15)  and  (16),  U0 ,  U3  and  U4  can 
be  solved  directly  in  terms  of  U3  and  U2 : 

U0  =  -2(a2+ot4.)U1_U1-(l/2)(4a2+a4  )U2U2  (17) 

U3  =  (,4/5 )  (  2a2  -a4  )U3  U2  (18) 

U4.=  (a2^ot4  )U22/3  (19) 

In  equation  (13 )  and  (14),  however,  it  is 
observed  that  some  terms  are  of  one  order  of 
e  greater  than  the  others.  The  terms  of 
higher  order  in  e  can  thus  be  less  accurate 
than  others  and  still  yield  the  same  order  of 
approximation  in  these  equations.  One  then 
can  solve  these  equation  first  using  only  the 
dominant  terms.  Then,  substitute  the  results 
back  into  the-  terms  of  higher  order  in  e, 
solve  the  full  equations  and  obtain  improved 
results.  The  immediate  purpose  here  is  to 
reduce  (16)  into  a  first  order  differential 
equation  in  U2  and  express  all  the  other  Uk  s 
in  terms  of  U2 . 


c2  =  4  (  4a2  -ct4  )/9 

c2  =  ( 9ct3  +3as -10a2  2  -10ot2_a4  -4a4  2  )/3 
c34  =  c3  +ic4 

with  (24) 

c3  =  2o(20cc2-17tx4  )/27 

c4  =  -2fj(  52a2 -13ct4  )/27 

and 

c5  =  (  1440<x3  +120a5 -1472a2  2 
-368a2  a4  -128oc4  2  )/135 

The  key  equations  (4),  (16),  (17),  (18),  (19) 
and  (22)  can  be  further  simplified  by  the 
following  change  of  variables.  Let 

Uk  =  VkSk  ,  Vk  =  UkS‘k,  k=0 , 1 ,  . .  4  (  25) 

where  S  has  been  defined  in  (6).  One  also  has 

dUk/dt  =  dVk/dt  +  ikeoVk/2  (26) 

In  terms  of  Vk ,  equations  (4),  (16),  (17), 
(18),  (19)  and  (22)  become  respectively 

u  =  eV0+[VlB+V2B2+c(V3B3+V4B4 )+Cc]  (27) 

with 

V0  =  -(32/9)(<x2+a4  )  f 2 -2  ( a2 +a4  )V2V2  (28) 

V3  =4f/3+  ( 1/9  )e[8(o-2i/t/)f-16(2cx2+<x4  )  fV2  =  0 

(29) 

V3  =  (  4/5 )  (  2 cx2  - a4  )  V3  V2  (  30) 

v4“(«2-a4  )V22/3  (31) 

and, 

2idV2/dt+e(-2<j+2i//+c3  f2  )V2 
+  e2  ( c2 V2 2 V2  +c3  4  f2  +  ( c5  f2 -//2 ) v2 )  ]  «  0  (32) 

where,  in  (29), 

B  =  SA  =  exp[ (l+eo/2)tl  =  eint  (33) 


Using  the  dominant  terms  in  (13)  and 
( 14 ) ,  one  has 

U4  =  4fS/3  (20) 

2i (dU2/dt+e//U2  ) +  s( 4a2 -a4  )U22/4  =  0  (21) 

Equation  (20)  is  used  in  the  terms  of  order  e 
in  (13)  to  yield  the  improved  U3 : 

U3  =4f  S/3+  ( 1/9 )  e (  8  ( <j-2i/j )  f  S 

-16 ( 2a2  +a4  ) f SU2  =  0  (22) 

Now,  the  terms  in  (16),  which  are  of  higher 
order  in  c,  contain  such  quantities  as 
d2U2/dt2,  dU2/dt,  dUj/dt,  U2  ,  U0  ,  U3  ,  U4  . 
These  expressions  can  be  obtained  by  using 
(21),  (22),  their  differentiations  (for 
d2U./dt2  and  du2/dt),  (17),  (18)  and  (19). 

The  final  form  of  (16)  can  be  written  as  th'- 
following: 


Hence  the  original  differential  equation  (1) 
has  been  reduced  to  (32),  where  V,  is  the 
unknown  function.  Once  V2  is  solved,  other 
Vks  can  be  obtained  from  (28)  through  (31). 
Then  u(t)  is  given  by  (27). 


To  illustrate  what  kind  of  information 
one  can  extract  from  the  equations  derived  so 
far,  we  shall  obtain  the  magnitude  for  a 
superharmonic  in  the  steady  state  solution 
and  determine  the  stability  of  such  a  solu- 
tion.  First,  we  shall  write  the  needed  equa¬ 
tions  in  terms  of  real  variables.  To  this 
end,  let 


v2”V2B+iv2  j=p2  exp( iy2  ) 
V2=(x-iy)/2 


where  now  p2 ,  y2  v2r 
real  functions  of  t. 


=x/2  and  V21=-y/2  are  all 
One  also  has 


dv2 /dt= ( dx/dt-idy/dt )/2  (35) 


2idU2/dt+e(  2i//U2  +c2  f2  S2  U2 ) 
+e2  ( c2  U2  2  U2+c3  4  f2  S2  +( c5  f2  )U2  )  ] 
where 


0 

(23) 


Note  that  we  have  introduced  two  new  vari¬ 
ables  x  and  y  such  that 

x=2Vj  R ,  y=-2v2I  (36) 
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to  save  some  writing.  Substitute  (34)  and 
(35)  in  (32 )  and  separate  the  real  and 
imaginary  part,  one  has  two  equations  for  two 
real  variables  x  and  y: 

dx/dt+ef/^x+ay  ]  +  e2  [  c4  f2 


-c2  ( x2  +y2  )  y/8+(  c5  f 2  -//2  )  y/2  ]  =  0 


dy/dt+ct/zy-ax+Cj  f2  ]+s2:[crf2 


(37a) 


+c2  (x2+y2  )x/8+(c5  f2-/z2  )x/2  J  =  0 

(37b) 

For  steady  state  solutions,  we  require 
that  the  amplitudes  and  phase  angles  of  va¬ 
rious  harmonic  components  to  be  constant  with 
respect  to  time  t, 


dpk/dt  „  0,  dyk/dt  _  0,  k=0,l..,4  (38) 


Results  for  more  general  cases  will  be 
reported  in  the  future. 


In  particular, 

dp2/dt  -  0,  dy2/dt  =  0  (39a) 

and,  what  is  equivalent: 

dx/dt=0,  dy/dt=0  (39b) 

It  should  be  noted  that  (39a)  actually 
also  quarantee  the  validity  of  (38)  for  k 
other  than  2.  This  fact  can  be  easily 
observed  from  the  relations  of  ( 28 ) — (3 1 ) , 
which  relate  Vk ,  k=0,l,3  and  4,  to  V2 . 

Now,  substitute  (39b)-  in  (37),  one  has 


//x+ay+e[c4  f 2 -c2  (x2+y2  )y/8 

+  (c5f2-//2  )y/2 ]  =  0  (40a) 

//y-vx+Cj  f2+e[c3  f2+c2  (x2+y2  )x/8 

+  (c5f2-//2  )x/2]  =  0  (40b) 

Some  numerical  results  will  be  presented  in 
determining  the  presence  of  superharmonic 
oscillations  for  the  following  given  set  of 
parameters: 


a2=0.3,  ot3=0.1,  a4=0.,  as=0., 
2.0,  <j“3.0,  f-=2.0 


(41) 


This  is  a  very  simple  case  due  to  the  fact 
that  c2  vanishes  as  can  be  seen  from  (24). 
Thus  (40)  become  linear  and  the  solution  can 
be  easily  obtained  as 

x»0.1824,  y=-0 . 0418  (42) 


Hence,  from  (33),  the  magnitude  of  the  super¬ 
harmonic  oscillation  of  order  2,  p2  is 

p2=0.5(x2+y2 ) =0 .3754  (43) 

Next,  equations  (37)  are  integrated  numeri¬ 
cally.  The  result  is  the  so  called  van  del 
Pol  plane  (7)  as  show  in  Figure  1.  As  indi¬ 
cated  in  this  plot,  solutions  converge  to  the 
steady  state  solution  obtained  above  as  the 
time  increases.  Hence  the  steady  state 
solution  is  stable  and  the  point  "A"  of  (42) 
is  known  as  a  stable  node. 


FIGURE  1.  The  van  del  Pol  plane  for  the 
superhantonics  of  order  2  for  the  set  of 
paraneters-given  in  Eqn. (41) .  Point  "A" 
shown  is  a  stable  node. 
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Abstract  In  this  paper  the  two-dimensional 

problem  of  diffraction  of  a  plane 
electromagnetic  wave  on  a  smooth  2'E-periodic 
surface  is  considered.  The  numerical  method 
solving  the  problem  of  diffraction  is 
developed. 

1.  Mathematical  formulation  of  the  problem. 

The  unknown  function  u  satisfies  the 
Helmholtz  equation 


2‘U(f(yM),yM)  -  27E-  K[yM'yp]  ‘  1  (yF 


•u(f (yp) ,yp)dyp  =  e 


Here  I  (y)  =  •!  1  +  [f(y)l 


ife(f  (yM)  -cosct+yM-sinc<) 


A  u  +  k  -u  =  0  (1) 

in  the  region  fi  *■  {  (x,y)  |  -oo  <  x  <  f(y), 
0  <  y  <  2%  }  . 

Here  fe  is  wavenumber,  &*-  ,  f(y)  is  smooth 

2'E-Periodic  function. 

The  boundary  condition  for  the  .function 


-  h-u(f(y).y)  »  i 
In  the  region  x  <  x^ 
radiation  condition 


>  inf 

[0.2111 


f(y)  the 


^ikfx-cosa+y-sinoi)  + 


+oo  -ir  x  ix  y 

+  E  T  -e  n  -e  (31 

n--oo  n 

is  imposed  on  u  .  Here  ct  is  the  angle  between 
the  wave  vector  of  incident  wave  and  x  - 

I  2  2 

axis,  xn  =  fe-sina  +  n,  “  ^n  '  Re  rn~  0 


Im  y 0. 


are  unknown  amplitudes  of 


scattered  plane  waves. 

The  function  u  is  also  assumed  to 
satisfy  the  Flocke  conditions: 

u(x,  211)  -  u(x,  Ol’e'**'  (4) 


g-(x,  210  -  ^(x,  0)-e“  (5) 

where  t  ■  2nft-sinc*. 

2.  Numerical  algorithm  solving  the 
diffraction  problem. 

With  the  help  of  Green's  function  of 
Flocke  canal 


G(M,P)  - 


^  eiVy.eirin|6x| 

L  rZ 


(  here  6x  -  xM-xp,  m  yM-yP  > 

the  problem  is  reduced  to  the  one-dimensional 
integral  equation  for  the  u(f(y),y)  : 


K[yM’yp]  =  h-G(f(yM),yM/f(yp).yp)  - 


«?n(f  (yM}  ’yM'f(yP)  ,yP) 

The  integral  equation  (7)  was  solved 
with  the  help  of  method-of-moments  : 

Following  [1],  let  us  divide  the  segment 
t0,2H]  into  N  equal  length  segments,  using 
points  y  (  yo“0,  yN”2lC  )  ■  Consider 

functions  : 

l,  ye[y,  ..yJ 

4>,(y)  - 

o,  y«(y._1,yll 

Let  us  seek  an  approximate  solution  of 
equation  (7)  in  the  following  form  : 


^(y)  ”  I  Di ‘^(y) 


where  coefficients  D.  are  to  be  determined. 

t 

Function  (y)  is  assumed  to  satisfy 
equation  (7)  in  points  y  ■  (  y  +  - 

l-2 

This  gives  algebraic  equations  for 

coefficients  determination. 

The  expressions  (9)-(14)  give  the  well 
convergent  series,  which  gives  us  the  method 
for  calculating  the  kernel  of  the  integral 
equation  (7) . 


G  (  M,P  ) 


i\o6y  iro|<5x| 
i  -e  ■  e 


+  ^  [e  b  [  ch(g|<5x|)  $4(n,<5x,<5y)  - 

n=l 

-  i -sh(|-|<5x| ) -^(n.dx.dy)  J  + 
R(n,<5x,<5y)  j  (9) 


Here  M  -  (xM,yM) 


P  -  (xp,yp) 


(n,<5x,<5y)  -  cos^yJ-  e"nl6xl  (10) 
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(11 ) 


$2  ( n ,  <5x ,  6y)  -  si_njn6y)  .e-n|<5:<| 


Expressions  (10),  (-11)  can  be  summed: 

00 

^  51.(n,doc,«5y.)  -  -ln2  +  -1 l  - 
n=l 

-  ln|  sh2(  )  +  sin2(  ^  )  j  (12) 


^  i2(n,6x,<5y) 
n-1 


arctg 


t 


sin(dy) 


l6xl  _ 


cos(<5y) 


(13) 


i\  c5y  iy  |<5x| 
5  ie  -e 


5G 

5nP  anP  2y 


oo  .  t , 

lr<5y 


r  x\^y  r  *.  <«» 


<51  (m) 


m“l 


,  (m) 

I  t  1 


i -sh(b  |<5x| ) -^p- -  -  fe2  J^2 1  •  (m )  ■ 


(sign(<5x)-ch(||<5x|)-nx  ++  i -sh(i|<5x|) -n  )  + 


+S2(m)-  (-ch(~|<5x|)-n  +  i ■  sh(£|<5x| )  •  sign(<5x)  ■ 


,nx)  ]  ]  +  Q(m.M, P)  | 


(14) 


Figures  3,  1  show  a  typical  example  of 
distribution  of  electromagnetic  surface 
current. 

Here  ft  -  a  -  60°,  h  -  (l+{) -0.075, 

1 

f(y)  »  -^-sin  y. 


R,  Q  satisfy  the  expressions  (15) 

|  R ( n , <5x , <5y )  |  <  -  :  |  Q(m,M,P)  |  <  £  (15) 

n  m 

The  kernel  of  the  integral  equation 
contains  logarithmic  singularity,  which  is 

expressed  in  explicit  form  in  (12). 

3.  Numerical  examples. 

Figures  1,  2  show  a  peculiar  example  of 
distribution  of  electromagnetic  surface 
current  (  function  u(f(y),y)  ). 

Here  ft  a  -  75°,  h  -  0 

f (y)  -  -|-sin  y. 

Parameter  N  -  30  (  see  (8)  ) 

Energy  error  equals  4- 10"*. 


Fig.  4.  Absolute  value  of  surface  current. 
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Abstract-  A  numerical  method  has  been  developed  for 
computing  coupled  partial  differential  equations 
describing  distributed  feedback  dye  lasers.  This 
method  Is  founded  on  the  Euler  method,  but  Is 
faster  about  30  times.  The  necessary  corapatition  on 
the  time  and  space  axes  has  been  determined  for  the 
required  accuracy  computations.  Calculations  have 
been  made  by  the  novel  method  and  the  obtained 
results  haye  been  compared  with  earlier  publlsed 
measurements.  The  computed  results  have  shown  good 
agreements  with  measured  values. 

I.  INTRODUCTION 

The  arrangements  and  behaviours  of  DFDLs  have  been 
extensively  studied  since  1971.  A  typical 
arrangement  of  the  DFDL  and  several  tuning 
possibilities  are  shown  by  (31.  The  processes 
happening  in  DFDLs  may  be  described  by  coupled 
differential  equations  (rate  equations)  (1,3,6-91. 
For  the  most  part  these  equations  contain  physical 
quantities  depending  on  ’only  the  time  variable. 
Many  calculations  were  made  and  their  results  were 
compared  with  measured  values  in  last  years.  The 
experiences  show  if  the  pulse  duration  of  the 
exciting  .laser  and  DFDL  is  longer  many  times  than 
the  time  calculated  by  the  laser  length  and  the 
refractive  Index  then  computed  values  approximate 
the  values  of  measurements.  (1,2,31.  If  these 
conditions  don't  exist  the  measured  values  arc 
fully  different  from  calculated  ones.  In  this  case 
the  calculations  give  exact  values  if  the  physical 
quantities  describing  DFDL  depend  on  space  variable 
too  (9).  For  two  variables  the  running  time  Is  many 
times  longer  than  it  for  one  variable.  A  novel 
algorithm  has  been  developed  to  reduce  the  running 
time.  This  algorithm  based  on  the  Euler  method,  but 
faster  than  It  many  times. 

II.  MODEL  OF  DFDL 

Coupled  partial  differential  equations  are  shown 
below  (1,2).  These  equations  noted  down  with  the 


help  of  publlsed  equations  In  (1,3,5,8.91  describe 
the  processes  In  DFDLs. 
dNCx.O 


dL 


=  I  CO -c  -  |n  -  NCx.ol  - 

p  p  L  °  J  T 

a  ^  •  NCx,  O  •  £l*Cx,  LD  +I_Cx.oJ  ; 


CO 


^"Cx.Llt  ,  n  ctl  *Cx,  0  _  n-NCx.O 

- — -  +  -■ — ST - -  =  - - -  +  Co-  -o-  D  ■ 


dx. 


dl 


•NCx.p  -  ^Cx.O  +  J- jx+Cx,t;>  -  I^Cx.oJJ  C25 


The  meaning  of  the  symbols  are  as  follows: 

Ng  :the  density  of  dye  molesules  (2.  l-lO^m"3], 

N(x.t)  : the  density  of  molecules  in  the  S  excited 

state  lmolecules-m  ], 
i 

I  (x,t):the  density  of  the  DFDL  photon  current 

propagetlng  into  the  +x  and  -x  direction, 

respectively  ( photons •  m*V  1 ,  ’ 

I  (t)  :  the  density  of  the  pump  photon  current 
P  2-1 

( photons -m'  3  ), 

<rp  .-the  absorption  cross  section  from  S„  at  the 
pumping  wavelength  (2.4-10"*Vi, 

<?E  :the  stimulated  emission  cross  section  from 
Sl  to  Sp  sta^e  at  the  lasing  wavelength 
(1.4-10"  ml, 

<ra  :  the  excited  state  absorption  cross  section 
from  S  to  S.  at  the  lasing  wavelength 
10.7-I0"2tlm2), 

x  : the  fluorescence  lifetime  of  the  SI  state 

(4  ns ) , 

n  : the  refractive  index  of  the  dye  solution 
(1.441, 

c  : the  speed  of  light  In  vacuum, 

V  :the  visibility  of  the  ami i tude-phase 

grating  in  the  excited  volume  (11, 
f)  -.the  factor  determining  that  fraction  of  the 
spontaneous  emission  which  propagates  into 
the  angular  and  spectral  range  of  the  DFDL 
beam. 

b-a 

The  value  of  0  is  calculated  as  (1  =  - 1  where 

tt-L2-S 

L  Is  the  length  of  DFDL,  a  =  (M.-cr  )"'  Is  the 

0  P 

penetration  depth  of  the  pumping  beam  into  the  dye 
solution,  b  is  the  height  of  the  excited  volume, 
and  S  Is  the  spectral  factor  determining  that. 
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fraction  of  the  spontaneus  emission,  which  falls 
Into  the  DFDL  bandwidth  [1,3].  This  parameters 
described  the  dye  laser  what  contained  the 
Rhodamine  6G  dissolved  in  methanol  and  what  was 
excited  by  fi  laser.  The  wavelength  of  laser  was 
337.1  nm,  and  the  pulse  duration  was  3.5  ns. 

III.  LIMIT  OF  Ax  AND  At 

Calculations  have  been  made  to  determine  the 
limits  of  the  distributing  Intervals  on  both  time 
and  space  axes.  The  rate  equations  depending  only 
time  variable  have  been  used  for  determining  the 
maximum  of  time  intervals  (At),  The  energy  and  the 
duration  of  the  first  DFDL  pulse  have  been  computed 
at  the  threshold  pump  intensity  what  is  necessary 
to  come  out  the  second  pulse.  Computations  have 
been  made  at  several  At,  and  the  divergences  from 
exact  value  (where  At  -*r  0)  have  been  determined. 
The  results  calculated  with  both  explicit  and 
implicit  Euler  method  show  it  Is  pay  to  use  the 
Implicit  method,  and  If  At  i  3  ps  then  both  energy 
and  duration  of  the  output  pulse  approximate  the 
exact  value  under  VA.  For  determining  the  maximum 
of  the  space  Intervals  (Ax)  a  pulse  was  propagated 
along  the  excited  volume.  The  rate  of  output  and 
input  pulse  intensity  was  calculated  with  both 
numerical  and  analltlcal  method.  The  results 
calculated  with  numerical  .method  have  been  under  l'A 
if  Ax  *  L/550.  According  to  the  limit  of  the  time 
Intervals  it's- necessary  to  distribute  the  length 
of  laser  (L  =  5.5  mm)  into  9,  and  according  to  the 
limit  of  the  space  intervals  Into  550. 


IT  +  . . . +  i: 


,  i  =  1 ,£, .  .  ,k -m. 


The  Is  quickly  calculated  if  the  m  =  where  J 
Is  an  Integer  number. 


Fig.  Measured  and  calculated  pulse  duration  of  the 
single  pulses  from  a  Rhodamine  6G  DFDL.  The  pump 
Intensity  was  adjusted  to  the  threshold  of  the 
Second  DFDL  pulse. 

V.  RESULTS  OF  CALCULATIONS 

The  k  =  JO  and  m  =  61  has  been  chosen  for  the 
computations.  The  maesured  and  the  calculated 
values  are  shown  on  the  figure.  According  to  the 
figure  the  calculated  values  are  In  good  agreement 
with  the  measurements  ID. 


IV.  NOVEL  ALGORITHM 

Let  the  length  of  laser  is  distributed  into  k 
Intervals  and  every  intervals  are  distributed  into 
a.  The  k  Is  determined  by  limit  of  time  intervals 
and  the  nrk  by  limit  of  space  Intervals.  The 
algorithm  -has  been  written  down  after  longer 
calculations: 

T*  -  rm-I*  +  I”"  — ffD'+  — — - - t-1  . 

ri«,l  K  1-y  l  ‘V’J 

t"  =  rm-l~  +  ^  T-A.fr> -0%  -f — n-  v) . 

*1-1.1 5  hm-rc  l-w  l  tCo'.  V-1 


where  £  =  1  + 
M.  .  .  +N. 


C  cf  —  cr  }  * 
o  a  , 


+1 . 


n-  i«i.i  ”• 
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ADAPTED  VERSIONS  OF  THE  EM  ALGORITHM: FOR 
PENALIZED  LIKELIHOOD  IN  EMISSION  TOMOGRAPHY 
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Abstract.  He  present  in  this  paper  two  different 
methods  for  solving  the  penalized  likelihood 
maximization  problem  arising  in  emission  computed 
tomography  (ECT).  Both  methods  are  modifications  of 
the  Expectation  Maximization  (EM)  algorithm 
proposed  to  overcome  the  inability  of  this  algorithm  in 
its  usual  form  to  cope  with  penalization  terms  in  a  non 
expensive  way. 

I.  INTRODUCTION 

In  ECT  we  aim  to  reconstruct  a  function  that  is  the 
distribution  of  radioactivity  in  a  body  cross-section 
and  the  measurements  are  used  to  estimate  the  total 
activity  along  lines  of  known  location.  Higher  levels 
of  noise  induce  the  use  of  mathematical  models 
incorporating  the  statistical  nature  of  the  process 
instead  of  inverting  the  Radon  transform  as  in  x-ray 
computed  tomography  Cl] .  In  [21,  Shepp  and  Vardi, 
suggested  the  use  of  maximum  log-likelihoods  estimates 
derived  from  the  Poisson  nature  of  the  emission 
process,  i.e., 

D 

max  L(x)  =  [  y  ln<a.  ,x>  -  <a,  ,x>,  (1) 

x-0  l -l  *  1  1 

where  y  =  (yp  (i  =  1 . m)  are  the  photon  counts, 

a(  are  the  columns  of  A  =  (a^).  the  matrix  modelling 
emission  features,  and  x  =  (xp  (j  =  1,  ...,  n)  the 
image  vector  (emission  density)  to  be  reconstructed 

(<,>  denotes  the  standard  inner  product  and  £a  =1 ) . 

l=i 


Two  examples  are  of  special  interest,  the  penalized 
lug-likelihood  (2)  and  the  least  squares  case.  For  the 
first  we  define  the  complete  data  space  as  the  set  of 
independent  Poisson  distributed  variables  x  , 

interpreted  in  ECT  as  the  number  of  emissions  in  pixel 
J  detected  by  tube  i  (2).  So,  (3)  becomes  equivalent 
to  maximize 

n  n  y  a  x* 

qCx/x*)  =  £  £  - In  a  x  -  a  x  -  |p(x),  (4) 

j=i  i=i  <a  ,x  >  J 

a  xky 

taking  into  account  that  E(x  /Y,xk)  =  1  -  1 . 

J  <a  ,x  > 

If  t 

L(x)  =  |  £  (b  -  <ht,x>)2  =  |  xtHtHx  -  Hlb  +  (5) 

n 

we  consider  b  =  £  b  ,  b  normally  distributed 
1  j  =  i  1J  1J 

N(htjxj(  n)  and  b  =E(bjJ  /  b,xlt)=hijxjk+  i(b-<h  ,xk>) 
(see[6)).  So 

q(x/xk)  =-|  £  £  (b  -  h  X  f.  (6) 

1=1  J=1  1 

and  differentiating  for  j  =  1 . n  the  equations  are 


To  solve  (1),  Shepp  and  Vardi  proposed  to  use  the  EM 
algorithm  obtaining  very  good  results  for  earlier 
steps.  Unfortunately,  iterations  have  to  be  stopped 
before  a  deteriorating  effect  (irregular  high  amplitude 
patterns)  appears.  To  cope  with  this  inconvenient, 
quadratic  penalization  terms  have  been  suggested  (3), 
so  problem  (1)  turns  now  to  be 

max  L(x)  -  p(x),  (2) 
x=o  2 

where  p(x)  is  a  convex  quadratic  function  and  r  a 
positive  parameter.  For  the  new  problem,  the  standard 
EM  algorithm  is  no  longer  applicable  in  practice  except 
if  the  matrix  associated  with  p(x)  is  diagonal.  In  the 
following  sections  we  describe  the  EM  algorithm  for  (2) 
and  for  the  pure  quadratic  problem,  as  well  as  the  new 
alternatives  proposed  for  (2). 

II.  THE  EM  ALGORITHM 

Let  Y  be  a  random  vector  (observed  data  in  some 
experiment)  with  density  function  g(Y,x),  where  x  is 
some  vector  of  parameters  to  be  estimated.  If  g  is 
difficult  to  maximize  with  respect  to  x,  a  possible 
solution  is  to  embedd  Y  In  a  richer  sample  space  X 
where  the  optimization  problem  Is  easier  to  solve. 
Then,  the  EM  algorithm  is  defined  as.  given  x  6  £1  ..no 
parameter  space) 

xk*1  =  arg  max  q(x/xk),  for  k=0,l,2, ...  (3) 
x  e  n 

where  q(x/x  )  is  the  expectation  of  the  extended 
log-density  given  (Y,xk).  Convergence  properties  and 
more  details  for  (3)  can  be  found  in  (4)  and  (SI. 


nxjCEh?j)  =  0 
J  1=1 


(7) 


III  THE  EPM  ALGORITHM 


Let  now 


p(x)  =  |  xlSx  -  xlq, 


(8) 


where  S={s(j>  is  a  positive  semidefinite  n  x  n  matrix, 

q  an  n-vector.  If  we  apply  (3-4)  to  (2)  using  (8)  the 
system  to  be  solved  is  for  j  =  1 .  n. 

k 

x.  =  y,a, 


—  £ 
x  L- 


’ll  J 


J  1=1  <a(,x  > 


- 1  -  *(£5^  - 


(9) 


1  =  1 


Unless  off-diagonal  elements  of  S  are  zero,  (9)  is  a 
huge  system  of  nonlinear  equations.  Several 
alternatives  have  been  suggested  to  cope  with  this 
drawback  ((6)  and  (71),  but  they  are  not  convergent  for 
every  y.  Our  first  alternative  is  to  substitute  in  (3) 
il  by  a  partial  maximization  and  the  now  algorithm 
becomes  solving  (9)  for  j  e  Ji  where  Jl  is  a  subset 

k  k 

of  indices  chosen  in  such  a  way  that  j  €  Ji  *>  s  =  0 

K  J I 

for  1  *  J,  i^  is  a  control  for  the  sequence  and  the 

blocks  contain  all  the  variables  for  each  cycle.  If  S 
Is  sparse  the  subsets  J(  arc  a  few  number  (typically  q 

for  a  smoothing  matrix).  In  (8)  (Theorem  4.1)  we 
proved  that  the  general  EPM  algorithm  converges. 
Implementation  and  experiments  can  be  found  in  [7J. 
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IV  THE  EXTENDED  EM  ALGORITHM 


In  spite  of  the  advantage  of  being  convergent  for 
every  7  the  EPM  algorithm  is  quite  expensive  because  of 
the  up-dating  of  the  scalar  products  (see  (7J).  So  we 
propose  an  alternative  based  on  introducing  a  set  of 
artifical  data  as  described  next. 

S  =  H4!!  for  some  H  4  RnXn;  on  the  other  hand  if  p 
has  a  minimum  (standard  assumption),  Sx  =  q  has  a 
solution  and  q  e  R  (Hj,  i.e.,  q  =  Hd  for  some  b. 
Formally  we  can  think  that  b  is  a  normally  distributed 
random  vector  and  the  same  procedure  as  for  (S)  is 
applicable.  Applying  the  expectation,  first  with 

respect  to  y,  afterwards  with  respect  to  b,  gives 
(combining  (4)  and  (6))  = 


n  B  ya  x 

q(*A  )=  E  E  - TlnaiiVauV 

S=i  i=i  <ai,x  >  J  3  3  i 


8.  A.R.  De  Pierro,  “A  generalization  >f  the  EM 
algorithm  for  maximum  likelihood  estimates  from 
incomplete  data".  Technical  Report  MIPC  119,  U.  of 
Pennsylvania,  1987. 


i,j 


(b  -h  x  V 
<-  lj  ij  j-> 


(10) 


k+1 

Differentiating,  x^  will  be  the  unique  positive 
solution  of  (for  j  =  1 . n) 

*1  n  anyi  k  k 

n  *  -  0.  (11) 

°  2  k 

taking  into  account  that  s  =  £  h  and  q  -  <s  ,x  >  = 

«=i  ‘J  J  J 

=JihuC^,  - 

Now  variables  are  separated  and  (11)  is  a  single 
unknown  quadratic  equation  for  each  j.  Convergence  of 
the  algorithm  is  guaranteed  because  it  is  a  special 
case  of  the  EM  algorithm 

Further  work  has  to  be  done  in  order  to  test 
practical  performance  of  this  algorithm  as  well  as 
extensions  to  other  nonquadratic  penalizations. 
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Abstract.  We  shall  consider  the  numerical  analysis  of  the 
boundary  element  for  nonlinear  ellipt’C  problems  with  nonlin¬ 
ear  material  conditions.  The  convergence  of  the  Galcrkin  and 
collocation  schemes  is  proved. 

1.  INTRODUCTION' 

In  this  paper  we  study  the  possibility  to  apply  the  bound¬ 
ary  clement- methods  to  nonlinear  elliptic  boundary  value  prob¬ 
lems  with  nonlinear  differential  equation.  To  this  end  in  the 
analysis  of  the  nonlinear  boundary  clement  method  one  has 
frequently  restricted  to  the  cases  where  the  differential  equa- 
tionsrarc  linear.  The  nonlinearity  appears  only  in  the  boundary 
conditions. 

By  means  of  the  Kirchhoff  transform  we  are  able  to  lin¬ 
earize  the  differential  equation.  The  introduced  new  unknown 
function  satisfies  a  linear  differential  equation.  The  boundary 
conditions  arc,  however,  nonlinear.  This  can  be  done  when 
the  the  differential  operator  is  in  the  divergence  form  and  the 
nonlinearity  depends  only  on  the  function  itself:  not  on  its 
derivatives. 

By  the  indirect  approach  of  the  boundary  integral  cqua 
tion  methods  the  "linearized"  problem  can  be  transformed  to 
nonlinear  boundary  integral  equation  for  the  unknown  bound 
ary  distribution  which  is  to  be  solved  numerically.  We  analyse 
both -the  Galcrkin  and  collocation  methods  for  finding  an  ap 
proximate  solution.  Here  wc  present  the  convergence  results 
and  some  preliminary  error  estimates.  The  complete  analysis 
is  presented  in  the  forthcoming  paper  [4]. 

2.  The  formulation  of  the  Piiom.F.M 

We  shall  consider  a  nonlinear  boundary  value  problem 
that  is  to  be  encountered  in  a  stationary  heat  conduction  prob¬ 
lem  with  a  temperature  dependent  heat  conductivity.  The 
problem  consists  in  finding  a  potential  function  6  G  Hr,,7(ft) 
such  that 

—S7  •  (o(<J)Vp)  =  0,  in  ft 

=  onT.  (1> 

Throughout  the  paper  we  assume  that  fl  is  a  bounded  plane 
domain  with  a  regular  boundary  E.  In  other  words  the  bound¬ 
ary  r  has  a,  regular  parameter  representation  x  :  R  — *  T  with 
a  nonvanishing  Jacobian:  jf-  0.  The  symbol  —  stands  for 
the  outer  normal  derivative  as  usual. 

Before  proceeding  with  the  reformulation  of  the  problem 
we  recall  that  IIr",-r(ft),  1  <  p  <  oc,  is  the  usual  Sobolev 
space  with  usual  norm  (jUilm.j,.  Besides  these  spares  we  need 
in  the  sequel  the  Sobolev-Slobodetcku  spaces  W*  ri  T »  m»  the 
boundary.  Other  related  function  spaces  are  introduced  in  the 
order  of  occurence. 

Let  us  now  consider  the  reformulation  of  the  problem 
'I).  For  that  we  shall  make  the  following  basic  assumption: 
We  suppose  that  nio)  is  a  sufficiently  smooth  function  and 
that  there  exists  positive  constants  m  and  M  such  that  for  all 

*€R 


0  <  m  <  a($)  <  M  <  oo.  (2) 

Now  for  the  Kirchhoff  transform  defined  by  setting 

K(  O)  =  f  a(s)d$ 

Jo 

it  holds  (4j: 

Lemma  1.  Let  the  function  space  X  be  L7(ft)  or  L7( T),  re¬ 
spectively.  Then  the  Kirchhoff  transform  K  :  X  X  is 
Lipschitz-conlimiaus  and  strongly  monotone,  i.c.  for  every 
vt,v  6  X 

(K(  u)  -  A(  v),  u  -v)x  >m  []u  -  t-il2- 

Furthermore.  The  mapping  K  .  W  7(ft)  -»  H  1  5{ft)  is  bijee 
tivc. 

By  the  theory  of  monotone  opretors  we  easily  conclude 
that  the  inverse  transform  K~l  :  L2(T)  — »  L2(T)  is  also  a 
strongly  monotone  and  Lipschitz-conlinuous  mapping.  With 
the  previous  lemma  it  is  easy  to  verify  that  v  =  &{$)  satisfies 
the  following  potential  problem 

Av  =  0.  in  ft. 

tk-  (3) 

onT. 

provided  o  solves  the  problem  4X1.  The  converse  also  holds  if 
v  is  the  solution  of  our  original  problem  (1/.  This  is  to  say 
itiac  problems  (X;  and  ,3;  art  equivalent  in  the  weak  form. 

The  problem  (3;  can  be  fuimulatcd  as  a  nonlinear  bound 
aiy  integral  equation  ,3,.  Tins  can  L*  accomplished  by  intro 
•hieing  a  boundary  distribution  a  such  that 

Vf*)  =  -  “( V)  l°g  I*  -  y\ds,,x  e  ft- 

Then  by  the  trace  properties  of  the  normal  derivative  of  the 
single  layer  potential  vve  derive  the  nonlinear  boundary  integral 
equation 

-4(u)  =  ( if  -  Z>>  +  GlK'HSin)))  =  /,  (4) 

where  the  operator  D *  is  the  spatial  adjoint  of  the  double  layer 
operator  D,  which  Is  defined  by  setting 

Du(x)  ~  J  ti(  log  \x  -  y|ds,. 

and  5  denotes  the  single  layer  operator  denned  ns 

Suixi^-^J  11(1/) log fx  -  y\dsf. 

For  lilt  uiuqu<  solvability  of  the  boundary  ilitegral  equa 
Hon  '  and  of  the  boundary  value  psobldn  *  vve  make  the  fol 
lowing  assumption 

A I.  The  nonlinear  operator  G  ;  IJt  F  t  -*  Lfl  T ).  2  <  p  < 
v .  J  -  1  -  1 .  is  hounded,  continuous  and  strictly  monotone. 
In  addition  to  these  wv-  suppose  that  far  almost  nil  x  t  E 

Gt  utu? i  >  fi'njr  h.  *r  >  n.  h  e  R. 
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Then  the  boundary  integral  equation  is  uniquely  solvable. 
More  precisely  we  have  [3], [4]: 

Theorem  2.  For  every  f  6  Lq(T)  there  exists  a  unique  .,u- 
tion  u  €  75(F)  to  (4). 

3.  THE  BOUNDARY  ELEMENT  DISCRETIZATION 

As  the  approximation  schemes  we  shall  use  the  Galerkin 
and  collocaticn  methods.  For  the  approximation  we  use  the 
boundary  element  spaces  5^(0)  with  respect  to  the  partition 
0  =  {x,  =  x(T,|i  =  0,...,iV  -  1}  on  T,  where  {r,}  are  grid 
points  on  the  unit  interval  that  is  carried  to  T  by  the  param 
eter  representation.  We  assume  that  the  family  of  the  par 
titions  is  quasiuniform.  We  remind  the  reader  that  5^(0) 
corresponds  via  the  parameter  representation  the  smoothest 
1-periodic  splines  of  degree  d  on  the  unit  interval  [1],  As  a 
mesh  parameter  we  choose  h  =  i r- 

The  problem,  in  general,  is  to  find  the  coefficients  a,  t 
R,  i.ss  0, . . . ,  N  —  1  such  that  Uh  =  's  as  g°°d  ap¬ 

proximation  of  the  true  solution  as  possible.  The  functions  ip, 
forms  a  suitable  basis  of  the  spline  space.  We  shall  present  here 
the  convcrgenceanalysis  of  the  two  most  popular  methods. 

The  Galerkin  method.  As  it  is  well-known  in  the  Galerkin 
method  the  coefficients  are  fixed  by  means  of  the  orthogonality 
condition 

(Ku> OivOtHn  -  (A(u),v5)i2(D,  ip  e  5^(0)  (5) 

This  is  the  same  as  to  treat  the  family  of  the  operator  equations 

(\l  +  PkD')uh  +  PhG(K~l(S(uh)))  =  Phf,  (6) 

where  P/,  :  I2(F)  -*  Sfj(Q)  is  the  orthogonal  projection 

In  the  convergence  analysis  we  apply  the  theory  of  a- 
proper-mappings  [2].  Since  the  nonlinear  mapping  A(-)  is  an 
operator  of  Garding  type  we  have  [4]: 

Theorem  3.  The  nonlinear  operator  A(-)  :  Lq( r)  — ►  Lq(T) 
is  a-proper  with  respect  to  the  projectionally  complete  scheme 

{Pi„SdN(  F)}. 

For  the  solvability  of  the  Galerkin  equations  we  shall  need 
the  following  assumption,  which  usually  valid  in  true  applica¬ 
tions. 

A2.  G  :  LP(T)  —>  Lq( r)  is  continuously  Frechet-differentiable, 
and  that  the  Frechct  derivative  DG(u )  is  strictly  monotone 
(i.e.  positive). 

With  this  assumption  the  nonlinear  operator  has  the  fol¬ 
lowing  properties: 

Theorem  4.  The  Frechet-derivative  DA(u) :  Lq(T)  — >  i?( r) 
is  a  Fredholm  operator  with  vanishing  index.  ind(DA(u ))  -  0 
m  addition  to  this  the  derivative  is  one-to-one. 

As  a  corollary  we  conclude  [4]: 

Theorem  5.  There  exists  ho  >  0  such  that  tor  every  0  <  h  < 
ho  the  Galerkin  method  yields  a  unique  solution  to  (5)  (  or 
(6)),  and  ||u  —  u&||  — »  0  as  h  — i  0. 

Finally,  utilizing  the  Frcdholmness  of  nonlinear  operator 
A(-)  and  the  approximation  properties  of  spline  spaces  on  T 
we  are  able  to  derive  the  asymptotic  error  estimates: 

Theorem  6.  Let  uh  be  as  in  the  previous  theorem.  Then  for 
sufficiently  small  h  there  holds 

||«  -  ttfcllw.i(r)  <  cdlulUnr))^-'  ||«l|w"-*(r) 


foi  every  — l<<<0<s<d+l. 

The  collocation  method.  For  the  collocation  method  we 
define  the  collocation  points  as  follows. 

£(  =  Xj,  d  is  odd, 

“  ,  7,"  -f-  i  ,4*1  \  j  . 

x,  =  x( - - - ),  d  is  even. 

Here  the  points  t,  on  the  real  line  corresponds  the  grid  points 
of  the  partition  0  via  the  parametrization  of  T.  If  we  let  7/,  to 
denote  the  interpolation  operator,  which  interpolates  between 
the  function  values  on  the  •  'location  points  £,,  from  the  space 
of  continuous  functions  t<  .v  approriate  spline  space  S^(0), 
we  can  write  the  collocatiu..  equations  in  the  form 

IhA(uh)  =  hf.  (7) 

The  interpolation  equation  (7)  is  not  always  reasonable. 
Therefore  we  must  have  some  additional  properties  besides  the 
asssumptions  A1  and  A2.  We  require  that 

A3.  The  mapping  G  :  W»+{>P(r)  — >  W*+<,,(F)  is  bounded 
with  some  e  that  is  sufficiently  small  (  0  <  e  <  |). 

After  this  additional  property  the  collocation  equations 
(7)  make  sense.  The  more  severe  difficulty  in  the  convergence 
analysis  is  due  the  fact  that  {h,Sfj(Q)}  is  not  a  projection- 
ally  complete  scheme  in  L^r).  However,  since  the  collocation 
equations  can  be  written  as 

(; \l-hD')uh  +  IhG(ir\S(uh )))  =  hf 

we  don’t  need  the  interpolation  operator  to  be  bounded  in 
Lq(r).  This  is  due  the  fact  that  the  double  layer  and  single 
layer  operators  are  smooth  operators.  This  allows  us  to  extend 
the  proof  of  the  convergence  of  the  Galerkin  method  to  the 
collocation  method.  Thus  we  have  [4]: 

Theorem  7.  There  exists  a  mesh  parameter  ho  such  that  for 
all  0  <  h  <  h0  the  collocation  equations  admit  a  unique  solu¬ 
tion  and  ||u  —  u/,||t«(r)  —>  0  as  h  —*  0. 
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Abstract 

A  conceptual  architecture  for  modelling  abstract  physical  systems  is 
described.  The  architecture  aims  to  provide  a  system  framework, 
which  is  based  on  the  engineering  modelling  process.  This  paper 
concentrates  on  the  use  of  qualitative  causal  networks  as  a  tool  for 
predicting  and  estimating  the  physical  phenomena  acting  within  a 
physical  system.  Three  qualitative  simulation  techniques  are  assessed 
and  a  constraint-based  qualitative  simulation  approach  is  adopted. 
The  incorporation  of  this  approach  within  the  overall  system 
architecture  is  discussed. 


.1 .  Jnt.riHluCljQ.n 

1.1  Background 

Modelling  of  engineering  problems  can  be  divided  into  a  number  of 
stages;  geometric  modelling,  physical  modelling,  mathematical 
modelling,  numerical  modelling  and  graphics  modelling  C'ornetric 
modelling  involves  representing  the  geometric  features  of  real  world 
problems  and  if  possible  making  geometric  simplifications  to  reduce 
the  complexity  of  the  problem.  Physical  modelling  involves 
identifying  any  physical  phenomena  which  are  occurring  such  as  heat 
transfer,  fluid  flow  or  stress  and  if  possible,  making  certain 
assumptions  to  simplify  phenomena  complexities.  Mathematical 
modelling  requires  building  suitable  equations  to  represent  the 
problem  mathematically  and  selecting  correct  boundary  conditions 
Numerical  modelling  involves  constructing  suitable  numerical 
algorithms  and  solving  these  algorithms  computationally  Finally 
graphical  modelling  requires  the  use  graphical  techniques  to  present 
the  numerical  solution.  Many  existing  numerical  problem  solving 
environments  such  as  DEQSOL  [Umetani  et  al.  1985,  Kon'no  el  al. 
1986],  ELLPACK  [Rice  1985]  and  FIDISOL  (Schonauer  and 
S^hnepf  1987],  NEXUS  [Gafncy  et  al.  1986]  help  users  with  the 
m.t  \cmatical  and  numerical  modelling  stages  of  the  overall  modelling 
pi  ,cess.  Few  systems,  however,  have  focussed  on  the  initial 
adelling  stages,  namely,  geometric  and  physical  modelling  In 
ihese  modelling  stages,  the  user  is  generally  required  to  conceptually 
represent  a  real  world  problem,  identify  the  nature  and  relative 
importance  of  the  physical  phenomena  occurring  and  determine  any 
geometric  simplifications  or  phenomena  assumptions  which  may  be 
made  to  facilitate  efficient  numerical  analysis. 

1 .2  Modelling  of  Physical  Systems 

This  paper  aims  to  address  these  shortcomings  by  presenting  a 
conceptual  architecture  which  addresses  the  process  of  engineering 
modelling  for  the  problem  domain  described  by  partial  differential 
equations.  The  discussion  assumes  as  a  starting  point,  a  high  level, 
abstract,  three  dimensional  representation  of  a  rctil  world  problem  or 
physical  system  (referred  to  as  the  complex  model).  This 
representation  then  evolves  through  a  series  of  transition  processes, 
each  stago representing  a  simpler  model.  The  final  model  (called  the 
optimised  model)  is  suitable  for  mathematical  and  numerical  analyse 
1  he  architecture  includes  techniques  for  representing  real  wor1,1 
problems,  identifying  all  physical  phenomena  and  qualitatively 
simulating  their  behaviour.  Additionally,  the  user  may  select 
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significant  phenomena  for  further  analysis,  carry  out  reduction  of 
geometric  and  phenomena  features  to  evolve  an  optimised  geometry 
which  is  suitable  for  efficient  mathematical  and  numerical  modelling 
Although  all  modelling  stages  are  initially  discussed  in  the  paper, 
special  emphasis  is  placed  on  the  behavioural  prediction  of  the 
physical  phenomena.  In  particular,  the  integration  of  the  two 
important  artificial  intelligence  techniques  of  qualitative  reasoning  and 
causal  network  analysis  are  focused  on  to  establish  a  high  level, 
knowledge  .intensive  network  representation 

The  paper  is  divided  as  follows;  Section  2  gives  an  overview  of  the 
modelling  process.  Section  3  discusses  other,  research  which  has 
addressed  these  higher-level  stages  of  engineering  modelling.  The 
relevance  of  the  proposed  modelling  methodology  is  illustrated  and 
the  incorporation  of  certain  current  research  into  the  proposed 
architecture  is  discussed.  Section  4  deals  with  qualitative  reasoning 
as  a  key  inference  technique  and  discusses  three  principal  qualitative 
reasoning  methodologies.  Section  5  discusses  the  tundamental 
approach  taken  in  this  work,  i.c„  qualitative  causal  networks. 
Section  6  concludes  the  paper. 


2.  System  Outline 


In  this  Section  an  overview  of  the  important  stages  of  the  modelling 
process  in  the  proposed  architecture  is  presented.  Furthermore,  the 
intermediate  stages  of  the  modelling  process  are  outlined.  Having 
established  a  global  perspective  on  the  system  architecture,  system 
entities  arc  introduced  which  form  a  framework  for  the  modelling 
process. 

2, 1  System  Architecture 

Figure  i  gives  an  overview  of  the  system  architecture.  Each  stage 
depicts  an  evolution  of  the  physical  problem,  beginning  with  tht 
complex  model  at  the  highest  level  of  abstraction  and  culminating  in 
an  optimised  model  which  corresponds  the  lowest  representation 
level  before  mathematical  modelling.  Transition  processes  determine 
each  evolution. 

(i)  Stage  1:  3-D  Representation 

The  complex  model  is  created  by  the  user  and  is  a  representation  of  a 
real  world  problem  or  physical  system  as  shown  in  Figure  2.  The 
complex  model  consists  of  a  number  of  components.  Each 
component  is  represented  as  an  object  with  initial  attributes  of 
geometry,  function,  location  and  material.  At  this  stage  the  user  is 
requested  to  specify  any  known  phenomena  features  for  each 
component,  in  the  example  illustrated  in  Figure  2,  the  user  may  be 
asked  it  an  electric  current,  voltage  difference  or  electric  field  are 
present. 

i :n  Transition  A:  Cause-Effect  Inference 

A  shallow  rule  based  inference  mechanism  is  used  to  exhaustively 
predict  all  possible  phenomena  in  the  system  based  on  the  high-Ievti 
knowledge  available  from  the  3-D  representation. 
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(ivl  Transition  B:  Constraint-based  Qualitative  Reasoning 
Qualitative  reasoning  and  causal  networks  are  used  to  derive  a 
behavioural  description.  Any  simplifications  such  as  geometric 
idealisations  are  carried  out  to  derive  a  simplified  primary  model  for 
each  phenomenon,  these  simplifications  are  known  as  primary 
simplifications.  Each  phenomena  is  then  estimated  using  constraint- 
based  qualitative  reasoning  to  give  a  behavioural  description.  This 
description  can  then  be  assessed  by  the  user  to  estimate  the 
importance  of  each  phenomenon.  This  approach  is  discussed  in  detail 
in  Section  4. 

(v)  Stage  3:  Quantified  Phenomena 

At  this  stage  there  is  a  stable  description  of  the  behaviour  of  all 
components  of  the  simplified  complex  model. 

(vi)  Transition  C:  Phenomena  Reduction 

Shallow  rule-based  inference  mechanisms  are  used  in  this  transition 
to  examine  the  values  of  key  parameters  for  each  phenomena 
throughout  the  system.  Using  knowledge  bases,  the  relative 
importance  of  each  phenomenon  can  be  assessed,  e.g.,  stress  levels 
in  electronic  components  and  the  user  may  make  an  informed 
selection  of  phenomena  to  include  in  subsequent  analysis. 

(vii)  Stage  4:  Reduced  Phenomena 

Stage  4  consists  of  a  number  of  reduced  phenomena  for  further 
analysis  and  optimisation. 

(viii)  Transition  D-  Phenomenon  and  Control  Volume  Reduction 
Depending  on  the  phenomena  selected  by  the  user  for  analyses,  an 
optimised  model  is  derived.  Optimisation  may  consist  of  further 
geometric  simplifications,  selection  of  a  subsection  of  the  model 
based  on  symmetry  or  selection  of  a  reduced  analysis  volume. 

fix')  Stage  5:  Optimised  Model 

This  final  stage  is  a  model  of  the  primary  model  optimised  for 
subsequent  analysis.  It  reflects  a  trade-off  between  simplicity  and 
accuracy  in  analysis.  For  example,  if  the  optimised  model  was  to  be 
used  for  numerical  simulation,  an  important  concern  would  be  the 
scope  of  the  analysis  volume.  If  a  large  analysis  volume  is  assumed, 
then  the  complexity  of  calculations  is  increased,  whereas  if  the 
analysis  volume  is  limited,  important  detail  may  be  lost. 

2.2  Introducing  System  Entities 


Figure  1  Overview  of  proposed  modelling  architectuic 


fiil)  Stage  2-  Predicted  Phenomena 

At  this  stage,  all  known  phenomena. have  been  predicted  b>  the 
system  However,  it  may  not  be  realistic  to  analyse  all  phenomena, 
therefore  by  quantifying  each  phenomenon,  certain  phenomena  may 
be  found  to  be  insignificant  and  therefore  removed  from  further 
consideration. 


2 


3 


Figure  2  Physical  System  or  Real  World  Ptobk  in 


The  physical  system  is  comprised  of  a  number  of  components.  Each 
component  has  a  functional  perspective  and  a  geometric  perspective. 
The  functional  perspective  determines  what  use  the  component  has. 
For  example,  a  metallic  pipe  may  be  viewed  as  a  flow  channel  for  a 
fluid,  an  electrical  conductor  or  a  bearing  for  a  rod  that  can  rotate 
inside  it.  The  geometric  perspective  defines  the  shape  and  dimensions 
of  a  component.  Initially  a  three  dimensional  shape  may  be  selected 
by  the  user  from  a  limited  library  of  shapes  and  instantiated  with  the 
appropriate  dimensions  e.g.  a  BLOCK  of  length  A,  width  B  and 
depth  C.  The  geometric  perspective  evolves  from  the  complex  model 
through  the  primary  simplification  to  the  optimised  model. 

Each  component  has  a  behaviour.  The  behaviour  of  that  component 
is  essentially  the  physical  phenomena  occurring  in  that  component 
and  is  context  dependent.  The  context  of  a  component  determines  the 
component's  behaviour  and  it  is  determined  by  the  component’s 
geometric  perspective,  functional  perspective  and  boundary  links  as 
well  as  its  current  local  behaviour. 

Boundary  links  are  the  medium  through  which  effects  are  propagated 
between  two  connected  components.  A  valid  boundary  exists 
between  any  two  physically  connected  components  and  also  between 
a  component  and  the  outside  world,  where  they  arc  directly  in 
contact.  A  boundary  link  is  an  abstract  entity  which  models  the 
transfer  of  effects  of  physical  phenomena  between  neighbouring 
components.  Transfer  parameters  are  defined  for  effects  of  physical 
phenomena,  e.g.,  for  heat  transfer  define  ‘Heat  Flux’  or  for  a  stress 
field  define  ‘Force’.  This  abstraction  enforces  the  localised  context 
for  each  component.  For  a  component  producing  a  heat  field,  it  need 
only  output  a  ‘Heat  Efflux’  parameter  value  to  its  boundaries.  It  is  up 
to  each  boundary  to  present  this  effect  to  the  context  of  the 
neighbouring  component  in  a  suitable  form.  Thus  the  context  of  a 
iie.ghbour  will  incorporate  Heal  Flux  which  will  be  presented  as  a 
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‘Heat  Influx-’  parameter  with  a  set  value.  From  the  receiving 
components  perspective,  the  origin  of- the  heat  is  immaterial  as  are  the 
destinations  for  subsequcnt-side-effects.  A  boundary  link  will  be 
represented  as  an  object  with  initial  attributes  of  shape  and 
participating  components. 


3.  Related  Work 

While  there  has  been  considerable  investigation  of  different  types  of 
abstract  models  for  physical  systems,  the  problem  of  modelling 
physical  phenomena  in  such  systems  has  received  little  attention. 
However,  work  has  beendone  which  is  related  to  parts  of  the 
proposed  modelling  process. 

Several  artificial  intelligence  researchers  have  investigated  the  use  of 
qualitative  reasoning  to  predict  the  behaviour  of  physical  systems. 
Section  4  explores  the  contribution  of  this  work  in  greater  detail.  The 
proposed  system  is  a  modelling  process  directed  to  modelling 
physical  phenomena  whereas  the  applications  of  existing  qualitative 
reasoning  systems  have  focussed  on  predicting  device  behaviour, 
e.g., -[Forbus  et  al  ‘87], 

Geometric  idealisation  plays  an  important  role  in  engineering 
modelling.  [Bachman  et  al  ‘88J,  [Bachmann  88]  and  [Collar  '90] 
have  done  considerable  work  in  the  field  of  geometric  modelling  but 
the  starting  point  for  then  idealization  process  is  a  lower  level,  fully 
specified  physical  model.  In  contrast,  the:proposed  system  begins 
with  a  high-level,  incomplete,  abstract  specification  (i.e.  the  complex 
model)  where  the  behaviour  of  the  system  is  not  yet  determined. 
Nonetheless,  the  geometric  idealization  techniques  proposed  in  their 
research  is  valid  in  the  lower  levels  of  the  proposed  architecture 
specifically  at  phenomena  and  analysis  volume  reduction  stages. 

Context  dependent  behaviours  [Nayak  et  al  ‘90]  represent  a 
conceptually  appealing  method  for  organising  multiple  models  of 
primitive  components.  Unfortunately,  like  component  based  and 
process  based  qualitative  reasoning  systems,  this  ontology  is  geared 
towards  prediction  of  device  behaviour  and  has  limited  application  in 
modelling  physical  phenomena. 

[Geisey  ‘90]  describes  a  program  for  automated  physical  modelling. 
He  proposes  a  quantitative  modelling  approach  whereby  the 
behaviour  of  the  system  (a  mechanical  device;  is  derived  using 
numerical  simulation.  Again,  the  application  for  this  work  is  in  the 
area  of  kinematic  analysis  rather  than  physical  phenomena. 
Furthermore,  the  use  of  quantitative  techniques  requues  a  more 
complete  model  specification  than  is  provided  for  at  the  user  interface 
of  the  proposed  system. 


4.  Qualitative  Reasoning 


Most  of  today’s  expert  systems  have  invariably  modelled  their 
domain  with  a  “black  box"  approach,  i.e.,  compiling  rules  from 
observable  inputs  and  outputs,  with  no  consideration  for  underlying 
physical  mechanisms.  A  commonly  recognised  failing  of  such 
“shallow  models"  is  that  they  arc  highly  domain  specific  IKuipers 
‘86].  The  black  box  approach  to  knowledge  representation  is  a 
shallow  way  of  contriving  summary  rules  to  suit  the  needs  of  the 
application  which  must  use  them. 

Qualitative  reasoning  provides  for  ‘deeper"  knowledge  which  models 
the  underlying  systems  of  the  black  box  and  allows  the  derivation  of 
the  high  level  rules  of  input-output  by  applying  an  input  to  the  model 
and  allowing  simulation  to  predict  the  output.  In  contrast  to  shallower 
conventional  heuristic  models,  a  qualitative  reasoning  system  will 
embed  its  knowledge  in  real  physical  mechanisms  rather  than  in  n  les 
of  th  mb  based  on  intuition  and  experience. 

In  this  section  three  approaches  to  qualitative  reasoning  are 
discussed.  In  particular  abstract  qualit  live  reasoning  systems  are 
defined  and  how  principal  compon.nts  are  instantiated  within 
component  based,  process  based  and  constraint  based  systems 
respectively.  Furthermore,  the  relevance  of  these  mcthodulogie .  m 


the  context  of  the  proposed  architecture  is  discussed  (Figure  1 
Transition  B). 


4. 1  Components  of  a  qualitative-reasoning  system. 

A  qualitative  reasoning  method  begins  with  a  model  of  the  domain, 
called  a  structural  description,  in  which  precise  numerical  values  and 
precise  functional  relationships  are  absent.  All  parameters  can  take  on 
one  of  a  finite  set  of  non-numeric  values  which  generally  delimit 
regions  of  qualitatively  distinct-behaviour  (e.g.,  fluid  flow  rate  could 
be  expressed  as  being  laminar,  between  laminar  and  turbulent, 
turbulent).  An  ordered  set  of  such  qualitative  values  is  called  a 
quantity  space.  The  minimal  quantity  space  has  the  values  (  ,  0,  +j 
which  only  supports  a  system  to  reason  about  signs. 

The  influence  of  one  parameter  on  another  is  expressed  by  qualitat'n  t 
constraint  equations.  The  qualitative  state  of  the  system  is  an 
assignment  of  a  qualitative  value  and  Incremental  Qualitative  value  or 
IQ  value  [i.e.,  direction  of  change  which  may  be  specified  as 
decreasing,  steady,  or  increasing;  to  each  parameter  together  with  the 
time-point  or  interval  at,  or  over,  which  this  value  applies  and  the 
direction  in  which  the  parameter  value  is  changing  (if  at  all).  Time  is 
represented  as  an  ordered  sequence  of  time-points  generated 
dynamically  whenever  something  interesting  happens  to  a  parameter 
Transition  rules  govern  any  changes  in  parameter  value. 

Some  systems  based  on  qualitative  reasoning  use  simulation  as  their 
inference  procedure,  while  others  use  envisionment  Simulation 
begins  with  an  initial  state  description  and  propagates  values 
forward,  exploring  all  legal  possibilities,  until  no  more  transition 
rules  apply.  Envisionment  generates  all  legal  qualitative  states  and 
then-all  possible  transitions  between  these  states  Both  approaches 
result  in  a  graph  of  possible  states  with  arcs  signifying  permissible 
transitions  between  states.  A  qualitative  behavioural  description  is 
then  any  path  through  such  a  graph. 

So  any  qualitative  reasoning  system  can  be  characterised  by  its 
structural  description,  quantity  space,  notion  of  qualitative  state 
representation  of  time,  transition  rules,  behavioural  description  and 
inference  procedure.  The  major  difference  between  the  various 
approaches  to  qualitative  reasoning  concerns  the  precise  statement  of 
the  constraint  laws  and  how  they  are  derived  from  the  physical 
structure  [de  Kleer  and  Brown  *83]  A  central  organising  principle 
for  de  Kleer  and  Brown  [de  Kleer  and  Brown  ‘84]  is  the  notion  of 
component,  for  Forbus  the  notion  of  process  [Forbu-  ‘84]  and  for 
Kuipers  the  notion  of  constraint  [Kuipers  ‘86].  The  preceding  views 
of  parameters,  constraints,  qualitative  state  and  representation  of  time 
are  essentially  shared  among  the  qualitative  physics  of  component 
based,  process  based  and  constraint  based  systems. 

4.2  Envisioning 

De  Kleer  and  Brown  take  the  view  that  a  device  consists  of 
physically  distinct  parts  connected  together.  The  goal  is  to  draw 
inferences  about  the  behaviour  of  the  composite  device  solely  from 
laws  governing  the  behaviours  of  parts.  Their  central  modelling 
primitive  is  the  qualitative  differential  equation,  called  a  confluence, 
which  acts  as  a  constraint  on  the  variables  and  derivatives  associated 
with  components.  For  example,  consider  the  qualitative  behaviour  of 
a  pressure  regulator  (Figure  3)  expressed  by  dP+dA-dQ-0,  where  P 
is  the  pressure  across  the  valve,  Q  is  the  flow  through  the  valve  and 
A  is  the  area  available  for  flow.  dP,  dQ  and  dA  represent  the  changes 
in  P,  Q  and  A  respectively.  The  confluence  represents  multiple 
competing  influences,  the  change  in  area  positively  influence'  flow 
rate  and  negatively  influences  pressure  The  change  in  pressure 
positively  influences  flow  rate,  etc.  A  confluence  is  generally  valid 
for  a  certain  operating  range  of  some  component  In  this  example 
very  different  behaviours  occur  when  the  valve  is  fully  open  or  fully 
closed. 

4.3  Dualiiai  e  Process  Theory 

F  orbus  describes  a  physical  situation  in  terms  of  the  interaction  of 
competing  processes  IForbus  84].  T  lie  central  idea  is  that  all 
changes  in  physical  systems  are  caused  directly  sir  indirectly  by 
pro  .esses.  Processes  can  become  active  sir  inactive  as  parameter 
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De  Kleer  and  Brown’s  component  based  reasoning  system 
determines  a  composite  device  behaviour  from  its  component 
structure.  Domains  consist  of  specific  components  which  have  their 
structural  description  mapped  out  explicitly  in  the  form  of 
confluences  (qualitative  differential  equations).  The  focus  for 
behaviour  prediction  rests  on  the  behaviour  of  the  device  itself  rather 
than  on  underlying  internal  effects. 


Figured  Pressure  Valve  Example 


values  change  by  the  acnon  of  other  processes.  The  rules  governing  a 
process  indicate: 

1.  Under  what  conditions  a  process  holds,  e.g.,  the  temperature  of 

the  source  must  exceed  the  temperature  of  the  destination  for  heat 
flow  to  occur. 

2.  The  relations  it  imposes  among  parameters. 

3.  The  influences  it  imposes  on  the  parameters  (e.g.,  the  amount  of 
heat  at  the  source  is  negatively  influenced  by  the  flow  rate  of  heat 
leaving  it). 

The  physical  situation  presented  in  Figure  4  can  be  described  by  the 
heat-flow  process.  The  quantity  condition  for  the  heat-flow  process 
is  that  the  temperature  of  the  source  is  grcater.than  the  temperature  of 
the  destination  of  the  heat  The  heat-flow  ratc  ncgatively  influences 
the  heat  of  the  source  and  positively  influences  the  heat  of  the 
destination.  The  complete-constraint  on  the  amount  of  heat  in  the 
source  is  determined  by  the  sum  of  all  'he  influences  which  reference 
it. 

4,4  Qualitative  Simulation 

In  Kuiper's  constraint  based  approach,  the  constraints  on  how 
parameters  are  related  to  each  other  are  two-  or  three-place  relations 
on  physical  parameters  Some  specify  familiar  mathematical 
relationships:  DERIV  (velocity,  acceleration),  MULT  (mass, 
acceleration,  force),  MINUS  (forward,  reverse).  Others  assert 
qualitatively  that  there  is  a  functional  relationship  between  two 
physical  parameters,  but  only  specify  that  the  relationship  is 
monotomically  increasing  or  decreasing.  M+(age, experience),  M- 
(mpg.mph).  Inequality.and  conditional  constraints  specify  conditions 
under  which  some  constraint  holds. 

The  “causal  structure  description”  indicates  each  of  the  constraints 
and  parameters  of  the  model.  Consider  the  simple  physical  system  in 
Figure  4  consisting  of  a  closed  container  of  gas  (at  temperature  T) 
that  receives  heat  from  a  source  (Ts)  and  radiates  heatinto  the  air 
(Ta).  The  rate  of  flow  of  heat  into  the  gas  is  a  strictly  increasing 
function  of  the  temperature  difference  between  the  gas  and  the 
source.  dT  =  0  corresponds  to  no  heat  flow-  into  the  gas.  To  solve 
this  model,  a  qualitative  simulation  is  carried  out  by  propagatmg 
+,0,-  values  (using  Figure  5)  and  inequalities  (using  constraint 
propagation)  in  order  to  obtain  values  for  all  the  variables. 


A  similar  observation  applies  to  Forbus’  qualitative. process  theory. 
The  central  idea  of  a  process  as  the  essential  agent  for  change  in  a 
physical  system-fits  well  with  the  notion  of  physical  phenomena 
introducing  side-effects  in  other  components.  However,  this 
approach  is  also  applied  to  predicting  device  behaviour  [Forbus  ct  al 
‘87]. 

4.6  Proposed  Modelling  Approach 

The  modelling  approach  proposed  in  this  work  deals  with  behaviour 
at  a  lower  level  than  component  and  process  based  systems.  Instead 
of  predicting  a  composite  device  behaviour,  this  work  is  more 
concerned  with  the  behaviour  within  a  component,  i.c.,  physical 
phenomena.  Rather  than  a  component  having  a  behaviour  itself,  in 
the  approach  taken  here,  it  serves  more  as  a  site  for  behaviours  to 
occur.  The  composite  behaviour  in  the  modelling  approach  of  the 
proposed  system  looks  at  how  physical  phenomena,  local  to  one  site 
(component)  initially,  might  propagate  to  other  sites  (components)  in 
the  system. 

Kuipers’  constraint  based  approach  conforms  most  readily  to  the 
requirements  of  this  work.  Constraint  equations  can  be  adapted  to 
qualitatively  reflect  fundamental  laws  of  physics,  e.g.,  power 
dissipation  =  M+( voltage).  The  calculus  of  qualitative  simulation  will 
allow  side-effects  of  physical  phenomena  to  be  derived.  Parameters 
provide  an  ideal  method  for  propagating  effects  by  parameter  sharing 
between  neighbouring  components. 

In  contrast  to  all.three  qualitative  reasoning  systems  outlined  in  this 
section,  it's  not  of  interest  to  predict  system  behaviour  over  time. 
Instead,  the  proposed  system  incorporates  the  qualitative  calculus  and 
constraint  conventions  of  Kuipers’  simulation-system  to  perform 
dynamic  simulation  but  present  the  resulting  behavioural  description 
as  a  static  view  of  the  final  time-point  parameter  values.  The  graph  of 
transitions  may  be  used  as  a  historical  account  of  the  simulation  to 
justify  results- to  the  user. 

5.  Qualitative  Causal  Networks 

Reason  locally  and  propagate  globally:  this  is  the  basic  principle  from 
which  thequalitative  causal  network  structiirc  is  derived  as  a  tool  for 
modelling  physical  systems.  In  this  section  the  use  of  qualitative 
simulation  is  explained  to  determine  local  behaviour  at  each 
component  (site)  in  the  network  and  how  a  causal  network, 
implemented  through  boundary  links  between  neighbouring 
components,  is  used  to  propagate  side-effects  to  ‘connected’ 
components. 

The  simulation  process  described  in  Section  5.1  corresponds  to  A 
and  B  of  Figure  6  which  outlines  the  algorithm  used  in  the  proposed 
system  to  generate  a  behavioural  description  of  the  physical  system 
(Figure  1,  Stage  3).  Section  5.2  examines  how  causal  networks  arc 
used  to  propagate  side-effect  phenomena  to  the  contexts  of 
ncii'hbouring  components  (Figure  6,  Pan  C). 
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Figure  4  Heat  Transfer  Example 


Figure  5  Constraint  Propogation  Table 
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PRIMARY  SIMPLIFICATION 


Initialised  domain  equation; 


Figure  6  Generating  a  Behavioural  Description 


2J-Localised  qualitative  simulation 

The  strategy  used  in  this  work  is  to  represent  essential  equations  of 
physics  qualitatively  through  constraint  equations  in  the  format 
proposed  in  Kuipers’  qualitative  simulation  methodology  [Kuipers 
‘86J, .e.g.,  Bemouilli’s  equation,  universal  gas  equation  etc  The 
knowledge  base  for  the  proposed  system  is  divided  into  a  number  of 
domains.  Each  domain  corresponds  to  a  physical  phenomenon  and 
the  knowledge  tor  that  domain  will  consist  of  constraint  equations 
derived  from  the  appropriate  laws  of  physics,  e.g..  Ohm’s  law  could 
be  represented  as.  Voltage  MULT(current,  resistance)  =  0 
Qualitative  calculus  [Kuipers  '86J  is  used  to  solve  these  equations 

Simulation  at  a  local  site  begins  with  an  initial  state  or  structural 
description  (Figure  1:  Stage  2).  In  the  first  iteration,  high-level 
phenomena  prediction  establishes  the  domain  equations  to  be 
included  for  each  component  and  initialises  certain  system  parameters 
based  on  user  inpuf(Figure  1.  Transition  A).  Subsequent  iterations 
derive  their  structural  descriptions  from  their  context. 

All  active  parameters  (i.e.  those  parameters  with  IQ  value  o  steady) 
are  placed  on  an  active  list.  Prediction  rules  are  applied  to  each 
parameter  on  the  active  list  to  predict  all  possible  transitions  with  no 
regard  at  this  stage  for  the  validity  of  the  new  value.  Transitions  are 
subsequently  filtered  by  applying  constraint  equations  which  filter 
out  inconsistent  transitions,  e.g.,  if  acceleration  is  constant  then, 
because  acceleration  and  velocity  are  related  by  the  derivative 
DERIV(vcIocity,  acceleration),  a  velocity  IQ  value  of  ‘steady’  would 
be  inconsistent  and  hence  filtered  out.  Other  parameters  that  had  been 
steady  may  be  perturbed  by  this  process,  i;e.,  a  side-effect.  When  all 
transitions  have  been  verified  or  removed,  the  next  state  is 
determined  for  the  behaviour  of  that  component.  Side-effects  are 
incorporated  into  the  components  boundary  link  parameters  and 
propagated  by  the  causal  network. 

5.2  Context  building  with  causal  networks 

The  structural  description  for  qualitative  simulation  at  each  node  is 
derived  for  each  component  solely  from  its  context.  The  role  of  the 
causal  network  is  to  ensure  that  any  side-cffcu  phenomena  due  to 
other  component  behaviours  are  included  in  this  context. 


The  basis  of  the  network  structure  is  the  boundary  links  between 
neighbouring  physically  connected  components.  The  boundary  is 
characterised  by  its  participant  components,  its  geometry  (which  may 
determine  the  type  of  distribution  for  a  phenomenon),  and  two  lists 
of  transfer  parameters,  (i.e.,  source  A  <->  destination  B  and  source 
B  <->  destination  A). 

After  a  local  simulation  has  been  completed,  the  boundary  link’s 
outgoing  transfer  parameters  are  updated  either  by  appending  a  new 
parameter  or  by  changing  a  current  transfer  parameter’s  value  and/or 
IQ  value.  Thc  next  component  incorporates  all  incoming  transfer 
parameter  lists  into  its  context.  Simulation  then  proceeds  with  the 
context  as  an  initial  state. 


5:3  Stooping  Criteria 

From  Figure  6  it  is  clear  that  the  simulation  process  is  an  iterative 
one.  One  complete  iteration  corresponds  to  a  local  simulation/global 
propagation  cycle.  The  behavioural  description  is  considered  to  be 
complete  when  the  system  reaches  an  equilibrium.  In  practice,  a 
physical  equilibrium  will  be  represented  by  a  complete  iteration 
which  produces  no  new  states  of  parameters.  Each  component’s 
active  parameter  list  should  be  empty  at  the  start  of  such  an  iteration. 

The  final  behavioural  description  (Figure  1:  Stage  3)  will  be 
determined  by  the  values  of  key  parameters  in  each  component  and  in 
each  boundary’s  transfer  lists. 


fu  Conclusions 


In  this  paper  a  conceptual  architecture  for  modelling  abstract-physical 
systems  has  been  outlined.  In  particular  qualitative  causal  networks 
have  been  introduced  as  a  tool  for  modelling  physical  phenomena. 

It  has  been  demonstrated  how  this  network  structure  facilitates  the 
presentation  of  a  localised  perspective  of  thc  whole  system  to  each 
component.  Boundary  links  are  used  to  present  summary  effects  to  a 
component  allowing  qualitative  simulation  to  be  done  without 
reference  to  the  source  or  destination  of  side-effects.  This  is  an 
important  division  of  work  from  the  design  point  of  view  Causal 
network  management  and  qualitative  simulation  can  be  developed  as 
self-contained,  independent  modules. 

A  role  for  qualitative  simulation  in  modelling  physical  phenomena 
has  been  established.  The  importance  of  deep  knowledge  for 
‘intelligent  reasoning  systems  has  been  emphasised  in  this 
architecture.  The  need  for  shallow  rule-based  inference  systems  is 
also  recognised  and  incorporated  into  the  proposed  system  to 
initialise  the  domains  for  qualitative  simulation  and  finally  in  model 
optimisation 

Having  outlined  thc  overall  modelling  process,  the  prototype 
implementation  will  begin  with  the  primary  simplification  and 
concentrate  on  the  derivation  of  a  behavioural  description  in  the 
manner  outlined  in  Section  5. 


Acknowledgements 

This  work  is  sponsored  by  the  Hitachi  Dublin  Laboratory  .We  would 
like  to  thank  Nobotushi  Sagawa  and  Neil  Hurley  for  various 
discussions  on  the  subject  and  comments  on  earlier  drafts  of  this 
paper. 


References 

[Bachman  ct-  al  88J  P.  L.  Baehmann,  M.  S.  Shephard,  R.  A. 
Ashley  and  A.  Jay.  1988.  "Automated  metal  forming  modelling 
utilizing  adaptive  rc-mcshing  geometry".  SCOREC  Report  #7  - 
1988,  Scientific  Computation  Research  Centre,  Renssclcar 
Polytechnic  Institute. 

[Bachman  88J  P.  L.  Baehmann.  1988.  "Automated  metal  form  -g 
modelling  utilizing  adaptive  re  mcsiung  geometry"  SCORI"*"  Report 


933 


#9  -  1988,  Scientific  Computation  Research  Centre,  Rensselear 
Polytechnic  Institute. 

[Bobrow  ‘84]  D.  G.Bobrow.  1984.  Qualitative  reasoning  about 
physical  systems:  An  introduction.  In  Artificial  Intelligence,  24 
(1984)  1-5. 

[Collar  ‘90]  R.  R.  Collar.  1990.  "Automatic  idealization  control  for 
geometric  simplifications  in  two-dimensional  stress  analysis". 
SCOREC  Report  #13  -  1990,  Scientific  Computation  Research 
Center,  Rensselear  Polytechnic  Institute. 

[de  Kleer  and  Brown  ‘83]  J:  de  Kleer  and  J.  S.  Brown.  1983.  "The 
origin,  form  and  logic  of  qualitative  physical  laws".  In  Proceedings 
of  the  Eighth  International  Joint  Conference  on  Artificial  Intelligence, 
li58  -  1169. 

[de  Kleer  and  Brown  ‘84]  J.  de  Kleer  and  J.  S.  Brown.  1984.  "A 
qualitative  physics  based  on  confluences".  In  Artificial  Intelligence, 
24,  1984,  7-83. 

[Forbus  ‘84]  K.D.  Forbus.  1984.  "Qualitative  Process  Theory".  In 
Artificial  Intelligence,  24,1984, 85-168. 

[Forbus  et  al  ‘87]  K.D.  Forbus,  Paul  Nielsen,  and  Boi  Fallings. 
"Qualitative  Kinematics:  a  framework".  In  Proceedings  of  1987 
International  Joint  Conference  on  Artificial  Intelligence,  430-435. 

[Gaffney  et  al  ‘83]  P.W.  Gaffney,  J.  W.  Wooten,  K.  A.  KesseJ,  and 
W.  R.  McKinney.  1983.  "NITPACK:  An  interactive  tree  package". 
ACM  Trans,  on  Mathematical  Software,  Vol.  9,  No.  4,  December 
1983,  Pages  395-417 

[Gaffney  ‘86]  P.  W.  Gaffeny  et  al.  NEXUS:  "Towards  a  problem 
solving  environment  (PSE)  for  scientific  computing",  ACM ■ 
SIGNUM  Newsletter,  2 1 :3,  July  1986,  1 3-2. 

[Gelsey  ‘90]  A.  Gelsey.  1990.  "Automated  physical  modelling".  In 
Proceedings  of  1989  International  Joint  Conference  on  Artificial 
Intelligence,  1225-1230. 

[Kuipers  ‘82]  B.  Kuipers.  1982.  "Getting  the  envisionment  right". 
In  Proceedings  of  the  American  Association  of  Artificial  Intelligence, 
209-210. 

[Kuipers  ‘84]  B.  Kuipers.  1984.  "Commonscnse  reasoning  about 
causality:  Deriving  behaviour  from  structure".  In  Artificial 
Intelligence,  24  (1984)  169-203. 

[Kuipers  ‘85]  B.  Kuipers.  1985.  "The  limits  of  qualitative 
simulation".  In  Proceedings  of  the  International  Joint  Conference  on 
Artificial  Intelligence,  128-136. 

[Kuipers  ‘86]  B.  Kuipers.  1986.  "Qualitative  Simulation".  In 
Artificial  Intelligence,  29  (1986).  289-338. 

[Nayak  et  al  ‘90]  P.  P.  Nayak,  S  Addanki,  and  Leo  Joskowicz. 
1990.  "Modelling  with  context  dependent  behaviours".  To  be 
published  1991. 

[Shephard  ‘88]  M.  S.  Shephard.  1988.  "The  specification  of 
physical  attribute  information  for  engineering  analysis".  In 
Engineering  with  Computers,  4, 145-155  (1988). 


934 


SOLIDIFICATION  OF  VARIABLE  PROPERTY  MELTS  IN  CLOSED 
CONTAINERS:  MAGNETIC  FIELD  EFFECTS 


George  S.  Dulikravich 
Associate  Professor 
Aerospace  Eng.  Dep. 
Penn  State  University 
University  Park,  PA 


Branko  Kosovic 
Graduate  Student 
Aerospace  Eng.  Dep. 
Penn  State  University 
University  Park,  PA 


SeungsooLee 
Research  Scientist 
Aerodynamics  Department 
Agency  for  Defense  Development 
Daejon,  South  Korea 


Abstract:  A  computer  code  has  been  developed  for  the  numerical 
prediction  of  steady,  laminar,  incompressible  flows  with  strong  heat 
conduction,  magnetic  field  effects  (Lorentz  forces  and  Joule  heating), 
latent  heat  of  phase  change,  and  thermal  buoyancy  using  extended 
Bousstnesq  approximation.  The  same  code  predicts  the  fluid  flow 
field  and  the  solid  layer  resulting  from  strong  wall  cooling. 
Numerical  results  for  solidification  inside  a  closed  container 
demonstrate  the  influence  of  strong  magnetic  fields  oh  the  melt  flow 
field  and  the  solid/liquid  interface  geometry. 

I.  INTRODUCTION 

Based  on  our  earlier  works  [1-3]  in  computational 
maghetohydrodynamics  t,MHD)  for  steady,  laminar,  incompressible 
flows  in  two  and  three  dimensions,  we  have  recently  developed  a 
computer  code  that  is  capable  of  simultaneously  predicting  details  of 
the  melt  flow  field  and  the  formation  of  the  solidified  region  [4]. 

Boussmesq  approximation  was  used  to  account  for  the 
thermal  buoyancy  force,  while  allowing  the  coeficients  of  viscosity, 
heat  conduction,  and  specific  heat  to  depend  on  temperature 
arbitrarily  [5].  Nevertheless,  in  the  present  work,  values  of  these 
coefficients  were  kept  constant  within  the  liquid,  allowed  to  vary 
linearly  between  liquidus  and  solidus  temperatures,  and  then  again 
keptconstant  within  the  solid.  A  special  test  run  (b)  was  performed 
where  the  coefficient  of  viscosity  was  varied  according  to  the 
arctangent  law  over  the  entire  range  of  temperatures.  This  computing 
logic  enables  us  to  use  a  single  flow  field  analysis  code  in  order  to 
simultaneously  predict  both  the  fluid  flow  field  and  the  temperature 
field  inside  the  accruing  solid,  thus  "capturing"  the  solid/liquid 
interface  shape  without  any  special  front  tracking  algorithm. 


n.  ANALYTICAL  MODEL 

Navier-Stokes  equations  for  incompressible  electrically 
conducting  homo-compositional  fluid  flow  are  given  by 

VM=0  (1) 

VG  +  (vivi  *  SHiHi)j  =  '  P.i  +  k  S  ei9  (2) 


Ill.  RESULTS 

In  a  conventional  case  of  a  thermal  buoyancy  induced  flow 
inside  a  closed  rectangular  container,  the  bottom  wall  is  uniformly 
hot  and  the  top  wall  is  uniformly  cold,  while  the  vertical  walls  were 
thermally  insulated.  The  computed  velocity  vector  field  [2]  for  such  a 
test  case  is  depicted  in  Figure  la.  If  a  uniform  vertical  downward 
pointing  magnetic  field  is  added  (but  without  allowing  for 
solidification),  the  number  of  recirculating  flow  regions  will  change 
(Fig.  lb)  indicating  strong  influence  of  the  magnetic  Field  on  the 
flow  pattern,  that  is,  the  reduction  of  vorticity. 

To  demonstrate  the  capability  of  the  code  to  predict  the 
formation  of  the  solid  region,  the  top  of  the  container  was  uniformly 
undercooled.  The  solid  phase  was  predicted  to  grow  from  the  top 
wall  (Fig.2).  Figure  2  shows  the  velocity  vector  fields  for  the  cases 
with.  Ht  =  0  (Fig.  2a),  Ht  =  0  with  variable  viscosity  (Fig  2b),  Ht  = 
5  (Fig.  2c),  and  Ht  =  10  (Fig.  2d).  It  can  be  seen  that  with  the 
increase  in  the  strength  of  the  magnetic  field,  the  vorticity  diminishes 
and  the  recirculation  cell  patterns  change.  Isotherms  for  the  same 
sequence  of  test  runs  are  shown  in  Figure  4.  The  convergence 
histories  for  this  test  case  are  represented  in  terms  of  an 
instantaneous  count  of  the  solidified  cells  (Fig.  3)  The  convergence 
is  oscillatory  with  a  clear  indication  that  the  change  in  the  character  of 
the  cell  from  a  liquid  to  a  solid  (or  vice  versa)  will  locally  add  (or 
consume)  a  large  amount  of  energy  in  the  form  of  latent  heat,  thus 
temporarily  disturbing  the  iterative  process  of  simultaneously 
satisfying  all  equations  in  the  system.  It  should  be  pointed  out  that 
the  computational  grid  is  fixed  and  it  is  clustered  towards  the 
container  walls.  Consequently,  the  grid  is  coarse  in  the  central  region 
of  the  container  where  the  actual  solidification  occurs.  A  simple 
remedy  could  be  a  solution-adaptive  grid,  that  is,  a  grid  that  is 
continuously  adjusted  during  the  iteration  process  so  that  it  conforms 
in  a  highly  clustered  pattern  with  the  solid/liquid  interface.  An  even 
simpler  approach  could  be  to  increase  the  number  of  grid  cells 
through  the  entire  computational  domain,  thus  covering  even  the 
unknown  interface  region  with  a  relatively  fine  grid.  Figure  2  shows 
clearly  the  supression  of  the  vorticity  due  to  the  increase  in  the 
magnetic  field  strength.  Isotherms  for  the  same  sequence  of  runs 
(Fig.  4)  indicate  that  the  fluid/solid  interface  becomes  much  smoother 
with  the  increase  of  the  magnetic  field  strength. 


where  p*  is  the  combination  of  the  hydrostatic,  hydrodynamic,  and 
magnetic  field  pressure.  Physical  properties  can  be  general  functions 
of  temperature,  while  an  equivalent  specific  heat  c^  incorporates  the 
latent  heat.  Then,  energy  conservation  equation  becomes 


+  (vj0).j  PrRec  '  0  Pj  +  Rm^Rec  '  eukeiimHk.jHm.i  (3) 

*  pc 


while  magnetic  transport  equation  is 
Hi.i  ■  (vjHi  ■  V>Hj),j  =  Rrn  HiJj 

The  system  of  governing  partial  differential  equations  (,l  -4>  was 
iteratively  integrated  using  explicit  Runge-Kutia  four  stage  time 
stepping,  and  an  artificial  compressibility  formulation  [1],  except  that 
the  velocity  components  and  their  derivatives  were  explicitly  set  to 
zero  at  every  point  where  the  instantaneous  temperature  is  lower  than 
the  solidus  temperature. 
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SOLIDIFICATION  HISTORY 
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Figure  1 .  Recirculation  streamlines  inside  the  closed 
container  without  solidification  and  with  Pr  =  7.9,  Gr 
=  3000,  Re  =  sqrt(  Gr ),  Ec  =  1  for:  a)  Ht  =  0;  b)  Ht 
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Figure  3.  Convergence  Jiistorics:  number  of 
solidified  cells  versus  number  of  iterations. 
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Figure  2.  Velocity  vector  field  inside  the  melt  with 
Pm  =  1,  Pr  =  7.9,  Gr  =  3000,  Ec  =  1,  Re  =  sqrt(  Gr 
)  and:  a)  Ht  =  0;  b)  Ht  =  0  and  variable  viscosity;  c) 
Ht  =  5;  d)  Ht  -  10. 


Figure  4.  Isotherms  inside  the  solid  and  the  melt 
with  Pm  =  1,  Pr  =  7.9,  Gr  =  3000,  Ec  =  1,  Re  = 
sgrt(  Gr  )  and:  a)  Ht  =  0;  b)  Ht  =  0  and  variable 
viscosity;  c)  Ht  =  5;  d)  Ht  =  10. 
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Abstract-  An  asymptotic  model  for  a  detonadon 
in  duct  is  derived  through  activation i  energy 
asymptotics.  Using  linearized  stability  analysis, 
we  studythe  stability  of  the  constant  equilibrium 
state  ;  next  we  investigate  the  quenching 
phenomenon.  Finally  we  study  a  bifurcation 
phenomenon  related  to  the  length  of  the  duct  and 
propose  a  simplified  model. 

1-  Introduction 


The  steady  detonation  structure  consists 
of  a  shock  wave,  followed  by  an  induction  zone 
in  which  reaction  is  weak,  followed  by  a  zone  in 
which  vigorous  reaction  and  heat  release  occurs. 
Behind  the  reaction  zone  is  uniform  burnt  gas. 

In  the  limit  of  large  activation  energy  (9-*  °°) 
this  structure  reduces  to  the  well  known  square- 
wave  in  which  conditions  are  uniform  in  the 
induction  zone  (of  length  L)  and  the  reaction 
zone  is  a  discontinuity. 


When  the  stability  of  such  detonation 
wave  is  examined,  for  a  certain  class  of 


disturbances  based  upon  L  and  0,  [1],  [2] 
perturbations  to  the  shock  displacement  arc 
governed  by  the  fully  nonlinear  parabolic 
equation  (3} 


,,,  .12,  ,ec®®xx  -  L 

0)  a*!®, 


associated  with  the  natural  Neumann  boundary 
conditions  at  the  walls : 

(2)  gx(0,t)=gx(/,t)  =  (T 


in  which  c  is  a  positive  given  constant  and  1  is 
the  width  of  the  duct.  In  this  presentation,  we 
are  interested -in  the  stability  of  steady-state 

solutions  of  problem  (l)-(2).  Of  course  g  =  1  is 
the  expected  unperturbed  solution  but  numerical 
investigation  has  shown  the  existence  of 
periodic  non-constant  solutions  for  a  certain 
range  of  parameter  l .  Two  kinds  of  results  have 
been  obtained  for  the  evolution  of  a  perturbation 

of  the  constant  solution  g  =  1 . 


2.  Linearized  stability  analysis 

Linearizing  problem  (l)-(2)  around 
g  s  1,  we  get  the  dynamical  system  (3)-(4) 

(3)  u,  =  Su=|uxx  +  u 

(4)  ux(0,t)  =  ux(/,t)  =  0: 


CTt2 

eigenvalues  Xj  =  1  -  j  -yj.  with  corresponding 


eigenvectors  toj  =  cos  j  — ,  j  =  0,  1,... 

There  is  at  least  one  unstable  mode  (the 
planar  mode)  corresponding  to  X0  =1.  We 

define  the  critical  length  /  c  =  rt  -\J|'for  which 

A.)  =  0,  leading  to  a  center  manifold.  For  /  <!  c, 
the  stable  manifold  is  codimension  1. 
Numerically,  we  validate  this  behaviour  on  the 
nonlinear  problem  (l)-(2)  by  taking  a  small 
initial  condition  with  null  mean-value  :  the 
evolution  of  such  a  perturbation  vanishes  [4], 


3.  Quenching  phenomenon 

This  result  is  also  related  to  the  previous 
stability  analysis :  taking  a  non  periodic  initial 
condition  leads  to  an  unstable  behavior. 
Nevertheless,  the  solution  remains  bounded 
whereas  the  time  derivative  gt  blows-up  in  finite 
time  tc  :  this  is  the  so-called  quenching 
phenomenon. 

More  precisely,  an  analytical  argument 
(4)  shows  that :  g  _  (t  -  tg)  log  (t  -  tg) 

4.  Critical  length  1  c  and  bifurcation 
phenomenon 

As  previously  mentionned,  there  exists  a 
critical  length  /c  for  which  X]  crosses  0. 
Therefore  as  /  increases,  crossing  /  c  ,  the 
dimension  of  the  stable  manifold  decreases.  On 
the  other  hand,  we  exhibited  nontrivial  solutions 
for  t  >  I  c.  Figure  1  gives  a  description  of  the 
steady-state  periodic  solutions  in  the  plane 

<^/|7,  g(o> ). 
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(Figure  1) 

This  is  the  typical  exchange  of  stability 
occuring  when  there  exists  a  branch  of 
bifurcation.  In  order  to  give  a  mathematical 
description  of  this  bifurcation  phenomenon,  we 
derive  a  simpler  model  whose  behavior  can  be 
compared  to  the  physical  one.  Assuming  Igl  and 
Igxxl  to  be  small  and  taking  a  first  order 
approximation  of  the  logarithmic  term  we  get : 

-2/2 

(5)  ut  -  uxx  =—  (1  -  u)  log  (1  -  u) 

(6)  ux  (0,t)  =  ux(0,l)  =  0 

where  u  is  defined  by 

(7)  g=l-cIog(l-u) 

On  this  model,  we  study  the  existence  of  non¬ 
trivial  stationary  solutions  and  their  stability  as 
well  as  the  quenching  phenomenon. 
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Abstract  :  A  homogenized- model  for  nonlinear  adsorption 
diffusion  processes  in  porous  beds,  modelling  chromatographic 
columns,  is  proposed.  We  consider  an  inhomogeneous  periodic 
medium  with  two  levels  of  structure  having  strong-different 
scales.  This  suggests  to  homogenized  it.  The  first  structure  is  a 
convection  area.The  secondstructure  is  an  adsorption  area,  made 
of  small  porous  cristals.  Our  equations  are  convection-diffusion 
equations  for  concentration,  and  Stokes  equations  for  the  fluid 
velocity1.  Along  the  cristal  boundary,  we  have  three  kinds  of 
discontinuity :  jumps  of  the  fluid  velocity  and  of  the  diffusion 
coefficient,  and  a  nonlinear  jump  for  the  concentration:  This  last 
heterogenity  is  the  most  important  in  view  of  homogenization. 
We  show  a  maximum  principle  ans  some  energy  estimates  for 
our  nonlinear  problem.  From  them,  we  prove,  as  main  result,  the 
convergence  of  our  microscopic  model  to  a  homogeneous  non 
linear  macroscopic  model. 

I.  INTRODUCTION 

This  paper  presents  a  general  homogenized  macroscopic  model 
for  convection-diffusion  equations  into  a  chromatographic 
column.  This  model  takes  into  account  the  complete  internal 
heterogeneous  structure  of  the  column,  and  nonlinear 
relationships  between  moving  and  adsorbed  phases.  The  main 
point  of  our  problem  is  this  nonlinearity,  this  discontinuity  is  an 
isothermal  relationship  derived  from  termodynamical 
considerations.  A  chromatographic  column  is  constituted,  at  a 
microscopic  scale,  of  two  structures  having  strong  different 
scales:  a  convection  area  and  an  adsorption  area  made  of  small 
porous  cristals.  These  structures  arc  assumed  to  be  periodic. 
Our  equations  are  convection-diffusion  equations  coupled  with 
Stokes  equations.  The  difference  of  scales  between  the  two  levels 
suggests  us  to  use  the  homogenization  techniques  to  replace  the 
heterogeneous  medium  by  an  equivalent  homogeneous  medium. 

The  structures  arc  assumed  to  depend  on  some  small  parameter  e. 
This  parameter  will  tend  to  zero  in  the  homogenization  process. 
We  shall  show  that  under  some  reasonable  assumptions  on  the 
isotermal  jump  condition,  the  model  converges  to  some  nonlinear 
integrodifferential  equation.  The  e-depending  model  will  be 
called  the  microscopic  model.  The  homogeneous  limit  model 
willbe  the  macroscopic  model. 

II.  THE  MICROSCOPIC  MODEL 


solutions  wje,  and  ue  depend  on  6.  We  have  to  homogenize  the 


following  microscopic  model- : 

-->  Convection-diffusion  in  £2j : 

3twf  =  Di  A  wf  -  ue.Vw,  (1) 

— >  Convection  in 

3tw|  =  e  2D2A,w|  (2) 

-->  Jumps  of  discontinuity  for  the  concentration  ■ 

w|  =  h  (wf)  on  re  (3) 

-->  Flux  continuity  on  F2: 

Dj  Vw^.n  =  e  2  D2  Vw|.n  (4) 

— >  Dinchlet  conditions  on  the  input  part  of  the  boundary . 

wf  =  v0  on  rin  (5) 

— Neumann  condition  on  the  impermeable  wall  and  on  the 
output  part  of  the  boundary : 

Vwf.n  =  0  on  To  U  rom  (6) 

-->  Initial  condition  : 

we  (x,  t  =  0)  =0.  (7) 

-->  Stationaiy  Stokes  equations  for  the  fluid  velocity  in  £2j : 

AUe  =Vpe  (8) 

div  ue  =0  (9) 

with  the  following  boundary  conditions: 

Ue  =0  on  I^Ur0  (andinftz)  0°) 

ue  =u0  on  rin  U  r°ut  (11) 


ue.n<0  on  rin  (12) 


m.  THE  MACROSCOPIC  MODEL 

In  this  section  we  give  the  macroscopic  model  which  is  defined 
to  be  the  limit  model  of  the  microscopic  model  stated  in  the 
previous  section  when,  the  parameter  e  goes  to  zero  the 
convergence  will  be  examinated  in  the  next  section.  Notice  that 
this  model  is  uniform  for  the  whole  domain  £2.  The  macroscopic 
model  is  defined  as  follow  (where  F  denote  the  concentration  in 
£2  and  u  the  fluid  velocity) : 


Our  equations  are  convection-diffusion  equations  coupled  with 
Stokes  equations.  The  heterogeneities  are:  jumps  of  discontinuity 
for  the  velocity  and  for  the  diffusion  coefficient,  and  a  nonlinear 
jump  of  discontinuity  for-thc  concentration  The  last  one  is  the 

most  important.  Our  domain  SI  is  divided  into  two  parts  £2j  and 
O2,  corresponding  to  the  inhomogeneous  parts  of  the  column.  Is 
denotes  the  boundary  between  £2j,  fi-j.  The  unknown  function  is 
the  corresponding  concentration  denoted  by  wf,  i=l ,  2.  The  fluid 
velocity  is  denoted  by  ue,  and  the  coefficient  of  diffusion  by  Dj, 
i=l,  2.  The  geometry  of  £2*,  £22,  1^,  and  consequently  the 


iYi|  JL 

—  d,w+  f(t)  *d3h  (»v)  -  X  aU  9j'v  +  k  -Vw  =0  (14) 

i.j«l 

The  deformation  of  the  Laplace  operator  due  to  the  geometry  of 
the  heterogeneity  is  given  by : 

a;j  =  D,~-[Sij+(j^Jvck(y)dy)  (15) 

where :  ajj  is  a  Y-periodic  function  in  II'  (Y  j)  (Y  is  a  basic  cell, 
Yj  is  the  convection  part  of  the  cell  Y)  defined  as : 

iO|(  =  Oin  Yj  (1 6) 
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Voj^.n  =  -nj.  on  3Yj  (17) 

The  convolution  term  f  expressing  the  adsorbed  phase  is  given 


fft)  =  Po(t,y)  dy 

(18) 

where  ph  is  a  Y-periodic  function  in  H1  (Y2MY2  is  the 

adsorption  part  of  the  cell  Y)  defined  as : 

9t  Po  (y.O  -  D2  A  p0  (y,t)  =  0  in  Y2 

(19) 

Po  (y4)  =  1  on  Y]  u9Y2 

(20) 

O 

!l 

G> 

>> 

0 

Q. 

(21) 

The  fact  that  the  adsorbed  phase  appears  in  (14)  as  a  memory 
terrmis  strongly  related  to. the  fact  that  equation  (2)  in  the 
microscopic  model  is  linear.  For  a  more  general  model,  we  get  a 
coupled  system  in  place  of  equation  (14) :  a  convective-diffusive 

equation  for  the  whole  domain  £2  with  a  source: term  for  the 
adsorption  process,  coupled  with  a  diffusive  cell  equation  in  Y2 
involving  h  on  the  boundary  9Y2- 


Theorem : 

There  exists  a  unique functiohw  of  (  0,T ;  V)  which  is  the 

limit  of  the  family  wc  (solution  of  the  weak  microscopic 
problem)  in  (  0,T;V).  This  limit  function  satisfies  the  weak 
formulation  of  the  nonlineanintegrodifferential  equation  (14). 
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IV.  CONVERGENCE 


It  is  weliknown  (Tartar)  that  the  homogenization  of  the  Stokes's 
equations  in  porous  media  leads  to  the  Darcy's  law.  We  do  not 
rewrite  it  here. 

We  assume  the  following  properties  for  some  extension  of  the 
boundary  condition  v0  in  (5) : 

v0  e  1.2(0, T;  H!(fl))nH  1  (0,T;  L2(O))nL«([0,T]  x  0)  (22) 
3tv0  e  L2(0,T;  H^nHKO.T;  L2(O))nL'«([0,T|  x  0)(23) 

The  convergence  of  the  microscopic  model  to  the  macroscopic 
model  is  obtained  for  the  weak  formulation  of  the  models  given 
in  the  two  previous  sections.  It  follows  of  the  a  priori  estimates 
stated  in  the  two  following  lemmas: 

Lemma  1  (maximum  principle) : 

Under  hypothesis  (22)  and  (23)  the  following  estimates  hold  for 
the  solution  w£  of  the  microscopic  problem  : 

0  <  w£(x,t)  ZSttp  ( vq  (x,t)  ;  (x,t)  in  rit!xfO,  Tj)  for  almost 
every  (x,t)inQx[0,Tj . 

0  <dtw£(x,t)  £Sup  (d,v0(x.t)  ;  (x.t)  in  ri^[0,Tl)  for  almost 
every  (x.t)  in  QxlO.T) . 

The  prove  is  based  on  Stampacchia's  method. 

Lemma  2  (energy  estimates) : 

For  the  solution  w£  of  the  microscopic  problem  the  following 
norms  are  bounded  independently  of  e : 

Hwf  h~(o,TlL2  ll,vf  h~(o,T-JL.2  (&))'  11  (o.TJ?  (Of))’ 

dNw%>\i}(0j-jf  (Q<)y  Miwfi\L-(pjqS(nt))Mw^-(o.rd,2(n)))' 
II3|V  (o,TJ*  (flfj).  C\\df2w^\[}  (0j-£,2  (Of))- 

Let  us  define  iv£thch-harmonic  extension  of  we: 

A  h  (w*)  =  0  in  Q|.  (24) 

Wc  have  the  following  convergence  result : 
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ABSTRACT  -  We  describe  a  new  phase  ficld’modc!  for  the  phase 
transition  of  an  isothermal  binary  alloy.  This  is  the  first  time,  to  the 
authors  knowledge,  that  a  phase  field  model  has  been:  proposed  for 
phase  transition  in  a  impure  material.  This  represents  a  significant 
step  in  the  derivation  of  a  phase  field  model  foi  the  solidification  of 
a  nonisothcrmal  binary  alloy. 

I.  INTRODUCTION 

Classical  macroscopic  models  of  phase.transitions  model  the  in¬ 
terface  between  regions  of  different  phase  as  a  surface,  and  hence 
assume  it  has  zero  thickness.  The  governing  equations  for  thermo¬ 
dynamic  variables,  such  as  temperature  and  solute,  are  formulated 
in  each  phase  independently,  based  upon  conservation  principles  and 
quantitively  verified  phenomenological  laws.  The  boundary  condi¬ 
tions  at  the  interface  are  chosen  to  describe  the  processes,  such  as 
liberation  of  latent  heat  and  segregation  that  occur  at  the  interface 
on  a  microscopic  scale.  This  approach  gives  rise  to  the  formulation 
of  a  free  boundary  problem  which  provides  a  difficult  mathemati¬ 
cal  setting  and  only  the  simplest  models  of  phase  change  have  been 
rigorously  mathematically  analysed.  Inc  advantage  of  these  mod¬ 
els  is  that  it  is  clear  from  the  outset  what  physical  mechanisms  are 
incorporated  into  them,  and  comparison  with  careful  controlled  ex¬ 
periments  is  possible. 

An  alternative  technique  for  investigating  transport  processes  m 
systems  involving  a  phase  transition,  involves  the  construction  of 
a  Landau-Ginzbcrg  free  energy  functional.  This  approach  has  its 
roots  in  statistical  physics,  Landau  and  Khalatinikov,  (ll.  Further, 
a  phase  field,  which  is  a  function,  is  postulated  which  de¬ 

scribes  the  phase  of  the  system  at  any  point  in  time  and  space.  It  is 
assumed  that  the  Helmholtz  free  energy  S(t 5,  ),  is  a  functional  of 

the  phase  ficUL,as  well  as  any  other  thermody  namic  variables,  (such 
at  temperature  which  arc  denoted  here  by  ellipsis)  in  the  following 
way: 

S(<5,...)=  /  }€*(V0)* +  *(&... (1) 

J  n 

where  ft  is  the  region  occupied  by  the  system,  and  is  the 

free  energy  density.  Its  dependence  on  $  usually  has  a  "double  well” 
form.  The  phase  field  is  then  assumed  to  evolve  as: 

(2) 

where  L  is  some  partial  differential  operator.  Tnis  equation  is  then 
supplemented  by  partial  differential  equations  for  the  other  thermo¬ 
dynamic  variables.  Cahn,  (2j,  has  successfully  used  this  approach  to 
model  spinodal  decomposition  of  a  binary  alloy,  although  here  the 
concentration  naturally  plays  the  role  of  the  phase  field.  Various 
models  that  employ  this  idea  arc  reviewed  by  Halperin,  Hohenburg 
and  Ma,  (4,',  particularly  in  regard  to  the  study  of  critical  phenom 
ena.  The  Model  C  given  by  these  authors  has  been  adapted  by 
Langer,  [5],  Fix,  [6]  and  most  prolifically  by  Caginalp,  [7]  to  derive 
the  so-called  "phase-field  model”  of  solidification  which  models  the 
phase  change  of  a  pure  material.  Caginalp  has  extensively  studied 
this,  and  variations  of  this  model,  [8]  j9j.  It  has  emerged  from  study 
of  this  model  that  qualititivcly  it  exhibits  features  common  to  so¬ 
lidification  of  a  pure  materia!.  Numerical  calculations  based  on  this 
model,  by  Smith,  ti0,  and  a  similar  model,  by  Kubayashl,  show 
breakdown  of  a  planar  and  circular  interfaces  to  cellular  structures, 
as  well  as  the  formation  of  dendrite  like  structures,  liquid  trapping 
and  coarsening  behaviour. 


Caginalp,  ,8,  has  shown  in  various  distinguished  bruits,  in  which 
t  •  0,  that  various  forms  of  the  classical  Stefan  problem  may  be 
recovered,  in  which  the  interface  is  taken  to  be  "sharp"  i.e.  modeled 
by  a  surface.  In  this  limit  there  are  thin  layers  within  0  of  thickness 
0(cy  in  which  the  phase  field  rapidly  changes.  These  are  interpreted 
as  representing  interfaces,  which  arc  necessarily  diffuse.  From  this 
analysis  it  transpires  that  in  some  limits,  the  interfacial  dynamics 
involve  curvature  effects  corresponding  to  the  Gibbs-Thompson  in¬ 
terfacial  surface  energy  as  well  as  kinetic  effects.  Further,  it  is  also 
possible  to  recover  the  classical  Hclc  Shaw  problem  in  other  limits. 
It  is  dear  that  this  approach  can  embody  a  considerable  variety  of 
realistic  physical  effects  in  a  coherent  way. 

However,  this  superabundance  of  physical  phenomena  also  pro¬ 
vides  a  difficulty  when  applying  the  model  to  a  definite  physical 
situation.  This  is  because  it  is  not  clear  how  to  choose  the  values  of 
parameters  in  the  phase  field  model  so  that  it  models  the  solidifica 
tion  of  a  pure  material  with  given  materials  and  growth  parameters, 
(or  equivalently  the  Stefan  number  and  capillary  number). 

Another  difficulty  with  this  particular  model,  as  pointed  out  by 
Penrose  and  Fife  [12],  is  that  it  is  thermodynamically  inconsistent. 
This  is  because  the  free  energy  functional  is  only  employed  in  the 
formulation  of  the  kinetic  equation  for  the  phase  field.  The  concern 
here  is  that  the  solution  of  the  above  governing  equations  docs  not 
correspond  to  the  free  energy  decreasing  monotonically  with  time, 
as  required  by  the  Second  Law  of  Thermodynamics.  An  alterna¬ 
tive  approach  suggested  by  these  authors  is  to  construct  an  entropy 
functional,  5,  of  the  system  and  require  it  to  evolve  as  a  gradient 
flow  of  the  form: 

u  oc  grad0S[u),  (3) 

where  grade  11  a  suiiabie  constrained  gradient,  and  u  represents  the 
thermodynamic  variables.  Th.>  formulation  necessarily  ensures  that 
the  total  entropy  of  the  system  increases  with  time. 

The  appeal  of  phase  field  models  in  describing  phase  transitions 
is  twofold; 

•  It  provides  a  simple,  elegant  description,  that  appears  to  cm 
body  a  rich  variety  of  realistic  physical  phenomena. 

•  From  a  computational  point  of  view  it  is  relatively  simple 
to  compute  solutions.  This  is  because  it  is  not  necessary  to 
distinguish  between  the  different  phases.  Computations  on 
the  classical  sharp  interface  formulation  require  that  the  free 
boundary  is  tracked  numerically  and  that  the  region  occupied 
by  each  phase  is  therefore  determined  and  dealt  with  indi¬ 
vidually.  This  results  in  very  difficult  and  untidy  numerical 
algorithms. 

In  this  paper  we  derive  a  new  phase  field  model  for  phase  ir*n- 
sitions  of  an  isothermal  binary  solution.  Jo  our  knowledge,  there 
are  to  dale  no  phase  field  models  that  deal  with  impure  materials. 
The  model  presented  here  is  a  first  step  io  developing  &  phase  field 
model  for  the  solidification  of  an  alloy. 

IF.  PHASE  FIELD  MODEL 

Wc  consider  an  isothermal  volution  of  two  different  species  A  and 
B  in  which  ate  present  two  phases,  solid  and  liquid,  contained  m  a 
fiveil  legion  fl  with  boundary  dfl.  I\c denote  the  concentration  of 
B  b»  and  «c  introduce  a  phase  field  tj  which  represents 

the  phase  in  time  and  space  in  fl.  For  definite' ess  we  describe  the 
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solid  liquid  interface  by  $(x,t)  -  \  and  denote  solid  regions  where 
<t>{x,l)  >  5  and  liquid  regions  where  <p{x, t)  < 

A  recent  phase  field  me  "1  due  to  Kobayashi  [11]  models  the  phase 
transition  of  a  pure  material  by  employing  the  following  gradient 
weighted  frec-energy  functional: 

**(*,T)»  /  +  /*(#, T)dn,  (4) 

J  n  * 

where  e  is  a  constant,  T(x,t)  is  the  temperature  and  the  free  energy 
density  /(<£,  T)  is  represented  by: 

Mt>T)  =  /4  -(r  \-m)dp,  (5) 

where  /3(T)  is  a  monotonic  increasing  function  of  T,  such  that 
0{Tm)  =  0,  where  is  the  freezing  temperature  of  the  mate¬ 
rial  and  |/3(T)1  <  [  The  free  energy  density  is  a  double 

well  potential.  The  restriction  |/3(T)|  <  5  ensures  that  it  has  local 
minima  at  <p  —  0  and  <j>  =  1,  and  a  local  maxima  at  <f>  =  1  +  /3 (T). 
Because  of  the  two  minima  the  system  may  exist  stablcly  in  a  state 
which  is  all-liquid  (0(x,t)  =  0)  or  all-solid  ( <p(x,t )  —  1).  There  is 
an  energy  penalty  for  a  change  of  phase  within  the  region  fi,  which 
corresponds  to  ip  varying  between  zero  and  unity.  This  is  because 
such  a  variation  increases  the  lotal.cnergy  Tg  of  the  system,  due  to 
an  increased  energy  density  associated  with  the  double  well  nature 
of  the  aergy  density,  and  also  due  to  the  contribution  to  the  total 
energy  due  to  the  gradient  energy,  which  is  no  longer  zero. 

If  -i  <  /3  <  0,  then  the  global  minima  of  the  energy  density  is 
at  <j>  -  1  and  so  the  all-solid  state  is  the  one  with  the  lowest  energy 
and  is  hence  the  prefered  state.  However,  if  0  <  /3  <  |  then  the 
situation  is  reversed,  and  the  liquid  is  the  preferred  state.  We  sec 
that  at  temperatures  below  the  melting  point  the  solid  phase  has  the 
minimum  energy  and  is  prefered,  whereas  for  temperatures  above 
the  melting  temperature,  th<-  all-liquid  phase  is  preferred. 

We  now  employ  this  form  for  the  free  energy  density  to  develop 
the  appropriate  free  energy  density  for  an 'isothermal  ideal  solution. 
We  assume  that  the  temperature,  7,  which  is  given,  is  such  that  if 
the  solution  consisted  only  of  species  A  (c  =  0)  the  all- solid  phase 
would  be  the  prefered  state  i.e.  T  <  Tfa,  where  T/f  is  the  melting 
temperature  of  pure  A.  Further,  we  also  assume  that  the  tempera¬ 
ture  T  is  sufficiently  large  that  if  the  system  consisted  of  species  B 
alone  (c  =  1}  the  all-liquid  phase  would  be  th»  prefered  state  i.e. 
T  >  Tj§,  where  Tft  is  the  melting  temperature  of  pure  B.  We  also 
assume  that  the  molar  Gibbs  free  energy  densities  of  each  species  A. 
fjid  -B  alone  are  of  the  form  given  by  Kobayashi,  and  are  denoted 
by  fA(fcT)  end  respectively.  Specifically  we  put. 

Ja(*;T)  =  WA-J*p(p-l)(p-±-MT))dp,  (6) 

fu{4>\ T)  =  Wb J  p{P^l)(p-\-MT))dp,  (T) 

where  here  Wa,'Wb  are  constants,  and  T  the  temperature  is  a  pa¬ 
rameter  in  vhis -isothermal  situation.  We  note  that  eecause  1$  <. 
T  <  Z$,  then  <  Pa(7)  <  0  <  Pb{T)  <  1-  The  total  energy 
density  !(4>,c\T)  of  the  solution  is: 

t  T 

/f c;  T)  —  cfis(<p,T)  r(l  c)/x(0;  T)  I  —  [ciogc  t  (1  -  c)log(l  -  c)J, 

vm 

(s) 

where  k  is  Boltzmans  constant  and  tim  is  the  molar  volume.  The 
first  two  terms  correspond  to  the  contriuutnn  to  me  energy  density, 
due  to  the  individual  molar  Gibbs  free  energies  of  the  two  species 
and  the  last  term  is  due  to  the  decrease  i:i  energy  associated  with 
the  mixing. of  the  two  constituents,  unde*  our  assumption  that  it  is 
an  ideal  solution. 

In  a  similar  way  to  Kobayashi  we  define  the  free  energy  functional 
hy:  2 

^,c;T)  =  jf  +  M,c;T)dn.  (9) 


In  order  to  derive  a  kinetic  model  wc  make  the  assumption  thal 
the  system  evolves  in  time  so  that  its  total  frec-energy  decreases 
nionutunkally.  This  may  he  met  by  assuming  the  rate  of  change  of 
c  and  <j>  vary  according  to  the  constrained  gradient  of  7{<p,c,T). 


u  a  -grnd0^(u),  (10) 


where  u  =  ( <j>,c)T .  Fife,  [13]  discusses  how  such  constrained  gra¬ 
dients  may  defined  in  a  more  rigorous  mathematical  setting.  The 
only  constraint  we  require  here  is  that  both  species  are  conserved, 
i.e.  jj  fn  cdfl  =  0.  Wc  chose  the  constrained  gradient  such  that: 


0<p  _  6F 
81  =  KlSfi’ 


(11) 


!  =  «,V.W1-C)vg,  (12) 

where  kj  and  kj  are  constants.  The  boundary  conditions  are 


dip  _  dc  _ 
dn  8n  ’ 


(13) 


where  n  is  the  outward  normal  to  the  boundary  9fl.  We  may  in¬ 
terpret  the  right  hand  side  of  (12)  as  the  divergence  of  a  solute 
flux,j  =  c(l  c)V{^.  The  coefficient  c(l  c)  has  been  included  to 
ensure  that  the  diffusion  equation  for  the  solute  that  emerges  has  a 
diffusion  coefficient  that  is  constant. 

Evaluating  the  variational  derivatives  of  the  free  energy  functional 
gives  that: 


which  may  be  also  written  as: 


81 


“'bM'T£+(i 


(16) 


ji  =-  k2V  -  (c(l  -  c)V(/4  -  Zb))  +  DV'c,  (17) 

where  T)  =  is  the  dilfusivity  of  the  solute. 
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Abstract-A  method  is  presented  for  solving 
the  multidimensional  equation  of  radiative 
transfer  in  a  scattering  plane-parallel  atmo¬ 
sphere  with  inhomogeneous  spreading  surface. 
The  method,  based  on  the  spherical  narmonics 
expansion,  can  be  used  to  compute  models  with 
an  arbitrary  large  optical  thickness  and  any 
scattering  phase  function. 


The  correction  problem  of  the  distortion 
of  the  representation  of  the  earth's  surface 
arises  in  connection  with  the  investigations 
of  natural  resources  of  the  Earth  from  the 
space.  The  main  stage  here  is  the  numerical 
solving  of  the  following  problem  of  radiati¬ 
ve  transfer  in  three-dimensional  plane  slab: 

(w,  grad  I)  +  cr(z)  I  s  St, 

1 1 2_0=  hfo<5(w-«o),  w  <=  a+,  ri) 

dy'  €  a-> 
ca(z)+  4 

where  S  I  =  — Jg(z,M0  )-I(?,»'  )dw'  . 

Ifr.S)^  is  the  radiation  intensity  at  the 
point  r  =  (x,y,z) _ along  the  unit  vector 

co  =  (vl-pzcos f>,  Yl-n2 sinp,  G  is^the  sur¬ 

face  of  the  unit  sphere,  0+={<o  :(w,n)>0  }, 

O  ={«  :(to,n)<0  },  <Hz)  ,o  (z)  are  the  extinc- 

9 

tion  and  scattering  coefficients,  respective¬ 
ly,  g(z,Acs=w-co'  )  is  the  scattering  phase 

function. 

Boundary  condition  at  the  z=0  defines  the 
illumination  of  the  top  of  an  atmosphere  by  a 
unidirectional  beam  of  monochromatic  radia¬ 
tion  of  strength  nF0.  Condition  at  the  z=H 

is  the  Lambert's  reflection  law,  where 


0  £q(x,y)S  1  is  the  reflection  coefficient  of 
the  spreading  surface. 

By  the  method  described  I. V. Mishin  and 
T.A. Sushkevich  [1]  the  solution  of  the 
problem  (1)  can  be  reduced  to  the  solving  of 
the  problems  (2)  and  (3). 

tug  +  c'Cz)  l  =  S  I, 

1 1  =  nF  <5(«-w  ) ,  w  <=  O  .  (2) 

*2=0  O  O  + 

Ij  =  0.  cS  €  O  , 

*2=11  - 

/  2  /  Z 

^dz  +  cos-A+Py  cl-p  sinp)  I'k  =  S 

*L=o=  0,  CO  s  n+;  *V|a_H=  1,  W  e  n_:  f3) 


The  numerical  solution  of  the  problem  (2) 
considered  in  our  work  [21.  And  now  we 
discuss  the  use  of  the  spherical  harmonics 
method  for  solving  (3)  when  py=0. 

In  this  case.  <P(z,ac,p,p  )  can  be  expressed 

*  M 


in  a  Fourier  series  as 


*='V°+2^  'rf* cosnvp  .  (4) 


Phase  function  allowg  following  expansion: 
g(z,Ps )=r° )+2^m(z,p,/j'  )cosm(iP-?>'  ),(5) 

m=  1 
oo 

where  rm=  £  gfc {z)Y”(m)Y™(^' ) ,  Y™(aO  is  the 
k  =  m  ^  r' 

normalized  associated  Legendre  polynomials  - 
By  substituting  (4)  and  (5)  in  (3)  we  obtain 

h§f+  1  )^|jy"V%-  ,(6) 

*mlsxo=0,  V>0;  *°|Z=H= l.^ls=„=0.  mfel,  P<0; 

^n(z,y,pj()  is  the  complex  function,  i.e. 

ipm  -  p™  +  i>p™ .  By  analyzing  (6)  we  can  to  show 

that  'fR>i+1=0  m  *zk=0,  k=0,l, . . . ,  [M/2]  . 

By  eliminating  those  components  frornm(6)  and 
defining  the  new  real  function  $  (z,/j,px) 

according  to  the  rule  *  ='PR  ,  $  =w 

we  find 


r  -5xm  r  1  O’  i 

,  .m  /.  2  T m+ 1  9  n  m~m  .  . 

'fJrr—HXi  +  (~1)  p  Yl-fJ  ($  +$  Y  $  d/J  , 

az  *  Q  (7) 


*  |2=o=°.  ^>0;  *  ISB„=0,  nfcl,  p<0; 

Expanding  Sm(z,g,Px)  in  Legendre  polynomials 

$m=  *k(®*PK,Yk('l|)»  (8) 


Substituting  this  expansion  in  (7)  we  obtain 
the  system  of  ordinary  differential  equations 

A—  +  [C(z)+pxD]2  =  0,  (9) 

A,  C(z)  are  thg  block  diagonal  matrices  of 

the  order  N  =  E  (N  -m+1).  Every  block  A  „  is 

m  in ,  m 

m  =  0 

the  symmetric  and  triadiagonal  matrix  of  the 
order  N  -m+1  with  zero  main  diagonal. 

Cm,m=  diag£cr(2m+l)-cc8gm,  c(2m+3)-cregm+i , .  . . , 


c?,2Nm+l)-cr gN  }.  D  is  the  block-triadiagonal 

m 

matrix  with  zero  blocks  in  the  main  diagonal 
and  blocks  D  , =-DT  .  are  the  rectangular 
matrices  (N  -mxl)x(N  -m).  ?=(^° ,&l , . . . ,$M )T  . 

m  Tft+  X 

-.rn  .  T 

$  =  (i  . $  )  . 

m  m*  l  hi 

Tft 

For  approximation  of  the  boundary  conditions 
in  (7)  we  use  Marshak's  conditions 

G"lm(0)=0:  G°2°(H)=t,  G™lm(H)=0,  nfil,  (10) 

where  G^1.  G2  are  defined  in  [2], 

For  inhomogeneous  in  the  vertical  directi 
on  atmospheric  models,  the  usual  approximati¬ 
on  is  to  divide  the  atmosphere  into  several 
homogeneous  layers.  In  each  layer  fzi_J,zil 

matrix  C(z)  is  the  constant  and  egual  Ct . 
Integrating  (S)  over  z  in  each  layer,  we  get 
+  exp(B  Azt )  ?(zi)  =  0,  (11) 
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where  B=A-1R,  R=(C.+pxD). 

In  order  to  define  matrix  exp(BAzt )  it  is 

necessary  to  solye  eigenvalue  problem  for 
matrix  B,  i.e. 

R/$  =  XA/5.  (12) 

Matrix  B  has  N  different  complex  eigenvalues, 
which  occur  in  ±  pairs, i.e.  ±X^ ,  o=l,...,N/2, 

and  therefore  the  order  of  the  problem  (12) 
can  be  reduced  to  N/2.  For  this  purpose  we 
define  the  unitary  transformation  P0 ,  which 

sorts  a  vector  into  its  odd  and  even  parts, 

i.e. 


Po^  =  ,(ia  '  •  •  •  ’^n/z  -  i  ,(iz  ,(i*  ’  ■ '  ■  ,/?N/2  )  = 

=  r>  =  (5?t  ,nb)T  . 

With  this  substitution,  our  problem  can  be 
written  as 


PoRPop=XPoAPo*  or 


or,  o 

0  R_ 


=X 


ro  a4 
a2  0 


Eliminating  nt ,  we  find 

ZK  =  where  z=AilRiA2lR2-  (13) 

The  problem  (13)  is  successfully  computing  by 
using  the  program  DHQR2  from  the1EISPACK  col¬ 
lection  [3] .  Thus  we  have  B=UAU  ,  where  A  is 
the  block-diagonal  matrix  with  the  blocks 


(■>£*)  *  U  1 
^  1  RJ 


is  the  matrix  of  the  eigenvectors. 


Then  exp(B)=Uexp(A)U  ,  where  exp(A)  is  the 
block-diagonal  matrix  with  the  blocks 


expX 


f  cosXJsinXi 
-sinXJcosXi 


Thus,  the  coefficients  of  (11)  are  defined. 
Adding  the  boundary  conditions  (10),  we  obta¬ 
in  the  linear  system  of  algebraic  equations. 

Substituting  the  computed  moments  to  (8) 
and  then  to  (4),  we  obtain  some  function 
'Pj (z,M,#>) ,  which  oscillates  over  angle  varia¬ 


bles  around  exact  solution.  When  M  and  N  are 

Tfl 


increasing,  is  slowly  converging  to  4<.  The¬ 
refore,,  for  obtaining  of  reasonable  solution 
without  largely  increasing  of  the  order  of 
approximation  there  is  necessary  to  make  smo¬ 
othing  of  the  spherical  harmonics  solution. 

For  this  purpose  we  use  the  smoothing 
procedure,  obtained  by  us  [2]  for  the  problem 
(2).  The  main  idea  of  this  method  is  the 
numerical  evaluation  of  the  error  W  = 

Following  this  method  we  can  construct 
boundary  problem  for  W (z,V,<P) 

+  [c-ip^V) -pZ cos^>)W  =  S  W  +  Q(z,tJ,p), 

J  *  (14) 


[W I  z=o=>Pn  (0 ,IJ  )  ,tJ>0  ’ 


U\z=,rx*IiW,v,<P)-l,V<0; 


where  Q(z,ai,so)  = 

M 

Z”  i  t  ■  1 1— - 1  -  ^  (}$ 

<p+<5oJ  ^(H^lKH^mtl)-^  (AOcosmp  + 

m 

m-O 

^  M-l 

+  -T1  E  [/cNm-m)CNm-m+1>  C1  + 

1 — »  u  rfi  rfi 

m=i _ _ . 

+  •/(Nm-m+l)(Nm-rn+2)  Y^+z (g)l cosmg  - 

m  m 

truncating  error  of  the  system  (9). 


integrating  (14)  without  SW  in  right  hand 
side  we  obtain  W  (-z which  is  the  appro¬ 
ximation  of  W  in  the  "single  scattering".  In 
order  to  evaluate  W  when  v<0  it  is  necessary 


to  compute  the  integrals 
Az 


fexp( t/g ) {cosbt]$N  (t)dt’  b=pxy^cos,/P, 

0  m 

which  can  be  obtained  by  multiplying  of  the 
system  (9)  at  exp(t/p)  {cosbt}’  by  integrating 


over  z  and  performing  respectively  matrix 
transformations.  Function  Wt  is  the  exact 

value  of  the  error  of  the  spherical  harmonics 
approximation  of  the  function  ¥  ,  which  is 

the  component  of  the  solution  of  the  problem 
(3)  and  described  "single  reflection"  from 
the  spreading  surface,  i.e.  'V  has  following 
form:  #  =  *  +  where 

H 

4'l=exp[Jcf(?  )d5/p]  [cosb(H-z)-isinb(H-z)]  .  (15) 

Z 

characterizes  diffuse  field  and  is 
the  smooth  function.  As  seems  from  (15)  func¬ 
tion  *  is  the  oscillating  when  Px*0  and  the¬ 
refore  is  bad  approximated  by  spherical  har¬ 
monics.  Accounting  of  error  W±  as  4*  =  *PN-  Wt 
could  described  *  with  high  accuracy  . 

Thus,  the  describing  smoothing  procedure  will 
make  possible  to  use  the  spherical  harmonics 
for  solution  the  problem  03)  with  high 
efficiency. 

Results  of  the  solving  of  the  problem  (3) 
for  the  Elterman's  atmospheric  model  C4]  for 
X=0.75  mkm  are  presented  in  figure.  Here 
plotted  function  *  at  the  top  of  atmosphere, 
which  usually  presented  in  following  form: 


X(0,M,P,Px )=exp(iHb)A(p,«>,px )exp[iF(p,^,Px )) . 
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Numerical  Solving  of  Boundary-Value  Problems  of  Mathematical  Physic 
with  Reproduction  of  Solution  Group 


A. S. Shvedov 

■‘Keldysh  Institute  of  Applied  Mathematics, 
the  USSR  Academy  of  Sciences, 

Miusskaja  sq. 4, Moscow, 125047, USSR) 

The  synthesis  of  simplest  algorithms  for 
numerical  solution  of  boundary-value  pro¬ 
blems  with  two  or  three  space  variables  on 
the  base  of  algorithms  for  corresponding 
single-dimensional  problems  is  generally 
connected  only  with  overcoming  technical  di¬ 
fficulties.  But  the  quality  of  such  simplest 
algotithms  often  proves  to  be  low. For  ins¬ 
tance,  the  solution  symmetry  disturbunce  or 
the  approximation  loss  can  occur  when  the 
vector  field  is  turned. The  synthesys  of  more 
perfect  algorithms  for  multidimensional  pro¬ 
blems  is  connected  with  overcoming  serious 
mathematical  difficulties. 

Let’s  consider  the  system  of  equations  for 
unsteady  inviscous  compressible  fluid  flows 
with  three  spatial  variables. 


dp  8  e  -» 

—  +  div  pu  =0,  —  +  div  eu  +  div  pu  =0, 

at  at 


a  u 

p —  +  grad  p  +  p  grad 

a  t 


(  U,U  ) 
2 


+  p  rot 


(1) 


uxu-0. 


p-  density,  p-  pressure,  u  -  velocity  of 

o 

gas,  e  =  pfe  +  0,5  |u  \  )  ,  e  -  internal 

energy. Equation  of  state  for  p,p  and  e  must 
be  added  to  the  system  (1). 

THEOREM. Difference  scheme  of  Godunov’s 
type  with  strong  symmetry  conservation  pro¬ 
perty  is  constructed  for  system  (1). 

The  algorithm  preserves  the  symmetry  if  it 
reproduces  the  property  of  the  initial  boun¬ 
dary-value  problem  solution  to  transform  in 
the  solution  of  the  same  problem  under  the 
effect  of  shift  or  rotation  groups.  At  the 
same  time  the  same  algorithm  must  be  adapt¬ 
able  to  any  group  irrespective  of  whether 
the  group  is  the  shift  or  rotation  group  and 
also  irrespective  of  the  shift  direction  and 
location  of  rotation  centres  or  axes.  I.e. 
whatever  shift  or  rotation  group  of  the  ini¬ 
tial  value-boundary  problem  withstands  the 
numerical  solution  will  transform  into 
itself  under  the  effect  of  the  group 
discrete  analogue. 

Here  we  give  the  strict  mathematical  defi¬ 
nition  of  the  symmetry  conservation 
property, distinguishing  between  the  strong 
and  weak  symmetry  conservation. 

The  algorithm  of  boundary-value  problem 
numerical  solution  consists  of  the  definiti¬ 
on  of  the  set, serving  as  a  basis  for  the  ap¬ 
proximate  solution  (for  the  counting  region) 
and  for  finding  the  solution.  He  shall 
consider  the  counting  region  to  be  an  image 
of  a  four-dimensional  parallelepiped 

E  ={(  X  1  ,  X  2  ,  x  3  ,  x  4  )  ; 

0£  x  1  sL  ,0£  x  2  £li  ,0£  x  3  £N  ,0*  x  4  £K} 

(L,M,H,K  are  positive  integers). The  piece- 
wise-smooth  one-to-one  intra  E  mapping 


Y  ■»  IR  4  has  the  following  form: 

x=x(x  \x  2,x  3, x  4),y=y(x  \x  2,x  3,x  4), 

z=zCx  l,x  2,  x  3,x  4),  t=t(x  4). 

Here  x,y, z  are  the  cartesian  coordinates  in 

the  space  R  3,  t  is  the  time. We  shall  write 
t  k  instead  of  t  (  k  )  , t  Q<t  <..'.<t  R. 

We  consider  the  mapping  Y  to  be  linear  over 

x  4  for  each  line  segment 

k-l<x4<k,  k  =  1  , ... ,  K. 

We  use  S  j  k  to  designate  the  three- 
dimensional  cube 

{  (  X  1  ,  X2,  X3,  X4); 

i-lsx'il,  ffl  -  1  <  x  2  £  m  , 

n~  1—  x3  —  n,  x  4  =  k  } 
The  approximate  solution  is  'a  function 
defined  on  the  set  Y  (  E  )  and  constant  on 
every  set  Y  C  E  )  ,  1  s  ]  s  L  ,  1  £ 

l  in  n  K 

£  m  £  H  ,  1  £  n  £  N  ,  OiksK.de  define 
the  value  of  the  approximate  solution  on 
this  set  as  f  , 

1  m  n  k 

Definition  1.  The  boundary-value  problem 
is  called  two-dimensional  (one-dimensional) 
in  the  following  case.  First,  there  is  such 
a  a  ,  p  ,  y  system  of  rectangular  cartesi¬ 
an,  or  cylindrical  ,  or  spherical  coordina¬ 
tes  at  the  space  IR  3  that  the  problem  solu¬ 
tion  can  be  defined  as  a  function  of  the  va¬ 
riables  a  and  p  (the  variable  a).  Second, 
if  vector  fields  are  used  in  analysis,  the 
decomposition  of  these  fields  into  unit  vec¬ 
tors  of  the  coordinate  system  a  ,  p  ,  y  the 
components  that  correspond  to  the  unit  vec¬ 
tor  of  the  variable  y  (or  unit  vectors  of 
the  variables  p  and  y)  are  to  be  zero. 

Later  we  shall  consider  only  two-  or  one¬ 
dimensional  problems,  for  which  the  variab¬ 
les  a  and^P  (the  variable  a)  are  not 
angular. It  means  that  the  boundary-value 
problem  withstands  the  erfect  of  the  shift 
or  rotation  group,  and  not  the  extention 
group. 

Definition  2. We  shall  say  the  grid  const¬ 
ruction  method  has  the  symmetry  conservation 
property,  if  any  two-  or  one-dimensional 
problem  in  the  coordinate  system  a  ,  p  ,  y 
appropiate  for  a  given  problem, satisfies  the 
equalities 

Y(l,m,n,t  k  )=(cc  j  B  ,  p  x  m  ,  y  n  ,  t  ^  )  - 

-  for  two-dimensional  problems  and 
Y(l,m,n,  t  k  Moc  l  ,  p  m  ,  y  „  ,  t  k  )  - 

-  for  one-dimensional  problems. Here 
a  o  <  a  i  <  •••<  a  l  '  P  o  <  0  i  < 

<  P  „  ,  r  0  <  3-  i  <  ...  <  r  H. 

Definition  3. The  numerical  solution  algo¬ 
rithm  for  a  class  of  boundary-value  problems 
with  the  three  space  variables  has  the  weak 
symmetry  conservation  property,  if  the  grid 
construction  method  has  the  symmetry  conser¬ 
vation  property  and  the  numerical  solution 
of  any  two-dimensional  problem  of  the  class 
considered,  based  on  this  algorithm  satisfi- 
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es  the  condition 


1  m  1  k 


=  f 


1  m  N  k 


f 


1  m  k  ' 


isJM,  1  *  m  *  M  ,  0  £  k  £  K  ; 
and  the  numerical  solution  of  any  one-dimen¬ 
sional  problem  of  the  class  considered  sati¬ 
sfies  the  condition 

f  =  .  .  .  =  f  = 

1  1  1  k  1  Hi  k 


=f 


112  k 


=. ..=f 


1  M  2  k 


f 


1  M  N  k 


=  f  j  k  ;  1  *  1  *  L  ,  0  s  k  £  K  . 
If  f  i  m  n  k  contains  vectors,  then  we  con¬ 
sider  the  vector  equality  as  an  equality  of 
their  components  obtained  by  their  decompo¬ 
sition  into  unit  vectors  of  the  coordinate 


system  a  ,  |3  ,  y\ 

Definition  4. The  numerical  solution  algo¬ 
rithm  for  a  class  of  boundary-value  problems 
with  the  three  space  variables  has  the 
strong  symmetry  conservation  property,  if  it 
has  the  weak  symmetry  conservation  property 
and  of  any  two-dimensional  problems  or  the 
class  considered  the  numerical  solution 
f  j  m  k  does  not  depend  on  the  number  N  and 

the  set  K  0  ,  K  x  ^  ,  and  of  any 

single-dimensional  problem  of  the  class  con¬ 
sidered  the  numerical  solution  f  l  doesn’t 

depend  on  the  numbers  H  and  W  and  the  sets 
P  o  '  P  0  m  and  y  o  /  *  i  .  •  •  ■ 


An  illustration  will  make  the  difference 
between  weak  and  strong  symmetry  conservati¬ 
ons  clear. Let  the  decision  of  boundary-value 

froblem  depend  on  the  r  coordinate  only  in 
he  (z,r,<p)  cylindrical  coordinate  system. 
The  different  grids  for  this  problem  soluti¬ 
on  are  presented  in  Fig. 1,2  in  the  z-const 
plane. These  grids  have  The  same  cell  number 
in  the  r  direction  and  the  different  cell 
number  in  <f>  direction.  If  the  algorithm  has 
the  weak  symmetry  conservation  property, then 
the  solution  will  be  identical  both  for  the 
grid  shown  in  Fig.  1  and  for  the  grid  shown 
m  Fig. 2  for  all  the  cell  layers  satisfying 
the  fixed  <t>.  However,  the  solution  F  (  r  ) 

obtained  using  the  first  grid,  can  be  diffe¬ 
rent  from  the  solution  F  2  (  r  )  obtained 

using  the  second  grid.  If  the  algorithm  has 
the  strong  symmetry  conservation  property  , 

F  1  (  r  )  fits  F  2  (  r  ). 


Fig.  1 


Fig.  2 


The  important  property  of  mathematicaj 
physical  problems  is  the  independence  fror 
the  coordinate  system,  in  which  they  are  gi¬ 
ven  since  the  problem  itself  does  not  depenc 
on  any  coordinate  system.  In  other  words, the 
equations  of  mathematical  physics  are  writ¬ 
ten  in  the  invariant  vector  (or  tensor] 
form.  It  is  the  numerical  algorithm  that  is 
reproduction  of  this  property  in  analysis. He 


apply  the  term  "invariance"  to  the  calcula¬ 
tion  results  independence  on  choice  of  the 

x,  y,  z  coordinate  system  in  the  space  (R  3  and 
parameterization  (the  mapping  Y).0ur  diffe¬ 
rence  scheme  has  the  invariance  property. 

The  symmetry  conservation  and  invariance 
properties  are  important  in  the  numerical 
solution  of  complex  geometry  problems, where 
the  solution  can  have  various  kinds  of 
symmetry  in  various  parts  of  counting  region 
and  when  it  is  not  clear  what  kina  of 
coordinate  system  shall  we  choose  to  carry 
out  the  analysis. The  strong  symmetry  conser¬ 
vation  property  is  also  necessary  for  sol¬ 
ving  perturbation  problems  close  to  two-  or 
one-dimensional  ones.If  the  numerical  algo¬ 
rithm  has  the  strong  symmetry  conservation 
property,  then  we  can  solve  two-  and  one-di¬ 
mensional  problems  using  the  programs  inten¬ 
ded  for  three  dimensional  calculations. 

Three  problems  are  solved  for  constructi¬ 
on  of  the  difference  scheme.  1. Construction 
of  curvilinear  cells.  2.0btaining  of  invari¬ 
ant  form  of  equations  of  motion  close  to  di¬ 
vergent.  3.  Obtaining  of  formulaes  for  cell 
volumes  and  for  cell  face  areas. 

The  new  method  for  construction  of  curvi¬ 
linear  surfaces  is  proposed. The  novelty  of 
the  method  suggested  is  that,  the  countable 
set  of  points  situated  on  the  surface  is  ge¬ 
nerated  ,  to  begin  with  .  Then  it  is  proved 
that,  there  is  the  Lipshitz  mapping  or  the 

parametric  plane  rectangle  into  a  space  [R  3 
where  the  binary-rational  points  of  the  rec¬ 
tangle  are  in  one-to-one  correspondence  with 
the  plane  points  constructed. By  this  way  the 
surface  is  parametrically  represented. 

The  multi-dimensional  analogue  of  the  Fa¬ 
ber  -  Schauder  basis  for  the  space  of  func¬ 
tions  was  created  for  the  substantiation  of 
the  surface  construction. 

Three  surface  families  covering  the  domain 
so  that  one  and  only  one  surface  of  each  of 
the  families  goes  through  the  each  point  of 
the  domain  generate  three  scalar  equations 
of  motion. Each  of  the  equations  is  generated 
by  one  of  the  surface  families. These  equati¬ 
ons  are  including  only  the  velocity  compo¬ 
nents  obtained  by  its  decomposition  into  da¬ 
tums  that  consist  of  the  vectors  going  nor¬ 
mal  to  or  in  the  main  directions  of  syrfa- 
ces.All  the  geometric  entities  involved  in 
equations  do  not  depend  on  ways  of  specify¬ 
ing  or  parameterizing  surfaces. They  are  de¬ 
fined  by  invariants  of  the  first  and  se¬ 
cond  quadratic  forms. The  differentiation  is 
included  into  the  obtained  equations  only  as 
a  divergence  of  some  vector  fields. 

Proof  of  the  theorem  is  given  in  (11. 

(11  Shvedov  A.S.  Difference  scheme  for  gas 
dynamics  equations, conserving  group  proper¬ 
ties  of  solutions. Matem.zametki,  1990, v. 45, 

N  4, pp. 140-151  (Russian) . (Transl.  in  " Mathe¬ 
matical  Notes") 
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